Hello.
I’m having a problem recently starting my sensu-backend instance, this instance worked before flawless but I don’t know why it stoped working. It’s installed on a debian 10 instance and runing “native” not using docker or something like that.
Actually when i execute systemctl the unit seems to work but I don’t see anything on the port 3000, that was the port I was using before. And scanning with nmap I don’t see other ports opened either.
The component that is showing errors is etcd but I havent done any configuration related to that.
systemctl status sensu-backend
● sensu-backend.service - The Sensu Backend service.
Loaded: loaded (/lib/systemd/system/sensu-backend.service; enabled; vendor preset: enabled)
Active: active (running) since Tue 2020-09-29 08:31:42 UTC; 9min ago
Main PID: 17716 (sensu-backend)
Tasks: 21 (limit: 4915)
Memory: 53.0M
CGroup: /system.slice/sensu-backend.service
└─17716 /usr/sbin/sensu-backend start -c /etc/sensu/backend.yml
Sep 29 08:32:20 panoptic sensu-backend[17716]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:32:20Z"}
Sep 29 08:32:27 panoptic sensu-backend[17716]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:32:27Z"}
Sep 29 08:32:34 panoptic sensu-backend[17716]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:32:34Z"}
Sep 29 08:32:41 panoptic sensu-backend[17716]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:32:41Z"}
Sep 29 08:32:45 panoptic sensu-backend[17716]: {"component":"etcd","level":"info","msg":"skipped leadership transfer for single member cluster","pkg":"etcdserver","time":"2020-09-29T08:32:45Z"}
Sep 29 08:32:45 panoptic sensu-backend[17716]: {"component":"etcd","level":"info","msg":"aborting publish because server is stopped","pkg":"etcdserver","time":"2020-09-29T08:32:45Z"}
Sep 29 08:36:45 panoptic sensu-backend[17716]: {"component":"etcd","level":"warning","msg":"Starting auto-compaction at revision 10995864 (retention: 2 revisions)","pkg":"compactor","time":"2020-09-29T08:36:45Z"}
Sep 29 08:36:45 panoptic sensu-backend[17716]: {"component":"etcd","level":"warning","msg":"Failed auto-compaction at revision 10995864 (etcdserver: too many requests)","pkg":"compactor","time":"2020-09-29T08:36:45Z"}
Sep 29 08:36:45 panoptic sensu-backend[17716]: {"component":"etcd","level":"warning","msg":"Retry after 5m0s","pkg":"compactor","time":"2020-09-29T08:36:45Z"}
Sep 29 08:38:20 panoptic sensu-backend[17716]: {"component":"etcd","level":"warning","msg":"request \"ID:6390454415251518722 Method:\\\"PUT\\\" Path:\\\"/0/members/8927110dc66458af/attributes\\\" Val:\\\"{\\\\\\\"name\\\\\\\":\\\\\\\"defa
journalctl -xe -u sensu-backend
Sep 29 08:24:25 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out, possibly due to previous leader failure","pkg":"etcdserver","time":"2020-09-29T08:24:25Z"}
Sep 29 08:24:30 panoptic sensu-backend[17588]: {"component":"etcd","level":"warning","msg":"request \"ID:6390454477382486530 Method:\\\"PUT\\\" Path:\\\"/0/members/8927110dc66458af/attributes\\\" Val:\\\"{\\\\\\\"name\\\\\\\":\\\\\\\"defa
Sep 29 08:24:32 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:24:32Z"}
Sep 29 08:24:39 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:24:39Z"}
Sep 29 08:24:46 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:24:46Z"}
Sep 29 08:24:53 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:24:53Z"}
Sep 29 08:25:00 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:25:00Z"}
Sep 29 08:25:07 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:25:07Z"}
Sep 29 08:25:14 panoptic sensu-backend[17588]: {"component":"etcd","level":"error","msg":"publish error: etcdserver: request timed out","pkg":"etcdserver","time":"2020-09-29T08:25:14Z"}
Sep 29 08:25:18 panoptic sensu-backend[17588]: {"component":"etcd","level":"info","msg":"skipped leadership transfer for single member cluster","pkg":"etcdserver","time":"2020-09-29T08:25:18Z"}
Sep 29 08:25:18 panoptic sensu-backend[17588]: {"component":"etcd","level":"info","msg":"aborting publish because server is stopped","pkg":"etcdserver","time":"2020-09-29T08:25:18Z"}
Sep 29 08:27:24 panoptic sensu-backend[17588]: {"component":"etcd","level":"warning","msg":"request \"ID:6390454665695194370 Method:\\\"PUT\\\" Path:\\\"/0/members/8927110dc66458af/attributes\\\" Val:\\\"{\\\\\\\"name\\\\\\\":\\\\\\\"defa
Sep 29 08:29:18 panoptic sensu-backend[17588]: {"component":"etcd","level":"warning","msg":"Starting auto-compaction at revision 10995864 (retention: 2 revisions)","pkg":"compactor","time":"2020-09-29T08:29:18Z"}
Sep 29 08:29:18 panoptic sensu-backend[17588]: {"component":"etcd","level":"warning","msg":"Failed auto-compaction at revision 10995864 (etcdserver: too many requests)","pkg":"compactor","time":"2020-09-29T08:29:18Z"}
Sep 29 08:29:18 panoptic sensu-backend[17588]: {"component":"etcd","level":"warning","msg":"Retry after 5m0s","pkg":"compactor","time":"2020-09-29T08:29:18Z"}
backend.yml
---
state-dir: "/var/lib/sensu/sensu-backend"
log-level: "debug" # available log levels: panic, fatal, error, warn, info, debug
cert-file: "/etc/sensu/mycert/fullchain.pem"
key-file: "/etc/sensu/mycert/privkey.pem"