Running Uchiwa 0.18.1 with Sensu 0.26.3
Production setup has just under 1,000 clients
Seeing a lot of spotty behavior with Uchiwa when nodes are silenced, as under:
Scenario-1
- Silenced all events (~9) for a client
- The “Silenced” page shows all expected entries for the events silenced
- The “Clients” page for that specific client shows the specific checks as silenced, as expected
- The “Events” page shows the silenced icon only against some events (i.e. icon near the checks). It takes several minutes for the silenced icon to show against all. It appears the icon typically changes when the check is next run on that client
Scenario-2
- Silenced a client via the “Clients” page
- Events for that client no longer appear on the “Events” page
The above behavior is not consistently seen but often enough for us to worry that what we are looking in Uchiwa at is not accurate. Anyone else seeing this behavior?
Hi Alex,
Regarding the scenario 1, this is caused by an expected behaviour in Sensu API but undesirable in Uchiwa. I just opened an issue about it: Validate silence & silenced_by attributes in Sensu events · Issue #602 · sensu/uchiwa · GitHub
About the second scenario, you should make sure you have nothing checked within the Hide dropdown in the events view; it looks like the Silenced Clients is currently active in your case.
Thanks,
Simon
···
On Friday, November 18, 2016 at 4:58:03 PM UTC-5, Alex Rodrigues wrote:
Running Uchiwa 0.18.1 with Sensu 0.26.3
Production setup has just under 1,000 clients
Seeing a lot of spotty behavior with Uchiwa when nodes are silenced, as under:
Scenario-1
- Silenced all events (~9) for a client
- The “Silenced” page shows all expected entries for the events silenced
- The “Clients” page for that specific client shows the specific checks as silenced, as expected
- The “Events” page shows the silenced icon only against some events (i.e. icon near the checks). It takes several minutes for the silenced icon to show against all. It appears the icon typically changes when the check is next run on that client
Scenario-2
- Silenced a client via the “Clients” page
- Events for that client no longer appear on the “Events” page
The above behavior is not consistently seen but often enough for us to worry that what we are looking in Uchiwa at is not accurate. Anyone else seeing this behavior?
Hi Simon,
Thanks for opening the issue for Scenario 1.
As for Scenario 2, I did not notice the “Hide” option till now which may quite possibly be the reason, but will keep an eye on it going forward. It is not obvious when the “Hide” filter is enabled, so I might raise a feature request for that
Alex
···
On Monday, November 21, 2016 at 5:57:52 PM UTC-5, Simon Plourde wrote:
Hi Alex,
Regarding the scenario 1, this is caused by an expected behaviour in Sensu API but undesirable in Uchiwa. I just opened an issue about it: https://github.com/sensu/uchiwa/issues/602
About the second scenario, you should make sure you have nothing checked within the Hide dropdown in the events view; it looks like the Silenced Clients is currently active in your case.
Thanks,
Simon
On Friday, November 18, 2016 at 4:58:03 PM UTC-5, Alex Rodrigues wrote:
Running Uchiwa 0.18.1 with Sensu 0.26.3
Production setup has just under 1,000 clients
Seeing a lot of spotty behavior with Uchiwa when nodes are silenced, as under:
Scenario-1
- Silenced all events (~9) for a client
- The “Silenced” page shows all expected entries for the events silenced
- The “Clients” page for that specific client shows the specific checks as silenced, as expected
- The “Events” page shows the silenced icon only against some events (i.e. icon near the checks). It takes several minutes for the silenced icon to show against all. It appears the icon typically changes when the check is next run on that client
Scenario-2
- Silenced a client via the “Clients” page
- Events for that client no longer appear on the “Events” page
The above behavior is not consistently seen but often enough for us to worry that what we are looking in Uchiwa at is not accurate. Anyone else seeing this behavior?