# sensu server is not clearing down some random client queues in rabbit.

**URL:** https://discourse.sensu.io/t/sensu-server-is-not-clearing-down-some-random-client-queues-in-rabbit/645
**Category:** Sensu Classic (EOL)
**Created:** [July 29, 2016, 10:25am UTC](https://discourse.sensu.io/t/sensu-server-is-not-clearing-down-some-random-client-queues-in-rabbit/645 "2016-07-29T10:25:56Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Owain\_Perry](https://avatars.discourse-cdn.com/v4/letter/o/b5a626/32.png) [@Owain\_Perry](https://discourse.sensu.io/u/Owain_Perry)
#### Post date: [July 29, 2016, 10:25am UTC](https://discourse.sensu.io/t/sensu-server-is-not-clearing-down-some-random-client-queues-in-rabbit/645/1 "2016-07-29T10:25:56Z")

</div>

Hi,

So I have 3 sensu servers version 0.25 running with roughly 1000 clients, at random points during a day sensu-server process seems stop clearing down the queues for a few clients (between about 4 and 10), these queue build up with new messages.

If I delete these queues, they are recreated and everything works as before. The keepalives are processed the whole time. and all the other queues have zero messages (as in sensu is keeping up with processing them OK)

just as an experiment I have tried:

restarting sensu-server process on all servers.

restarting each node in the rabbit cluster.

One thing to note is that all communication to rabbit goes via an AWS Elastic Load Balancer.

Does anyone have any thoughts or ideas of how I can debug what might be happening?

Cheers.

Owain.

---

<div class="post-metadata">

### Author: ![Kyle\_Anderson](https://avatars.discourse-cdn.com/v4/letter/k/e5b9ba/32.png) [@Kyle\_Anderson](https://discourse.sensu.io/u/Kyle_Anderson)
#### Post date: [July 30, 2016, 3:31pm UTC](https://discourse.sensu.io/t/sensu-server-is-not-clearing-down-some-random-client-queues-in-rabbit/645/2 "2016-07-30T15:31:21Z")

</div>

ELBs can have their quirks, but the symptoms don’t really describe an issue with the queue+lb itself, especially if it is just for a few clients?  
Just in case can you look at the ELB metrics to make sure that it isn’t getting in the way?

> **···**
>
> On Fri, Jul 29, 2016 at 3:25 AM, Owain Perry [owain.perry@gmail.com](mailto:owain.perry@gmail.com) wrote:
> 
> > Hi,
> 
> > So I have 3 sensu servers version 0.25 running with roughly 1000 clients, at random points during a day sensu-server process seems stop clearing down the queues for a few clients (between about 4 and 10), these queue build up with new messages.
> 
> > 
> 
> > If I delete these queues, they are recreated and everything works as before. The keepalives are processed the whole time. and all the other queues have zero messages (as in sensu is keeping up with processing them OK)
> 
> > 
> 
> > just as an experiment I have tried:
> 
> > 
> 
> > restarting sensu-server process on all servers.
> 
> > restarting each node in the rabbit cluster.
> 
> > 
> 
> > One thing to note is that all communication to rabbit goes via an AWS Elastic Load Balancer.
> 
> > 
> 
> > Does anyone have any thoughts or ideas of how I can debug what might be happening?
> 
> > 
> 
> > Cheers.
> 
> > 
> 
> > Owain.
> 
> >

---

<div class="post-metadata">

### Author: ![Kyle\_Anderson](https://avatars.discourse-cdn.com/v4/letter/k/e5b9ba/32.png) [@Kyle\_Anderson](https://discourse.sensu.io/u/Kyle_Anderson)
#### Post date: [July 30, 2016, 3:31pm UTC](https://discourse.sensu.io/t/sensu-server-is-not-clearing-down-some-random-client-queues-in-rabbit/645/3 "2016-07-30T15:31:26Z")

</div>

[http://docs.aws.amazon.com/ElasticLoadBalancing/latest/DeveloperGuide/elb-cloudwatch-metrics.html](http://docs.aws.amazon.com/ElasticLoadBalancing/latest/DeveloperGuide/elb-cloudwatch-metrics.html)

> **···**
>
> On Sat, Jul 30, 2016 at 8:31 AM, Kyle Anderson [kyle@xkyle.com](mailto:kyle@xkyle.com) wrote:
> 
> > ELBs can have their quirks, but the symptoms don’t really describe an issue with the queue+lb itself, especially if it is just for a few clients?  
> > Just in case can you look at the ELB metrics to make sure that it isn’t getting in the way?
> 
> On Fri, Jul 29, 2016 at 3:25 AM, Owain Perry [owain.perry@gmail.com](mailto:owain.perry@gmail.com) wrote:
> 
> > Hi,
> 
> > So I have 3 sensu servers version 0.25 running with roughly 1000 clients, at random points during a day sensu-server process seems stop clearing down the queues for a few clients (between about 4 and 10), these queue build up with new messages.
> 
> > 
> 
> > If I delete these queues, they are recreated and everything works as before. The keepalives are processed the whole time. and all the other queues have zero messages (as in sensu is keeping up with processing them OK)
> 
> > 
> 
> > just as an experiment I have tried:
> 
> > 
> 
> > restarting sensu-server process on all servers.
> 
> > restarting each node in the rabbit cluster.
> 
> > 
> 
> > One thing to note is that all communication to rabbit goes via an AWS Elastic Load Balancer.
> 
> > 
> 
> > Does anyone have any thoughts or ideas of how I can debug what might be happening?
> 
> > 
> 
> > Cheers.
> 
> > 
> 
> > Owain.
> 
> >
