# Sensu port 3030 not able to huge data.

**URL:** https://discourse.sensu.io/t/sensu-port-3030-not-able-to-huge-data/733
**Category:** Sensu Classic (EOL)
**Created:** [December 14, 2016, 3:08am UTC](https://discourse.sensu.io/t/sensu-port-3030-not-able-to-huge-data/733 "2016-12-14T03:08:38Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Mandava\_Kishore](https://avatars.discourse-cdn.com/v4/letter/m/9d8465/32.png) [@Mandava\_Kishore](https://discourse.sensu.io/u/Mandava_Kishore)
#### Post date: [December 14, 2016, 3:08am UTC](https://discourse.sensu.io/t/sensu-port-3030-not-able-to-huge-data/733/1 "2016-12-14T03:08:38Z")

</div>

Hi,

collecting system logs through Fluentd and pushing logs to Sensu port 3030 using Fluentd-Sensu plugin. Fluentd collecting 100 logs per second and pushing to Sensu port 3030.

When I checked log timestamp in Sensu-client.log, I have seen a lot of time delay from Fluentd.log.I have installed Wireshark and try to check the bottle neck. I found that when ever system log generated, Fluentd read that log and pushing to port 3030 and data sits on port long time. Due to this there is time delay from Fluentd to Sensu client. how can I improve the performance of port?

Fluentd Configuration:

 @type tail path /var/log/secure pos\_file /var/log/fluentd/secure.pos tag secure\_message format syslog

\<match secure\_message.\*\*\>  
type copy  
  
@type stdout  
  
  
@type sensu  
server localhost  
port 3030  
check\_handlers [“hostcollector”]  
check\_name fluentd\_log  
check\_category SECURITY  
check\_type metric  
check\_status 0  
check\_ttl 100

---

<div class="post-metadata">

### Author: ![AB1](https://avatars.discourse-cdn.com/v4/letter/a/d2c977/32.png) [@AB1](https://discourse.sensu.io/u/AB1)
#### Post date: [January 2, 2017, 3:22pm UTC](https://discourse.sensu.io/t/sensu-port-3030-not-able-to-huge-data/733/2 "2017-01-02T15:22:26Z")

</div>

Hi Kishore,

maybe it’s just a use case I don’t know of but why do you point logs at sensu-client? I saw your stackoverflow post.

What do you expect to see in Sensu?

I don’t know Fluentd but seems to be a pretty standard log shipper. I guess [fluent-plugin-sensu](https://github.com/miyakawataku/fluent-plugin-sensu) is supposed to react on log output and create the check payload. Are the JSON payloads correctly structured?

> **[GitHub - miyakawataku/fluent-plugin-sensu: Fluentd output plugin to send...](https://github.com/miyakawataku/fluent-plugin-sensu#check-payload-setting)**
>
> Fluentd output plugin to send checks to sensu-client, which is an agent process of Sensu monitoring framework. - GitHub - miyakawataku/fluent-plugin-sensu: Fluentd output plugin to send checks to s...

Routing 100 checks per second through sensu from logs doesn’t seem like a very good practice to me. We used to ship metrics through sensu and it really put a strain on the sensu server.

You might be better off setting up checks in your log store and send those results to sensu if that’s possible.

More information on what exactly you want to achieve would be good.

-AB

> **···**
>
> On Wednesday, 14 December 2016 04:08:38 UTC+1, Kishore wrote:
> 
> > Hi,
> 
> > 
> 
> > collecting system logs through Fluentd and pushing logs to Sensu port 3030 using Fluentd-Sensu plugin. Fluentd collecting 100 logs per second and pushing to Sensu port 3030.
> 
> > When I checked log timestamp in Sensu-client.log, I have seen a lot of time delay from Fluentd.log.I have installed Wireshark and try to check the bottle neck. I found that when ever system log generated, Fluentd read that log and pushing to port 3030 and data sits on port long time. Due to this there is time delay from Fluentd to Sensu client. how can I improve the performance of port?
> 
> > Fluentd Configuration:
> 
> > 
> 
> > @type tail path /var/log/secure pos\_file /var/log/fluentd/secure.pos tag secure\_message format syslog
> 
> > \<match secure\_message.\*\*\>  
> > type copy  
> >   
> > @type stdout  
> >   
> >   
> > @type sensu  
> > server localhost  
> > port 3030  
> > check\_handlers [“hostcollector”]  
> > check\_name fluentd\_log  
> > check\_category SECURITY  
> > check\_type metric  
> > check\_status 0  
> > check\_ttl 100

---

<div class="post-metadata">

### Author: ![jspaleta](https://sea2.discourse-cdn.com/flex016/user_avatar/discourse.sensu.io/jspaleta/32/141_2.png) [@jspaleta](https://discourse.sensu.io/u/jspaleta)
#### Post date: [November 22, 2018, 2:07am UTC](https://discourse.sensu.io/t/sensu-port-3030-not-able-to-huge-data/733/3 "2018-11-22T02:07:44Z")

</div>


