Sensu Client not sending Metrics data to the Server

Sure,

Here is my carbon config file…

Thanks,

Srini

carbon.config file.rtf (2.87 KB)

···

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson wrote:

Well, “True” does look like a valid bool for python to me.

Can you put your carbon config file in a pastebin so I can see it

without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle srin...@gmail.com wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected with below

exceptions, I ams till unable to send data through AMQP whenever I send data

through AMQP carbon-cache gets crashed. Also please advice if below output

is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log | grep -i

“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with

192.168.30.135:47813 lost: Connection to the other side was lost in a

non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache

Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line 90, in

run_twistd_plugin

config.parseOptions(twistd_options)

File “/usr/lib/python2.7/dist-packages/twisted/application/app.py”, line

604, in parseOptions

usage.Options.parseOptions(self, options)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 266,

in parseOptions

self.subOptions.parseOptions(rest)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 276,

in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 197, in

postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 526, in

read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 146, in

readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30, max2su...@gmail.com > > > wrote:

Hi,

       We are facing a problem of not getting any check "metrics"

response from the client while following the tutorial at link Adding a

Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:"determining

stale clients"}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:"publishing

check

request",“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:"publishing

check

result",“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:"Dev.load_avg.one

0.13 1425079537\nDev.load_avg.five 0.12 1425079537\nDev.load_avg.fifteen

0.22 1425079537\n\n",“status”:0}}}

What are the configs that we are missing ?

Thanks:-

I Just resolved boolean true value issues, but still am unable to start sensu-server after having below handler in sensu server. can you please explain me if I need to have any handler in plugins to support amqp?

{

“handlers”: {

"graphite": {

   "type": "amqp",

  "exchange": {

    "type": "topic",

    "name": "metrics",

    "durable": "true"

  },

  "mutator": "only_check_output"

}

}

Below are the errors we are receiving:

{“timestamp”:“2015-06-04T10:03:36.567577+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:03:36.568654+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:04:18.008631+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:04:18.009642+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:04:18.010737+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:53:51.270568+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:53:51.271562+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Thanks,

Srinivas

···

On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle srini5884@gmail.com wrote:

Sure,

Here is my carbon config file…

Thanks,

Srini

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson wrote:

Well, “True” does look like a valid bool for python to me.
Can you put your carbon config file in a pastebin so I can see it
without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle srin...@gmail.com wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected with below
exceptions, I ams till unable to send data through AMQP whenever I send data
through AMQP carbon-cache gets crashed. Also please advice if below output
is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log | grep -i
“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with
192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with
192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with
192.168.30.135:47813 lost: Connection to the other side was lost in a
non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache
    Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line 90, in
run_twistd_plugin

config.parseOptions(twistd_options)

File “/usr/lib/python2.7/dist-packages/twisted/application/app.py”, line
604, in parseOptions

usage.Options.parseOptions(self, options)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 266,
in parseOptions

self.subOptions.parseOptions(rest)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 276,
in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 197, in
postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 526, in
read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 146, in
readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30, max2su...@gmail.com

wrote:

Hi,
We are facing a problem of not getting any check “metrics”
response from the client while following the tutorial at link Adding a
Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:“determining
stale clients”}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:“publishing
check
request”,“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:“publishing
check
result”,“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:“Dev.load_avg.one
0.13 1425079537\nDev.load_avg.five 0.12 1425079537\nDev.load_avg.fifteen
0.22 1425079537\n\n”,“status”:0}}}

What are the configs that we are missing ?

Thanks:-

Below is the sensu config file I have on sensu server"

root@ip-192-168-30-135:/etc/sensu# vi config.json

},

“api”: {

"host": "localhost",

"port": 4567

},

“dashboard”: {

"host": "localhost",

"port": 8080,

"user": "admin",

"password": "secret"

},

“handlers”: {

"graphite": {

   "type": "amqp",

  "exchange": {

    "type": "topic",

    "name": "metrics",

    "durable": "true"

  },

  "mutator": "only_check_output"

}

}

}

···

On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle srini5884@gmail.com wrote:

I Just resolved boolean true value issues, but still am unable to start sensu-server after having below handler in sensu server. can you please explain me if I need to have any handler in plugins to support amqp?

{

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"
}

}

Below are the errors we are receiving:

{“timestamp”:“2015-06-04T10:03:36.567577+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:03:36.568654+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:04:18.008631+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:04:18.009642+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:04:18.010737+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:53:51.270568+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:53:51.271562+0000”,“level”:“warn”,“message”:“config file applied changes”,“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Thanks,

Srinivas

On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle srini5884@gmail.com wrote:

Sure,

Here is my carbon config file…

Thanks,

Srini

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson wrote:

Well, “True” does look like a valid bool for python to me.
Can you put your carbon config file in a pastebin so I can see it
without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle srin...@gmail.com wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected with below
exceptions, I ams till unable to send data through AMQP whenever I send data
through AMQP carbon-cache gets crashed. Also please advice if below output
is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log | grep -i
“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with
192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with
192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with
192.168.30.135:47813 lost: Connection to the other side was lost in a
non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache
    Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line 90, in
run_twistd_plugin

config.parseOptions(twistd_options)

File “/usr/lib/python2.7/dist-packages/twisted/application/app.py”, line
604, in parseOptions

usage.Options.parseOptions(self, options)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 266,
in parseOptions

self.subOptions.parseOptions(rest)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 276,
in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 197, in
postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 526, in
read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 146, in
readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30, max2su...@gmail.com

wrote:

Hi,
We are facing a problem of not getting any check “metrics”
response from the client while following the tutorial at link Adding a
Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:“determining
stale clients”}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:“unknown
handler”,“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:“publishing
check
request”,“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:“publishing
check
result”,“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:“Dev.load_avg.one
0.13 1425079537\nDev.load_avg.five 0.12 1425079537\nDev.load_avg.fifteen
0.22 1425079537\n\n”,“status”:0}}}

What are the configs that we are missing ?

Thanks:-

Again, please use a pastebin to share configuration data like this:

It is impossible to be sure about what your configuration is with
email formatting.

···

On Thu, Jun 4, 2015 at 7:08 AM, Srinivas Palle <srini5884@gmail.com> wrote:

Below is the sensu config file I have on sensu server"

root@ip-192-168-30-135:/etc/sensu# vi config.json

  },

  "api": {

    "host": "localhost",

    "port": 4567

  },

  "dashboard": {

    "host": "localhost",

    "port": 8080,

    "user": "admin",

    "password": "secret"

  },

"handlers": {

    "graphite": {

       "type": "amqp",

      "exchange": {

        "type": "topic",

        "name": "metrics",

        "durable": "true"

      },

      "mutator": "only_check_output"

}

  }

}

On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle <srini5884@gmail.com> wrote:

I Just resolved boolean true value issues, but still am unable to start
sensu-server after having below handler in sensu server. can you please
explain me if I need to have any handler in plugins to support amqp?

{

  "handlers": {

    "graphite": {

       "type": "amqp",

      "exchange": {

        "type": "topic",

        "name": "metrics",

        "durable": "true"

      },

      "mutator": "only_check_output"

    }

  }

Below are the errors we are receiving:

{"timestamp":"2015-06-04T10:03:36.567577+0000","level":"warn","message":"config
file applied
changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"host":"192.168.30.160","port":"2003","type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}

{"timestamp":"2015-06-04T10:03:36.568654+0000","level":"fatal","message":"unknown
handler
type","object":{"host":"192.168.30.160","port":"2003","type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}

{"timestamp":"2015-06-04T10:04:18.008631+0000","level":"warn","message":"config
file applied
changes","file":"/etc/sensu/conf.d/check-disk-fail.json","changes":{"checks":{"diskfail_check":[null,{"type":"amqp","command":"/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb","interval":10,"handlers":["graphite"],"subscribers":["ALL"]}]}}}

{"timestamp":"2015-06-04T10:04:18.009642+0000","level":"warn","message":"config
file applied
changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}

{"timestamp":"2015-06-04T10:04:18.010737+0000","level":"fatal","message":"unknown
handler
type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}

{"timestamp":"2015-06-04T10:53:51.270568+0000","level":"warn","message":"config
file applied
changes","file":"/etc/sensu/conf.d/check-disk-fail.json","changes":{"checks":{"diskfail_check":[null,{"type":"amqp","command":"/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb","interval":10,"handlers":["graphite"],"subscribers":["ALL"]}]}}}

{"timestamp":"2015-06-04T10:53:51.271562+0000","level":"warn","message":"config
file applied
changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}

{"timestamp":"2015-06-04T10:53:51.272595+0000","level":"fatal","message":"unknown
handler
type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}

Thanks,

Srinivas

On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle <srini5884@gmail.com> >> wrote:

Sure,

Here is my carbon config file..

Thanks,
Srini

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson wrote:

Well, "True" does look like a valid bool for python to me.
Can you put your carbon config file in a pastebin so I can see it
without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle <srin...@gmail.com> >>>> wrote:
> Hi Kyle,
>
> My current sensu - graphite set up is working fine as expected with
> below
> exceptions, I ams till unable to send data through AMQP whenever I
> send data
> through AMQP carbon-cache gets crashed. Also please advice if below
> output
> is good to go with?
>
> root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log | grep -i
> "192.168.30.135"
>
> 03/06/2015 18:29:33 :: MetricLineReceiver connection with
> 192.168.30.135:47814 established
>
> 03/06/2015 18:29:33 :: MetricLineReceiver connection with
> 192.168.30.135:47814 closed cleanly
>
> 03/06/2015 18:39:44 :: MetricLineReceiver connection with
> 192.168.30.135:47813 lost: Connection to the other side was lost in a
> non-clean fashion: Connection lost.
>
>
>
> AMQP error:
>
>
> root@ip-192-168-30-160:~# service carbon-cache restart
>
> * Restarting Graphite backend daemon carbon-cache
> Traceback (most recent call last):
>
> File "/usr/bin/carbon-cache", line 32, in <module>
>
> run_twistd_plugin(__file__)
>
> File "/usr/lib/python2.7/dist-packages/carbon/util.py", line 90, in
> run_twistd_plugin
>
> config.parseOptions(twistd_options)
>
> File "/usr/lib/python2.7/dist-packages/twisted/application/app.py",
> line
> 604, in parseOptions
>
> usage.Options.parseOptions(self, options)
>
> File "/usr/lib/python2.7/dist-packages/twisted/python/usage.py",
> line 266,
> in parseOptions
>
> self.subOptions.parseOptions(rest)
>
> File "/usr/lib/python2.7/dist-packages/twisted/python/usage.py",
> line 276,
> in parseOptions
>
> self.postOptions()
>
> File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line 197, in
> postOptions
>
> program_settings = read_config(program, self)
>
> File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line 526, in
> read_config
>
> settings.readFrom(config, section)
>
> File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line 146, in
> readFrom
>
> value = parser.getboolean(section, key)
>
> File "/usr/lib/python2.7/ConfigParser.py", line 370, in getboolean
>
> raise ValueError, 'Not a boolean: %s' % v
>
> ValueError: Not a boolean: True
>
> ENABLE_AMQP = True
>
> AMQP_HOST = 192.168.30.135
>
> AMQP_PORT = 5672
>
> AMQP_VHOST = /sensu
>
> AMQP_USER = sensu
>
> AMQP_PASSWORD = sensu123
>
> AMQP_EXCHANGE = metrics
>
> AMQP_METRIC_NAME_IN_BODY = True
>
> Thanks,Srini
>
>
> On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30, >>>> > max2su...@gmail.com >>>> > wrote:
>>
>> Hi,
>> We are facing a problem of not getting any check "metrics"
>> response from the client while following the tutorial at link Adding
>> a
>> Metric.
>>
>> Following are the outputs :-
>>
>> Server > tail -f /var/log/sensu/sensu-server.log
>>
>>
>>
>> {"timestamp":"2015-02-27T18:23:59.010129-0500","level":"error","message":"unknown
>> handler","handler_name":"default"}
>>
>>
>> {"timestamp":"2015-02-27T18:24:06.362472-0500","level":"info","message":"determining
>> stale clients"}
>>
>>
>> {"timestamp":"2015-02-27T18:24:06.384124-0500","level":"error","message":"unknown
>> handler","handler_name":"default"}
>>
>>
>> {"timestamp":"2015-02-27T18:24:06.386882-0500","level":"error","message":"unknown
>> handler","handler_name":"default"}
>>
>>
>> {"timestamp":"2015-02-27T18:24:06.389126-0500","level":"error","message":"unknown
>> handler","handler_name":"default"}
>>
>>
>> {"timestamp":"2015-02-27T18:24:08.426386-0500","level":"info","message":"publishing
>> check
>>
>> request","payload":{"name":"load_metrics","issued":1425079448,"command":"load-metrics.rb"},"subscribers":["production"]}
>>
>>
>> Client > tail -f /var/log/sensu/sensu-client.log
>>
>>
>>
>> {"timestamp":"2015-02-27T18:25:37.674068-0500","level":"info","message":"publishing
>> check
>>
>> result","payload":{"client":"sensu-client.25.max2","check":{"name":"load_metrics","issued":1425079538,"command":"load-metrics.rb","executed":1425079537,"duration":0.172,"output":"Dev.load_avg.one
>> 0.13 1425079537\nDev.load_avg.five 0.12
>> 1425079537\nDev.load_avg.fifteen
>> 0.22 1425079537\n\n","status":0}}}
>>
>>
>> What are the configs that we are missing ?
>>
>> Thanks:-
>>
>

Again, please email the entire group and not me personally. It allow
others to help if they know.
I will no longer reply-back to your personal emails.

The error that sensu has:
{"timestamp":"2015-06-04T10:53:51.272595+0000","level":"fatal","message":"unknown
handler type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}

Comes from the mutator section of the handler config:

Here are the docs on how to define mutators:
https://sensuapp.org/docs/latest/mutators

It has to be in its own block, it cannot be in the "Handlers" section,
and cannot be in the graphite section.

I also recommend using configuration management (chef/puppet) as they
will prevent you from creating malformed json.

···

On Fri, Jun 5, 2015 at 6:31 AM, Srinivas Palle <srini5884@gmail.com> wrote:

I am trying to data from sensu to graphite through AMQP handler.

Thanks,
Srinivas

On Fri, Jun 5, 2015 at 6:10 PM, Srinivas Palle <srini5884@gmail.com> wrote:

Here is my config file:

AMQP handler configuration:

{ "handlers": { "graphite": { "type": "amqp", "exchange": - Pastebin.com :

Basic sensu config file:

{ "rabbitmq": { "ssl": { "private_key_file": "/etc/sensu/ssl/clie - Pastebin.com

Thanks,
Srinivas

On Fri, Jun 5, 2015 at 10:08 AM, Kyle Anderson <kyle@xkyle.com> wrote:

Again, please use a pastebin to share configuration data like this:
http://pastebin.com/
It is impossible to be sure about what your configuration is with
email formatting.

On Thu, Jun 4, 2015 at 7:08 AM, Srinivas Palle <srini5884@gmail.com> >>> wrote:
> Below is the sensu config file I have on sensu server"
>
> root@ip-192-168-30-135:/etc/sensu# vi config.json
>
>
> },
>
> "api": {
>
> "host": "localhost",
>
> "port": 4567
>
> },
>
> "dashboard": {
>
> "host": "localhost",
>
> "port": 8080,
>
> "user": "admin",
>
> "password": "secret"
>
> },
>
> "handlers": {
>
> "graphite": {
>
> "type": "amqp",
>
> "exchange": {
>
> "type": "topic",
>
> "name": "metrics",
>
> "durable": "true"
>
> },
>
> "mutator": "only_check_output"
>
> }
>
> }
>
> }
>
>
> On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle <srini5884@gmail.com> >>> > wrote:
>>
>> I Just resolved boolean true value issues, but still am unable to
>> start
>> sensu-server after having below handler in sensu server. can you
>> please
>> explain me if I need to have any handler in plugins to support amqp?
>>
>> {
>>
>> "handlers": {
>>
>> "graphite": {
>>
>> "type": "amqp",
>>
>> "exchange": {
>>
>> "type": "topic",
>>
>> "name": "metrics",
>>
>> "durable": "true"
>>
>> },
>>
>> "mutator": "only_check_output"
>>
>> }
>>
>> }
>>
>>
>>
>> Below are the errors we are receiving:
>>
>>
>>
>>
>> {"timestamp":"2015-06-04T10:03:36.567577+0000","level":"warn","message":"config
>> file applied
>>
>> changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"host":"192.168.30.160","port":"2003","type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}
>>
>>
>>
>> {"timestamp":"2015-06-04T10:03:36.568654+0000","level":"fatal","message":"unknown
>> handler
>>
>> type","object":{"host":"192.168.30.160","port":"2003","type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}
>>
>>
>>
>> {"timestamp":"2015-06-04T10:04:18.008631+0000","level":"warn","message":"config
>> file applied
>>
>> changes","file":"/etc/sensu/conf.d/check-disk-fail.json","changes":{"checks":{"diskfail_check":[null,{"type":"amqp","command":"/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb","interval":10,"handlers":["graphite"],"subscribers":["ALL"]}]}}}
>>
>>
>>
>> {"timestamp":"2015-06-04T10:04:18.009642+0000","level":"warn","message":"config
>> file applied
>>
>> changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}
>>
>>
>>
>> {"timestamp":"2015-06-04T10:04:18.010737+0000","level":"fatal","message":"unknown
>> handler
>>
>> type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}
>>
>>
>>
>> {"timestamp":"2015-06-04T10:53:51.270568+0000","level":"warn","message":"config
>> file applied
>>
>> changes","file":"/etc/sensu/conf.d/check-disk-fail.json","changes":{"checks":{"diskfail_check":[null,{"type":"amqp","command":"/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb","interval":10,"handlers":["graphite"],"subscribers":["ALL"]}]}}}
>>
>>
>>
>> {"timestamp":"2015-06-04T10:53:51.271562+0000","level":"warn","message":"config
>> file applied
>>
>> changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}
>>
>>
>>
>> {"timestamp":"2015-06-04T10:53:51.272595+0000","level":"fatal","message":"unknown
>> handler
>>
>> type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}
>>
>>
>>
>> Thanks,
>>
>> Srinivas
>>
>>
>> On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle <srini5884@gmail.com> >>> >> wrote:
>>>
>>> Sure,
>>>
>>> Here is my carbon config file..
>>>
>>> Thanks,
>>> Srini
>>>
>>> On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson >>> >>> wrote:
>>>>
>>>> Well, "True" does look like a valid bool for python to me.
>>>> Can you put your carbon config file in a pastebin so I can see it
>>>> without email formatting?
>>>>
>>>> On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle <srin...@gmail.com> >>> >>>> wrote:
>>>> > Hi Kyle,
>>>> >
>>>> > My current sensu - graphite set up is working fine as expected
>>>> > with
>>>> > below
>>>> > exceptions, I ams till unable to send data through AMQP whenever I
>>>> > send data
>>>> > through AMQP carbon-cache gets crashed. Also please advice if
>>>> > below
>>>> > output
>>>> > is good to go with?
>>>> >
>>>> > root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log |
>>>> > grep -i
>>>> > "192.168.30.135"
>>>> >
>>>> > 03/06/2015 18:29:33 :: MetricLineReceiver connection with
>>>> > 192.168.30.135:47814 established
>>>> >
>>>> > 03/06/2015 18:29:33 :: MetricLineReceiver connection with
>>>> > 192.168.30.135:47814 closed cleanly
>>>> >
>>>> > 03/06/2015 18:39:44 :: MetricLineReceiver connection with
>>>> > 192.168.30.135:47813 lost: Connection to the other side was lost
>>>> > in a
>>>> > non-clean fashion: Connection lost.
>>>> >
>>>> >
>>>> >
>>>> > AMQP error:
>>>> >
>>>> >
>>>> > root@ip-192-168-30-160:~# service carbon-cache restart
>>>> >
>>>> > * Restarting Graphite backend daemon carbon-cache
>>>> > Traceback (most recent call last):
>>>> >
>>>> > File "/usr/bin/carbon-cache", line 32, in <module>
>>>> >
>>>> > run_twistd_plugin(__file__)
>>>> >
>>>> > File "/usr/lib/python2.7/dist-packages/carbon/util.py", line 90,
>>>> > in
>>>> > run_twistd_plugin
>>>> >
>>>> > config.parseOptions(twistd_options)
>>>> >
>>>> > File
>>>> > "/usr/lib/python2.7/dist-packages/twisted/application/app.py",
>>>> > line
>>>> > 604, in parseOptions
>>>> >
>>>> > usage.Options.parseOptions(self, options)
>>>> >
>>>> > File "/usr/lib/python2.7/dist-packages/twisted/python/usage.py",
>>>> > line 266,
>>>> > in parseOptions
>>>> >
>>>> > self.subOptions.parseOptions(rest)
>>>> >
>>>> > File "/usr/lib/python2.7/dist-packages/twisted/python/usage.py",
>>>> > line 276,
>>>> > in parseOptions
>>>> >
>>>> > self.postOptions()
>>>> >
>>>> > File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line
>>>> > 197, in
>>>> > postOptions
>>>> >
>>>> > program_settings = read_config(program, self)
>>>> >
>>>> > File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line
>>>> > 526, in
>>>> > read_config
>>>> >
>>>> > settings.readFrom(config, section)
>>>> >
>>>> > File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line
>>>> > 146, in
>>>> > readFrom
>>>> >
>>>> > value = parser.getboolean(section, key)
>>>> >
>>>> > File "/usr/lib/python2.7/ConfigParser.py", line 370, in
>>>> > getboolean
>>>> >
>>>> > raise ValueError, 'Not a boolean: %s' % v
>>>> >
>>>> > ValueError: Not a boolean: True
>>>> >
>>>> > ENABLE_AMQP = True
>>>> >
>>>> > AMQP_HOST = 192.168.30.135
>>>> >
>>>> > AMQP_PORT = 5672
>>>> >
>>>> > AMQP_VHOST = /sensu
>>>> >
>>>> > AMQP_USER = sensu
>>>> >
>>>> > AMQP_PASSWORD = sensu123
>>>> >
>>>> > AMQP_EXCHANGE = metrics
>>>> >
>>>> > AMQP_METRIC_NAME_IN_BODY = True
>>>> >
>>>> > Thanks,Srini
>>>> >
>>>> >
>>>> > On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30, >>> >>>> > max2su...@gmail.com >>> >>>> > wrote:
>>>> >>
>>>> >> Hi,
>>>> >> We are facing a problem of not getting any check
>>>> >> "metrics"
>>>> >> response from the client while following the tutorial at link
>>>> >> Adding
>>>> >> a
>>>> >> Metric.
>>>> >>
>>>> >> Following are the outputs :-
>>>> >>
>>>> >> Server > tail -f /var/log/sensu/sensu-server.log
>>>> >>
>>>> >>
>>>> >>
>>>> >>
>>>> >> {"timestamp":"2015-02-27T18:23:59.010129-0500","level":"error","message":"unknown
>>>> >> handler","handler_name":"default"}
>>>> >>
>>>> >>
>>>> >>
>>>> >> {"timestamp":"2015-02-27T18:24:06.362472-0500","level":"info","message":"determining
>>>> >> stale clients"}
>>>> >>
>>>> >>
>>>> >>
>>>> >> {"timestamp":"2015-02-27T18:24:06.384124-0500","level":"error","message":"unknown
>>>> >> handler","handler_name":"default"}
>>>> >>
>>>> >>
>>>> >>
>>>> >> {"timestamp":"2015-02-27T18:24:06.386882-0500","level":"error","message":"unknown
>>>> >> handler","handler_name":"default"}
>>>> >>
>>>> >>
>>>> >>
>>>> >> {"timestamp":"2015-02-27T18:24:06.389126-0500","level":"error","message":"unknown
>>>> >> handler","handler_name":"default"}
>>>> >>
>>>> >>
>>>> >>
>>>> >> {"timestamp":"2015-02-27T18:24:08.426386-0500","level":"info","message":"publishing
>>>> >> check
>>>> >>
>>>> >>
>>>> >> request","payload":{"name":"load_metrics","issued":1425079448,"command":"load-metrics.rb"},"subscribers":["production"]}
>>>> >>
>>>> >>
>>>> >> Client > tail -f /var/log/sensu/sensu-client.log
>>>> >>
>>>> >>
>>>> >>
>>>> >>
>>>> >> {"timestamp":"2015-02-27T18:25:37.674068-0500","level":"info","message":"publishing
>>>> >> check
>>>> >>
>>>> >>
>>>> >> result","payload":{"client":"sensu-client.25.max2","check":{"name":"load_metrics","issued":1425079538,"command":"load-metrics.rb","executed":1425079537,"duration":0.172,"output":"Dev.load_avg.one
>>>> >> 0.13 1425079537\nDev.load_avg.five 0.12
>>>> >> 1425079537\nDev.load_avg.fifteen
>>>> >> 0.22 1425079537\n\n","status":0}}}
>>>> >>
>>>> >>
>>>> >> What are the configs that we are missing ?
>>>> >>
>>>> >> Thanks:-
>>>> >>
>>>> >
>>
>>
>

My apologies I ensure to reply all henceforth.

···

On Fri, Jun 5, 2015 at 8:05 PM, Kyle Anderson kyle@xkyle.com wrote:

Again, please email the entire group and not me personally. It allow

others to help if they know.

I will no longer reply-back to your personal emails.

The error that sensu has:

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Comes from the mutator section of the handler config:

http://pastebin.com/7WAEALy3

Here are the docs on how to define mutators:

https://sensuapp.org/docs/latest/mutators

It has to be in its own block, it cannot be in the “Handlers” section,

and cannot be in the graphite section.

I also recommend using configuration management (chef/puppet) as they

will prevent you from creating malformed json.

On Fri, Jun 5, 2015 at 6:31 AM, Srinivas Palle srini5884@gmail.com wrote:

I am trying to data from sensu to graphite through AMQP handler.

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 6:10 PM, Srinivas Palle srini5884@gmail.com wrote:

Here is my config file:

AMQP handler configuration:

http://pastebin.com/7WAEALy3 :

Basic sensu config file:

http://pastebin.com/EkedqsLW

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 10:08 AM, Kyle Anderson kyle@xkyle.com wrote:

Again, please use a pastebin to share configuration data like this:

http://pastebin.com/

It is impossible to be sure about what your configuration is with

email formatting.

On Thu, Jun 4, 2015 at 7:08 AM, Srinivas Palle srini5884@gmail.com

wrote:

Below is the sensu config file I have on sensu server"

root@ip-192-168-30-135:/etc/sensu# vi config.json

},

“api”: {

"host": "localhost",
"port": 4567

},

“dashboard”: {

"host": "localhost",
"port": 8080,
"user": "admin",
"password": "secret"

},

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"

}

}

}

On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle srini5884@gmail.com

wrote:

I Just resolved boolean true value issues, but still am unable to

start

sensu-server after having below handler in sensu server. can you

please

explain me if I need to have any handler in plugins to support amqp?

{

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"
}

}

Below are the errors we are receiving:

{“timestamp”:“2015-06-04T10:03:36.567577+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:03:36.568654+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:04:18.008631+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:04:18.009642+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:04:18.010737+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:53:51.270568+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:53:51.271562+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Thanks,

Srinivas

On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle srini5884@gmail.com

wrote:

Sure,

Here is my carbon config file…

Thanks,

Srini

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson

wrote:

Well, “True” does look like a valid bool for python to me.

Can you put your carbon config file in a pastebin so I can see it

without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle srin...@gmail.com

wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected

with

below

exceptions, I ams till unable to send data through AMQP whenever I

send data

through AMQP carbon-cache gets crashed. Also please advice if

below

output

is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log |

grep -i

“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with

192.168.30.135:47813 lost: Connection to the other side was lost

in a

non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache

Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line 90,

in

run_twistd_plugin

config.parseOptions(twistd_options)

File

“/usr/lib/python2.7/dist-packages/twisted/application/app.py”,

line

604, in parseOptions

usage.Options.parseOptions(self, options)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 266,

in parseOptions

self.subOptions.parseOptions(rest)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 276,

in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

197, in

postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

526, in

read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

146, in

readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in

getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30,

max2su...@gmail.com

wrote:

Hi,

       We are facing a problem of not getting any check

“metrics”

response from the client while following the tutorial at link

Adding

a

Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:"determining

stale clients"}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:"publishing

check

request",“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:"publishing

check

result",“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:"Dev.load_avg.one

0.13 1425079537\nDev.load_avg.five 0.12

1425079537\nDev.load_avg.fifteen

0.22 1425079537\n\n",“status”:0}}}

What are the configs that we are missing ?

Thanks:-

I missed having mutated.rb plugin in sensu server, can this be an issue here?

···

On Fri, Jun 5, 2015 at 8:22 PM, Srinivas Palle srini5884@gmail.com wrote:

My apologies I ensure to reply all henceforth.

On Fri, Jun 5, 2015 at 8:05 PM, Kyle Anderson kyle@xkyle.com wrote:

Again, please email the entire group and not me personally. It allow

others to help if they know.

I will no longer reply-back to your personal emails.

The error that sensu has:

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Comes from the mutator section of the handler config:

http://pastebin.com/7WAEALy3

Here are the docs on how to define mutators:

https://sensuapp.org/docs/latest/mutators

It has to be in its own block, it cannot be in the “Handlers” section,

and cannot be in the graphite section.

I also recommend using configuration management (chef/puppet) as they

will prevent you from creating malformed json.

On Fri, Jun 5, 2015 at 6:31 AM, Srinivas Palle srini5884@gmail.com wrote:

I am trying to data from sensu to graphite through AMQP handler.

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 6:10 PM, Srinivas Palle srini5884@gmail.com wrote:

Here is my config file:

AMQP handler configuration:

http://pastebin.com/7WAEALy3 :

Basic sensu config file:

http://pastebin.com/EkedqsLW

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 10:08 AM, Kyle Anderson kyle@xkyle.com wrote:

Again, please use a pastebin to share configuration data like this:

http://pastebin.com/

It is impossible to be sure about what your configuration is with

email formatting.

On Thu, Jun 4, 2015 at 7:08 AM, Srinivas Palle srini5884@gmail.com

wrote:

Below is the sensu config file I have on sensu server"

root@ip-192-168-30-135:/etc/sensu# vi config.json

},

“api”: {

"host": "localhost",
"port": 4567

},

“dashboard”: {

"host": "localhost",
"port": 8080,
"user": "admin",
"password": "secret"

},

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"

}

}

}

On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle srini5884@gmail.com

wrote:

I Just resolved boolean true value issues, but still am unable to

start

sensu-server after having below handler in sensu server. can you

please

explain me if I need to have any handler in plugins to support amqp?

{

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"
}

}

Below are the errors we are receiving:

{“timestamp”:“2015-06-04T10:03:36.567577+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:03:36.568654+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:04:18.008631+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:04:18.009642+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:04:18.010737+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:53:51.270568+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:53:51.271562+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Thanks,

Srinivas

On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle srini5884@gmail.com

wrote:

Sure,

Here is my carbon config file…

Thanks,

Srini

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson

wrote:

Well, “True” does look like a valid bool for python to me.

Can you put your carbon config file in a pastebin so I can see it

without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle srin...@gmail.com

wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected

with

below

exceptions, I ams till unable to send data through AMQP whenever I

send data

through AMQP carbon-cache gets crashed. Also please advice if

below

output

is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log |

grep -i

“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with

192.168.30.135:47813 lost: Connection to the other side was lost

in a

non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache

Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line 90,

in

run_twistd_plugin

config.parseOptions(twistd_options)

File

“/usr/lib/python2.7/dist-packages/twisted/application/app.py”,

line

604, in parseOptions

usage.Options.parseOptions(self, options)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 266,

in parseOptions

self.subOptions.parseOptions(rest)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 276,

in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

197, in

postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

526, in

read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

146, in

readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in

getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30,

max2su...@gmail.com

wrote:

Hi,

       We are facing a problem of not getting any check

“metrics”

response from the client while following the tutorial at link

Adding

a

Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:"determining

stale clients"}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:"publishing

check

request",“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:"publishing

check

result",“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:"Dev.load_avg.one

0.13 1425079537\nDev.load_avg.five 0.12

1425079537\nDev.load_avg.fifteen

0.22 1425079537\n\n",“status”:0}}}

What are the configs that we are missing ?

Thanks:-

Yes, but the config file is also an issue, and is what the last log is
trying to say.
missing mutator.rb would probably be your next error, but it would be
a more obvious "file not found" or something.

···

On Fri, Jun 5, 2015 at 7:57 AM, Srinivas Palle <srini5884@gmail.com> wrote:

I missed having mutated.rb plugin in sensu server, can this be an issue
here?

On Fri, Jun 5, 2015 at 8:22 PM, Srinivas Palle <srini5884@gmail.com> wrote:

My apologies I ensure to reply all henceforth.

On Fri, Jun 5, 2015 at 8:05 PM, Kyle Anderson <kyle@xkyle.com> wrote:

Again, please email the entire group and not me personally. It allow
others to help if they know.
I will no longer reply-back to your personal emails.

The error that sensu has:

{"timestamp":"2015-06-04T10:53:51.272595+0000","level":"fatal","message":"unknown
handler
type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}

Comes from the mutator section of the handler config:
{ "handlers": { "graphite": { "type": "amqp", "exchange": - Pastebin.com

Here are the docs on how to define mutators:
https://sensuapp.org/docs/latest/mutators

It has to be in its own block, it cannot be in the "Handlers" section,
and cannot be in the graphite section.

I also recommend using configuration management (chef/puppet) as they
will prevent you from creating malformed json.

On Fri, Jun 5, 2015 at 6:31 AM, Srinivas Palle <srini5884@gmail.com> >>> wrote:
> I am trying to data from sensu to graphite through AMQP handler.
>
> Thanks,
> Srinivas
>
>
>
> On Fri, Jun 5, 2015 at 6:10 PM, Srinivas Palle <srini5884@gmail.com> >>> > wrote:
>>
>> Here is my config file:
>>
>> AMQP handler configuration:
>>
>> { "handlers": { "graphite": { "type": "amqp", "exchange": - Pastebin.com :
>>
>> Basic sensu config file:
>>
>> { "rabbitmq": { "ssl": { "private_key_file": "/etc/sensu/ssl/clie - Pastebin.com
>>
>> Thanks,
>> Srinivas
>>
>>
>>
>> On Fri, Jun 5, 2015 at 10:08 AM, Kyle Anderson <kyle@xkyle.com> wrote:
>>>
>>> Again, please use a pastebin to share configuration data like this:
>>> http://pastebin.com/
>>> It is impossible to be sure about what your configuration is with
>>> email formatting.
>>>
>>> On Thu, Jun 4, 2015 at 7:08 AM, Srinivas Palle <srini5884@gmail.com> >>> >>> wrote:
>>> > Below is the sensu config file I have on sensu server"
>>> >
>>> > root@ip-192-168-30-135:/etc/sensu# vi config.json
>>> >
>>> >
>>> > },
>>> >
>>> > "api": {
>>> >
>>> > "host": "localhost",
>>> >
>>> > "port": 4567
>>> >
>>> > },
>>> >
>>> > "dashboard": {
>>> >
>>> > "host": "localhost",
>>> >
>>> > "port": 8080,
>>> >
>>> > "user": "admin",
>>> >
>>> > "password": "secret"
>>> >
>>> > },
>>> >
>>> > "handlers": {
>>> >
>>> > "graphite": {
>>> >
>>> > "type": "amqp",
>>> >
>>> > "exchange": {
>>> >
>>> > "type": "topic",
>>> >
>>> > "name": "metrics",
>>> >
>>> > "durable": "true"
>>> >
>>> > },
>>> >
>>> > "mutator": "only_check_output"
>>> >
>>> > }
>>> >
>>> > }
>>> >
>>> > }
>>> >
>>> >
>>> > On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle >>> >>> > <srini5884@gmail.com> >>> >>> > wrote:
>>> >>
>>> >> I Just resolved boolean true value issues, but still am unable to
>>> >> start
>>> >> sensu-server after having below handler in sensu server. can you
>>> >> please
>>> >> explain me if I need to have any handler in plugins to support
>>> >> amqp?
>>> >>
>>> >> {
>>> >>
>>> >> "handlers": {
>>> >>
>>> >> "graphite": {
>>> >>
>>> >> "type": "amqp",
>>> >>
>>> >> "exchange": {
>>> >>
>>> >> "type": "topic",
>>> >>
>>> >> "name": "metrics",
>>> >>
>>> >> "durable": "true"
>>> >>
>>> >> },
>>> >>
>>> >> "mutator": "only_check_output"
>>> >>
>>> >> }
>>> >>
>>> >> }
>>> >>
>>> >>
>>> >>
>>> >> Below are the errors we are receiving:
>>> >>
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:03:36.567577+0000","level":"warn","message":"config
>>> >> file applied
>>> >>
>>> >>
>>> >> changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"host":"192.168.30.160","port":"2003","type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:03:36.568654+0000","level":"fatal","message":"unknown
>>> >> handler
>>> >>
>>> >>
>>> >> type","object":{"host":"192.168.30.160","port":"2003","type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:04:18.008631+0000","level":"warn","message":"config
>>> >> file applied
>>> >>
>>> >>
>>> >> changes","file":"/etc/sensu/conf.d/check-disk-fail.json","changes":{"checks":{"diskfail_check":[null,{"type":"amqp","command":"/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb","interval":10,"handlers":["graphite"],"subscribers":["ALL"]}]}}}
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:04:18.009642+0000","level":"warn","message":"config
>>> >> file applied
>>> >>
>>> >>
>>> >> changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:04:18.010737+0000","level":"fatal","message":"unknown
>>> >> handler
>>> >>
>>> >>
>>> >> type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:53:51.270568+0000","level":"warn","message":"config
>>> >> file applied
>>> >>
>>> >>
>>> >> changes","file":"/etc/sensu/conf.d/check-disk-fail.json","changes":{"checks":{"diskfail_check":[null,{"type":"amqp","command":"/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb","interval":10,"handlers":["graphite"],"subscribers":["ALL"]}]}}}
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:53:51.271562+0000","level":"warn","message":"config
>>> >> file applied
>>> >>
>>> >>
>>> >> changes","file":"/etc/sensu/conf.d/handler_graphite.json","changes":{"handlers":{"graphite":[null,{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output"}]}}}
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> {"timestamp":"2015-06-04T10:53:51.272595+0000","level":"fatal","message":"unknown
>>> >> handler
>>> >>
>>> >>
>>> >> type","object":{"type":"amqp","exchange":{"type":"topic","name":"metrics","durable":"true"},"mutator":"only_check_output","name":"graphite"}}
>>> >>
>>> >>
>>> >>
>>> >> Thanks,
>>> >>
>>> >> Srinivas
>>> >>
>>> >>
>>> >> On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle >>> >>> >> <srini5884@gmail.com> >>> >>> >> wrote:
>>> >>>
>>> >>> Sure,
>>> >>>
>>> >>> Here is my carbon config file..
>>> >>>
>>> >>> Thanks,
>>> >>> Srini
>>> >>>
>>> >>> On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson >>> >>> >>> wrote:
>>> >>>>
>>> >>>> Well, "True" does look like a valid bool for python to me.
>>> >>>> Can you put your carbon config file in a pastebin so I can see
>>> >>>> it
>>> >>>> without email formatting?
>>> >>>>
>>> >>>> On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle >>> >>> >>>> <srin...@gmail.com> >>> >>> >>>> wrote:
>>> >>>> > Hi Kyle,
>>> >>>> >
>>> >>>> > My current sensu - graphite set up is working fine as expected
>>> >>>> > with
>>> >>>> > below
>>> >>>> > exceptions, I ams till unable to send data through AMQP
>>> >>>> > whenever I
>>> >>>> > send data
>>> >>>> > through AMQP carbon-cache gets crashed. Also please advice if
>>> >>>> > below
>>> >>>> > output
>>> >>>> > is good to go with?
>>> >>>> >
>>> >>>> > root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log |
>>> >>>> > grep -i
>>> >>>> > "192.168.30.135"
>>> >>>> >
>>> >>>> > 03/06/2015 18:29:33 :: MetricLineReceiver connection with
>>> >>>> > 192.168.30.135:47814 established
>>> >>>> >
>>> >>>> > 03/06/2015 18:29:33 :: MetricLineReceiver connection with
>>> >>>> > 192.168.30.135:47814 closed cleanly
>>> >>>> >
>>> >>>> > 03/06/2015 18:39:44 :: MetricLineReceiver connection with
>>> >>>> > 192.168.30.135:47813 lost: Connection to the other side was
>>> >>>> > lost
>>> >>>> > in a
>>> >>>> > non-clean fashion: Connection lost.
>>> >>>> >
>>> >>>> >
>>> >>>> >
>>> >>>> > AMQP error:
>>> >>>> >
>>> >>>> >
>>> >>>> > root@ip-192-168-30-160:~# service carbon-cache restart
>>> >>>> >
>>> >>>> > * Restarting Graphite backend daemon carbon-cache
>>> >>>> > Traceback (most recent call last):
>>> >>>> >
>>> >>>> > File "/usr/bin/carbon-cache", line 32, in <module>
>>> >>>> >
>>> >>>> > run_twistd_plugin(__file__)
>>> >>>> >
>>> >>>> > File "/usr/lib/python2.7/dist-packages/carbon/util.py", line
>>> >>>> > 90,
>>> >>>> > in
>>> >>>> > run_twistd_plugin
>>> >>>> >
>>> >>>> > config.parseOptions(twistd_options)
>>> >>>> >
>>> >>>> > File
>>> >>>> > "/usr/lib/python2.7/dist-packages/twisted/application/app.py",
>>> >>>> > line
>>> >>>> > 604, in parseOptions
>>> >>>> >
>>> >>>> > usage.Options.parseOptions(self, options)
>>> >>>> >
>>> >>>> > File
>>> >>>> > "/usr/lib/python2.7/dist-packages/twisted/python/usage.py",
>>> >>>> > line 266,
>>> >>>> > in parseOptions
>>> >>>> >
>>> >>>> > self.subOptions.parseOptions(rest)
>>> >>>> >
>>> >>>> > File
>>> >>>> > "/usr/lib/python2.7/dist-packages/twisted/python/usage.py",
>>> >>>> > line 276,
>>> >>>> > in parseOptions
>>> >>>> >
>>> >>>> > self.postOptions()
>>> >>>> >
>>> >>>> > File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line
>>> >>>> > 197, in
>>> >>>> > postOptions
>>> >>>> >
>>> >>>> > program_settings = read_config(program, self)
>>> >>>> >
>>> >>>> > File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line
>>> >>>> > 526, in
>>> >>>> > read_config
>>> >>>> >
>>> >>>> > settings.readFrom(config, section)
>>> >>>> >
>>> >>>> > File "/usr/lib/python2.7/dist-packages/carbon/conf.py", line
>>> >>>> > 146, in
>>> >>>> > readFrom
>>> >>>> >
>>> >>>> > value = parser.getboolean(section, key)
>>> >>>> >
>>> >>>> > File "/usr/lib/python2.7/ConfigParser.py", line 370, in
>>> >>>> > getboolean
>>> >>>> >
>>> >>>> > raise ValueError, 'Not a boolean: %s' % v
>>> >>>> >
>>> >>>> > ValueError: Not a boolean: True
>>> >>>> >
>>> >>>> > ENABLE_AMQP = True
>>> >>>> >
>>> >>>> > AMQP_HOST = 192.168.30.135
>>> >>>> >
>>> >>>> > AMQP_PORT = 5672
>>> >>>> >
>>> >>>> > AMQP_VHOST = /sensu
>>> >>>> >
>>> >>>> > AMQP_USER = sensu
>>> >>>> >
>>> >>>> > AMQP_PASSWORD = sensu123
>>> >>>> >
>>> >>>> > AMQP_EXCHANGE = metrics
>>> >>>> >
>>> >>>> > AMQP_METRIC_NAME_IN_BODY = True
>>> >>>> >
>>> >>>> > Thanks,Srini
>>> >>>> >
>>> >>>> >
>>> >>>> > On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30, >>> >>> >>>> > max2su...@gmail.com >>> >>> >>>> > wrote:
>>> >>>> >>
>>> >>>> >> Hi,
>>> >>>> >> We are facing a problem of not getting any check
>>> >>>> >> "metrics"
>>> >>>> >> response from the client while following the tutorial at link
>>> >>>> >> Adding
>>> >>>> >> a
>>> >>>> >> Metric.
>>> >>>> >>
>>> >>>> >> Following are the outputs :-
>>> >>>> >>
>>> >>>> >> Server > tail -f /var/log/sensu/sensu-server.log
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> {"timestamp":"2015-02-27T18:23:59.010129-0500","level":"error","message":"unknown
>>> >>>> >> handler","handler_name":"default"}
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> {"timestamp":"2015-02-27T18:24:06.362472-0500","level":"info","message":"determining
>>> >>>> >> stale clients"}
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> {"timestamp":"2015-02-27T18:24:06.384124-0500","level":"error","message":"unknown
>>> >>>> >> handler","handler_name":"default"}
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> {"timestamp":"2015-02-27T18:24:06.386882-0500","level":"error","message":"unknown
>>> >>>> >> handler","handler_name":"default"}
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> {"timestamp":"2015-02-27T18:24:06.389126-0500","level":"error","message":"unknown
>>> >>>> >> handler","handler_name":"default"}
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> {"timestamp":"2015-02-27T18:24:08.426386-0500","level":"info","message":"publishing
>>> >>>> >> check
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> request","payload":{"name":"load_metrics","issued":1425079448,"command":"load-metrics.rb"},"subscribers":["production"]}
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> Client > tail -f /var/log/sensu/sensu-client.log
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> {"timestamp":"2015-02-27T18:25:37.674068-0500","level":"info","message":"publishing
>>> >>>> >> check
>>> >>>> >>
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> result","payload":{"client":"sensu-client.25.max2","check":{"name":"load_metrics","issued":1425079538,"command":"load-metrics.rb","executed":1425079537,"duration":0.172,"output":"Dev.load_avg.one
>>> >>>> >> 0.13 1425079537\nDev.load_avg.five 0.12
>>> >>>> >> 1425079537\nDev.load_avg.fifteen
>>> >>>> >> 0.22 1425079537\n\n","status":0}}}
>>> >>>> >>
>>> >>>> >>
>>> >>>> >> What are the configs that we are missing ?
>>> >>>> >>
>>> >>>> >> Thanks:-
>>> >>>> >>
>>> >>>> >
>>> >>
>>> >>
>>> >
>>
>>
>

It shows same error as below, am really confused how to set handler config properly now, I just used doc http://www.joemiller.me/2012/02/02/sensu-and-graphite/ to configure amqp handler.

Can you please help me from where I can download mutated.rb plugin?

{“timestamp”:“2015-06-05T14:55:40.452325+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-05T14:55:40.452387+0000”,“level”:“fatal”,“message”:“SENSU NOT RUNNING!”}

···

On Fri, Jun 5, 2015 at 8:29 PM, Kyle Anderson kyle@xkyle.com wrote:

Yes, but the config file is also an issue, and is what the last log is

trying to say.

missing mutator.rb would probably be your next error, but it would be

a more obvious “file not found” or something.

On Fri, Jun 5, 2015 at 7:57 AM, Srinivas Palle srini5884@gmail.com wrote:

I missed having mutated.rb plugin in sensu server, can this be an issue

here?

On Fri, Jun 5, 2015 at 8:22 PM, Srinivas Palle srini5884@gmail.com wrote:

My apologies I ensure to reply all henceforth.

On Fri, Jun 5, 2015 at 8:05 PM, Kyle Anderson kyle@xkyle.com wrote:

Again, please email the entire group and not me personally. It allow

others to help if they know.

I will no longer reply-back to your personal emails.

The error that sensu has:

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Comes from the mutator section of the handler config:

http://pastebin.com/7WAEALy3

Here are the docs on how to define mutators:

https://sensuapp.org/docs/latest/mutators

It has to be in its own block, it cannot be in the “Handlers” section,

and cannot be in the graphite section.

I also recommend using configuration management (chef/puppet) as they

will prevent you from creating malformed json.

On Fri, Jun 5, 2015 at 6:31 AM, Srinivas Palle srini5884@gmail.com

wrote:

I am trying to data from sensu to graphite through AMQP handler.

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 6:10 PM, Srinivas Palle srini5884@gmail.com

wrote:

Here is my config file:

AMQP handler configuration:

http://pastebin.com/7WAEALy3 :

Basic sensu config file:

http://pastebin.com/EkedqsLW

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 10:08 AM, Kyle Anderson kyle@xkyle.com wrote:

Again, please use a pastebin to share configuration data like this:

http://pastebin.com/

It is impossible to be sure about what your configuration is with

email formatting.

On Thu, Jun 4, 2015 at 7:08 AM, Srinivas Palle srini5884@gmail.com

wrote:

Below is the sensu config file I have on sensu server"

root@ip-192-168-30-135:/etc/sensu# vi config.json

},

“api”: {

"host": "localhost",
"port": 4567

},

“dashboard”: {

"host": "localhost",
"port": 8080,
"user": "admin",
"password": "secret"

},

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"

}

}

}

On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle

srini5884@gmail.com

wrote:

I Just resolved boolean true value issues, but still am unable to

start

sensu-server after having below handler in sensu server. can you

please

explain me if I need to have any handler in plugins to support

amqp?

{

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"
}

}

Below are the errors we are receiving:

{“timestamp”:“2015-06-04T10:03:36.567577+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:03:36.568654+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:04:18.008631+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:04:18.009642+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:04:18.010737+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:53:51.270568+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:53:51.271562+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Thanks,

Srinivas

On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle

srini5884@gmail.com

wrote:

Sure,

Here is my carbon config file…

Thanks,

Srini

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson

wrote:

Well, “True” does look like a valid bool for python to me.

Can you put your carbon config file in a pastebin so I can see

it

without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle

srin...@gmail.com

wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected

with

below

exceptions, I ams till unable to send data through AMQP

whenever I

send data

through AMQP carbon-cache gets crashed. Also please advice if

below

output

is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log |

grep -i

“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with

192.168.30.135:47813 lost: Connection to the other side was

lost

in a

non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache

Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line

90,

in

run_twistd_plugin

config.parseOptions(twistd_options)

File

“/usr/lib/python2.7/dist-packages/twisted/application/app.py”,

line

604, in parseOptions

usage.Options.parseOptions(self, options)

File

“/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 266,

in parseOptions

self.subOptions.parseOptions(rest)

File

“/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 276,

in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

197, in

postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

526, in

read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

146, in

readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in

getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30,

max2su...@gmail.com

wrote:

Hi,

       We are facing a problem of not getting any check

“metrics”

response from the client while following the tutorial at link

Adding

a

Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:"determining

stale clients"}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:"publishing

check

request",“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:"publishing

check

result",“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:"Dev.load_avg.one

0.13 1425079537\nDev.load_avg.five 0.12

1425079537\nDev.load_avg.fifteen

0.22 1425079537\n\n",“status”:0}}}

What are the configs that we are missing ?

Thanks:-

Now I removed mutators in handler config file but still I get error as unknown handler:

···

On Fri, Jun 5, 2015 at 8:32 PM, Srinivas Palle srini5884@gmail.com wrote:

It shows same error as below, am really confused how to set handler config properly now, I just used doc http://www.joemiller.me/2012/02/02/sensu-and-graphite/ to configure amqp handler.

Can you please help me from where I can download mutated.rb plugin?

{“timestamp”:“2015-06-05T14:55:40.452325+0000”,“level”:“fatal”,“message”:“unknown handler type”,“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-05T14:55:40.452387+0000”,“level”:“fatal”,“message”:“SENSU NOT RUNNING!”}

On Fri, Jun 5, 2015 at 8:29 PM, Kyle Anderson kyle@xkyle.com wrote:

Yes, but the config file is also an issue, and is what the last log is

trying to say.

missing mutator.rb would probably be your next error, but it would be

a more obvious “file not found” or something.

On Fri, Jun 5, 2015 at 7:57 AM, Srinivas Palle srini5884@gmail.com wrote:

I missed having mutated.rb plugin in sensu server, can this be an issue

here?

On Fri, Jun 5, 2015 at 8:22 PM, Srinivas Palle srini5884@gmail.com wrote:

My apologies I ensure to reply all henceforth.

On Fri, Jun 5, 2015 at 8:05 PM, Kyle Anderson kyle@xkyle.com wrote:

Again, please email the entire group and not me personally. It allow

others to help if they know.

I will no longer reply-back to your personal emails.

The error that sensu has:

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Comes from the mutator section of the handler config:

http://pastebin.com/7WAEALy3

Here are the docs on how to define mutators:

https://sensuapp.org/docs/latest/mutators

It has to be in its own block, it cannot be in the “Handlers” section,

and cannot be in the graphite section.

I also recommend using configuration management (chef/puppet) as they

will prevent you from creating malformed json.

On Fri, Jun 5, 2015 at 6:31 AM, Srinivas Palle srini5884@gmail.com

wrote:

I am trying to data from sensu to graphite through AMQP handler.

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 6:10 PM, Srinivas Palle srini5884@gmail.com

wrote:

Here is my config file:

AMQP handler configuration:

http://pastebin.com/7WAEALy3 :

Basic sensu config file:

http://pastebin.com/EkedqsLW

Thanks,

Srinivas

On Fri, Jun 5, 2015 at 10:08 AM, Kyle Anderson kyle@xkyle.com wrote:

Again, please use a pastebin to share configuration data like this:

http://pastebin.com/

It is impossible to be sure about what your configuration is with

email formatting.

On Thu, Jun 4, 2015 at 7:08 AM, Srinivas Palle srini5884@gmail.com

wrote:

Below is the sensu config file I have on sensu server"

root@ip-192-168-30-135:/etc/sensu# vi config.json

},

“api”: {

"host": "localhost",
"port": 4567

},

“dashboard”: {

"host": "localhost",
"port": 8080,
"user": "admin",
"password": "secret"

},

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"

}

}

}

On Thu, Jun 4, 2015 at 7:27 PM, Srinivas Palle

srini5884@gmail.com

wrote:

I Just resolved boolean true value issues, but still am unable to

start

sensu-server after having below handler in sensu server. can you

please

explain me if I need to have any handler in plugins to support

amqp?

{

“handlers”: {

"graphite": {
   "type": "amqp",
  "exchange": {
    "type": "topic",
    "name": "metrics",
    "durable": "true"
  },
  "mutator": "only_check_output"
}

}

Below are the errors we are receiving:

{“timestamp”:“2015-06-04T10:03:36.567577+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:03:36.568654+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“host”:“192.168.30.160”,“port”:“2003”,“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:04:18.008631+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:04:18.009642+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:04:18.010737+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

{“timestamp”:“2015-06-04T10:53:51.270568+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/check-disk-fail.json”,“changes”:{“checks”:{“diskfail_check”:[null,{“type”:“amqp”,“command”:“/etc/sensu/plugins/sensu-community-plugins/plugins/system/check-disk-fail.rb”,“interval”:10,“handlers”:[“graphite”],“subscribers”:[“ALL”]}]}}}

{“timestamp”:“2015-06-04T10:53:51.271562+0000”,“level”:“warn”,“message”:"config

file applied

changes",“file”:“/etc/sensu/conf.d/handler_graphite.json”,“changes”:{“handlers”:{“graphite”:[null,{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”}]}}}

{“timestamp”:“2015-06-04T10:53:51.272595+0000”,“level”:“fatal”,“message”:"unknown

handler

type",“object”:{“type”:“amqp”,“exchange”:{“type”:“topic”,“name”:“metrics”,“durable”:“true”},“mutator”:“only_check_output”,“name”:“graphite”}}

Thanks,

Srinivas

On Thu, Jun 4, 2015 at 9:54 AM, Srinivas Palle

srini5884@gmail.com

wrote:

Sure,

Here is my carbon config file…

Thanks,

Srini

On Thursday, June 4, 2015 at 9:13:19 AM UTC+5:30, Kyle Anderson

wrote:

Well, “True” does look like a valid bool for python to me.

Can you put your carbon config file in a pastebin so I can see

it

without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle

srin...@gmail.com

wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected

with

below

exceptions, I ams till unable to send data through AMQP

whenever I

send data

through AMQP carbon-cache gets crashed. Also please advice if

below

output

is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log |

grep -i

“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with

192.168.30.135:47813 lost: Connection to the other side was

lost

in a

non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache

Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line

90,

in

run_twistd_plugin

config.parseOptions(twistd_options)

File

“/usr/lib/python2.7/dist-packages/twisted/application/app.py”,

line

604, in parseOptions

usage.Options.parseOptions(self, options)

File

“/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 266,

in parseOptions

self.subOptions.parseOptions(rest)

File

“/usr/lib/python2.7/dist-packages/twisted/python/usage.py”,

line 276,

in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

197, in

postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

526, in

read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line

146, in

readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in

getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30,

max2su...@gmail.com

wrote:

Hi,

       We are facing a problem of not getting any check

“metrics”

response from the client while following the tutorial at link

Adding

a

Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:"determining

stale clients"}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:"publishing

check

request",“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:"publishing

check

result",“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:"Dev.load_avg.one

0.13 1425079537\nDev.load_avg.five 0.12

1425079537\nDev.load_avg.fifteen

0.22 1425079537\n\n",“status”:0}}}

What are the configs that we are missing ?

Thanks:-

Any update please?

Do sensu opensource supports sending data to graphite through AMQP? I am just waiting to have handler and mutator which supports handler to post data through AMQP.

Can someone please share if you have those details?

Thanks,

Srini

···

On Thu, Jun 4, 2015 at 9:13 AM, Kyle Anderson kyle@xkyle.com wrote:

Well, “True” does look like a valid bool for python to me.

Can you put your carbon config file in a pastebin so I can see it

without email formatting?

On Wed, Jun 3, 2015 at 11:45 AM, Srinivas Palle srini5884@gmail.com wrote:

Hi Kyle,

My current sensu - graphite set up is working fine as expected with below

exceptions, I ams till unable to send data through AMQP whenever I send data

through AMQP carbon-cache gets crashed. Also please advice if below output

is good to go with?

root@ip-192-168-30-160:/var/log/carbon# tail -f listener.log | grep -i

“192.168.30.135”

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 established

03/06/2015 18:29:33 :: MetricLineReceiver connection with

192.168.30.135:47814 closed cleanly

03/06/2015 18:39:44 :: MetricLineReceiver connection with

192.168.30.135:47813 lost: Connection to the other side was lost in a

non-clean fashion: Connection lost.

AMQP error:

root@ip-192-168-30-160:~# service carbon-cache restart

  • Restarting Graphite backend daemon carbon-cache

Traceback (most recent call last):

File “/usr/bin/carbon-cache”, line 32, in

run_twistd_plugin(__file__)

File “/usr/lib/python2.7/dist-packages/carbon/util.py”, line 90, in

run_twistd_plugin

config.parseOptions(twistd_options)

File “/usr/lib/python2.7/dist-packages/twisted/application/app.py”, line

604, in parseOptions

usage.Options.parseOptions(self, options)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 266,

in parseOptions

self.subOptions.parseOptions(rest)

File “/usr/lib/python2.7/dist-packages/twisted/python/usage.py”, line 276,

in parseOptions

self.postOptions()

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 197, in

postOptions

program_settings = read_config(program, self)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 526, in

read_config

settings.readFrom(config, section)

File “/usr/lib/python2.7/dist-packages/carbon/conf.py”, line 146, in

readFrom

value = parser.getboolean(section, key)

File “/usr/lib/python2.7/ConfigParser.py”, line 370, in getboolean

raise ValueError, 'Not a boolean: %s' % v

ValueError: Not a boolean: True

ENABLE_AMQP = True

AMQP_HOST = 192.168.30.135

AMQP_PORT = 5672

AMQP_VHOST = /sensu

AMQP_USER = sensu

AMQP_PASSWORD = sensu123

AMQP_EXCHANGE = metrics

AMQP_METRIC_NAME_IN_BODY = True

                               Thanks,Srini

On Saturday, February 28, 2015 at 4:58:56 AM UTC+5:30, max2su...@gmail.com

wrote:

Hi,

       We are facing a problem of not getting any check "metrics"

response from the client while following the tutorial at link Adding a

Metric.

Following are the outputs :-

Server > tail -f /var/log/sensu/sensu-server.log

{“timestamp”:“2015-02-27T18:23:59.010129-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.362472-0500”,“level”:“info”,“message”:"determining

stale clients"}

{“timestamp”:“2015-02-27T18:24:06.384124-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.386882-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:06.389126-0500”,“level”:“error”,“message”:"unknown

handler",“handler_name”:“default”}

{“timestamp”:“2015-02-27T18:24:08.426386-0500”,“level”:“info”,“message”:"publishing

check

request",“payload”:{“name”:“load_metrics”,“issued”:1425079448,“command”:“load-metrics.rb”},“subscribers”:[“production”]}

Client > tail -f /var/log/sensu/sensu-client.log

{“timestamp”:“2015-02-27T18:25:37.674068-0500”,“level”:“info”,“message”:"publishing

check

result",“payload”:{“client”:“sensu-client.25.max2”,“check”:{“name”:“load_metrics”,“issued”:1425079538,“command”:“load-metrics.rb”,“executed”:1425079537,“duration”:0.172,“output”:"Dev.load_avg.one

0.13 1425079537\nDev.load_avg.five 0.12 1425079537\nDev.load_avg.fifteen

0.22 1425079537\n\n",“status”:0}}}

What are the configs that we are missing ?

Thanks:-