Collected restart issues & Invalid line error in listeners log

[srini5884]

Hi All,

Can someone please let me know if there any bugs with collectd.conf ? I do see lot of errors reporting the same on one particular but unfortunately none of the provided solutions are working.

Please help me how to resolve these issues?

• Restarting statistics collection and monitoring daemon collectd Parse error in file /etc/collectd/collectd.conf', line 1100 near': syntax error, unexpected $end, expecting UNQUOTED_STRING or OPENBRAC or EOL

yyparse returned error #1

configfile: Cannot read file `/etc/collectd/collectd.conf'.

Unable to read config file /etc/collectd/collectd.conf.

Error: Reading the config file failed!

Read the syslog for details.

Thanks,

Srinivas

[arielshaqed]

Hi srinni5884, I think you forgot to attach your collectd.conf...

Thanks,

Ariel.

[srini5884]

My Apologies,

Attaching now ...

[srini5884]

Thanks for your response, am really having difficulties in integrating sensu with graphite...

Please help me to close this issue.

Below are listeners logs an another blocker..

Listeners log:

ubuntu@ip-192-168-30-160:/var/log/carbon$ tail -f listener.log

08/05/2015 13:22:06 :: MetricLineReceiver connection with 192.168.30.135:36139 closed cleanly

08/05/2015 13:23:06 :: MetricLineReceiver connection with 192.168.30.135:36155 established

08/05/2015 13:23:06 :: invalid line received from client 192.168.30.135:36155, ignoring

[srini5884]

I am unable to upload rtf file in this blog, I apologize for sharing config file in text format.

[srini5884]

[srini5884]

[srini5884]

to explain more about my set up, I am running Sensu server and graphite server on two instances. Using graphite-tcp.rb handlers to redirect output to graphite along with plugins check-data.rb, check-cpu.rb, check-disk.rb.

I am trying to make use of graphite for graphical interface to pull down metrics whenever required.

[srini5884]

May I know what are the important daemons required in Graphite to pull the client information and save the data?

I am not sure if collectd is a major cause blocking me..

Let me know if I need any additional plugins to have clients information in grpahite.

[arielshaqed]

Hi,

It's a bit hard to tell, without plain-text config files and logs attached. You might have better luck using email for that than the GitHub interface.

But it appears your collect.conf is 1099 lines long, so the error you're getting is on the last line. The last stanza in the file is:

<Include "/etc/collectd/collectd.conf.d"> Filter "*.conf"

so I would start by eliminating all unneeded files in /etc/collectd/collectd.conf.d.

HTH,

Ariel.

On Mon, May 11, 2015 at 5:51 PM, srini5884 notifications@github.com wrote:

Config file for collectd(1).

# Some plugins need additional configuration and are disabled by default. Please read collectd.conf(5) for details.

# You should also read /usr/share/doc/collectd-core/README.Debian.plugins before enabling any more plugins.

############################################################################## Global

----------------------------------------------------------------------------

Global settings for the daemon.

##############################################################################

Hostname "localhost" FQDNLookup true

BaseDir "/var/lib/collectd"

PluginDir "/usr/lib/collectd"

TypesDB "/usr/share/collectd/types.db" "/etc/collectd/my_types.db"

----------------------------------------------------------------------------

When enabled, plugins are loaded automatically with the default options when an appropriate block is encountered. Disabled by default.

----------------------------------------------------------------------------

AutoLoadPlugin false

----------------------------------------------------------------------------

Interval at which to query values. This may be overwritten on a per-plugin base by using the 'Interval' option of the LoadPlugin block: Interval 60

----------------------------------------------------------------------------

Interval 10

Timeout 2

ReadThreads 5

WriteThreads 5

Limit the size of the write queue. Default is no limit. Setting up a limit is recommended for servers handling a high volume of traffic.

WriteQueueLimitHigh 1000000

WriteQueueLimitLow 800000

############################################################################## Logging

----------------------------------------------------------------------------

Plugins which provide logging functions should be loaded first, so log messages generated when loading or configuring other plugins can be accessed.

##############################################################################

LoadPlugin logfile

LoadPlugin syslog

# LogLevel "info" File STDOUT Timestamp true PrintSeverity false

#

LogLevel info

############################################################################## LoadPlugin section

----------------------------------------------------------------------------

Specify what features to activate.

##############################################################################

LoadPlugin aggregation

LoadPlugin amqp

LoadPlugin apache

LoadPlugin apcups

LoadPlugin ascent

LoadPlugin battery

LoadPlugin bind

LoadPlugin cgroups

LoadPlugin conntrack

LoadPlugin contextswitch

LoadPlugin cpu

LoadPlugin cpufreq

LoadPlugin csv

LoadPlugin curl

LoadPlugin curl_json

LoadPlugin curl_xml

LoadPlugin dbi

LoadPlugin df LoadPlugin disk

LoadPlugin dns

LoadPlugin email

LoadPlugin entropy

LoadPlugin ethstat

LoadPlugin exec

LoadPlugin filecount

LoadPlugin fscache

LoadPlugin gmond

LoadPlugin hddtemp

LoadPlugin interface

LoadPlugin ipmi

LoadPlugin iptables

LoadPlugin ipvs

LoadPlugin irq

LoadPlugin java

LoadPlugin libvirt

LoadPlugin load

LoadPlugin lvm

LoadPlugin madwifi

LoadPlugin mbmon

LoadPlugin md

LoadPlugin memcachec

LoadPlugin memcached

LoadPlugin memory

LoadPlugin modbus

LoadPlugin multimeter

LoadPlugin mysql

LoadPlugin netlink

LoadPlugin network

LoadPlugin nfs

LoadPlugin nginx

LoadPlugin notify_desktop

LoadPlugin notify_email

LoadPlugin ntpd

LoadPlugin numa

LoadPlugin nut

LoadPlugin olsrd

LoadPlugin openvpn

# Globals true

#

LoadPlugin pinba

LoadPlugin ping

LoadPlugin postgresql

LoadPlugin powerdns

LoadPlugin processes

LoadPlugin protocols

# Globals true

#

LoadPlugin rrdcached

LoadPlugin rrdtool

LoadPlugin sensors

LoadPlugin serial

LoadPlugin snmp

LoadPlugin statsd

LoadPlugin swap

LoadPlugin table

LoadPlugin tail

LoadPlugin tail_csv

LoadPlugin tcpconns

LoadPlugin teamspeak2

LoadPlugin ted

LoadPlugin thermal

LoadPlugin tokyotyrant

LoadPlugin unixsock

LoadPlugin uptime

LoadPlugin users

LoadPlugin uuid

LoadPlugin varnish

LoadPlugin vmem

LoadPlugin vserver

LoadPlugin wireless

LoadPlugin write_graphite

LoadPlugin write_http

LoadPlugin write_riemann

############################################################################## Plugin configuration

----------------------------------------------------------------------------

In this section configuration stubs for each plugin are provided. A desc- ription of those options is available in the collectd.conf(5) manual page.

##############################################################################

#

Host "unspecified" Plugin "cpu" PluginInstance "/[0,2,4,6,8]$/" Type

"cpu" #TypeInstance "unspecified"

# SetPlugin "cpu" SetPluginInstance "even-%{aggregation}"

# GroupBy "Host" GroupBy "TypeInstance"

# CalculateNum false CalculateSum false CalculateAverage true CalculateMinimum false CalculateMaximum false CalculateStddev false

#

# Host "localhost" Port "5672" VHost "/" User "guest" Password "guest" Exchange "amq.fanout" RoutingKey "collectd" Persistent false StoreRates false

#

URL "http://localhost/server-status?auto" User "www-user" Password "secret" VerifyPeer false VerifyHost false CACert "/etc/ssl/ca.crt" Server "apache"

# URL "http://some.domain.tld/status?auto" Host "some.domain.tld" Server "lighttpd"

#

# Host "localhost" Port "3551" ReportSeconds true

#

# URL "http://localhost/ascent/status/" User "www-user" Password "secret" VerifyPeer false VerifyHost false CACert "/etc/ssl/ca.crt"

#

# URL "http://localhost:8053/"

# ParseTime false

# OpCodes true QTypes true ServerStats true ZoneMaintStats true ResolverStats false MemoryStats true

# QTypes true ResolverStats true CacheRRSets true

# Zone "127.in-addr.arpa/IN"

#

# CGroup "libvirt" IgnoreSelected false

#

# DataDir "/var/lib/collectd/csv" StoreRates false

#

# URL "http://finance.google.com/finance?q=NYSE%3AAMD" User "foo" Password "bar" VerifyPeer false VerifyHost false CACert "/etc/ssl/ca.crt" MeasureResponseTime false Regex "]> *([0-9].[0-9]+) *" DSType "GaugeAverage" Type "stock_value" Instance "AMD"

#

# See: http://wiki.apache.org/couchdb/Runtime_Statistics Instance "httpd" Type "http_requests"

# Type "http_request_methods"

# Type "http_response_codes" Database status metrics: Instance "dbs" Type "gauge" Type "counter" Type "bytes"

#

# Host "my_host" Instance "some_instance" User "collectd" Password "thaiNg0I" VerifyPeer true VerifyHost true CACert "/path/to/ca.crt"

# Type "magic_level" InstancePrefix "prefix-" InstanceFrom "td[1]" ValuesFrom "td[2]/span[@class https://github.com/class=\"level\"]"

#

# Statement "SELECT 'customers' AS c_key, COUNT(*) AS c_value \ FROM customers_tbl" MinVersion 40102 MaxVersion 50042 Type "gauge" InstancePrefix "customer" InstancesFrom "c_key" ValuesFrom "c_value"

# Driver "mysql" DriverOption "host" "localhost" DriverOption "username" "collectd" DriverOption "password" "secret" DriverOption "dbname" "custdb0" SelectDB "custdb0" Query "num_of_customers" Query "..." Host "..."

#

Device "/dev/xvda1" Device "192.168.30.160:/mnt/nfs" MountPoint "/" FSType "ext3"

ignore rootfs; else, the root file-system would appear twice, causing

one of the updates to fail and spam the log

FSType rootfs

ignore the usual virtual / temporary file-systems

FSType sysfs FSType proc FSType devtmpfs FSType devpts FSType tmpfs FSType fusectl FSType cgroup IgnoreSelected true

ReportByDevice false ReportReserved false ReportInodes false ValuesAbsolute true ValuesPercentage false

# Disk "hda" Disk "/sda[23]/" IgnoreSelected false

#

# Interface "eth0" IgnoreSource "192.168.0.1" SelectNumericQueryTypes false

#

# SocketFile "/var/run/collectd-email" SocketGroup "collectd" SocketPerms "0770" MaxConns 5

#

# Interface "eth0" Map "rx_csum_offload_errors" "if_rx_errors" "checksum_offload" Map "multicast" "if_multicast" MappedOnly false

#

# Exec user "/path/to/exec" Exec "user:group" "/path/to/exec" NotificationExec user "/path/to/exec"

#

# Instance "foodir" Name "*.conf" MTime "-5m" Size "+10k" Recursive true IncludeHidden false

#

# MCReceiveFrom "239.2.11.71" "8649"

# Type "swap" TypeInstance "total" DataSource "value"

# Type "swap" TypeInstance "free" DataSource "value"

#

# Host "127.0.0.1" Port 7634

#

Interface "eth0" IgnoreSelected false

# Sensor "some_sensor" Sensor "another_one" IgnoreSelected false NotifySensorAdd false NotifySensorRemove true NotifySensorNotPresent false

#

# Chain "table" "chain"

#

# Irq 7 Irq 8 Irq 9 IgnoreSelected true

#

# JVMArg "-verbose:jni" JVMArg "-Djava.class.path=/usr/share/collectd/java/collectd-api.jar"

# LoadPlugin "org.collectd.java.GenericJMX" # See /usr/share/doc/collectd/examples/GenericJMX.conf # for an example config.

#

# Connection "xen:///" RefreshInterval 60 Domain "name" BlockDevice "name:device" InterfaceDevice "name:device" IgnoreSelected false HostnameFormat name InterfaceFormat name

#

# Interface "wlan0" IgnoreSelected false Source "SysFS" WatchSet "None" WatchAdd "node_octets" WatchAdd "node_rssi" WatchAdd "is_rx_acl" WatchAdd "is_scan_active"

#

# Host "127.0.0.1" Port 411

#

# Device "/dev/md0" IgnoreSelected false

#

# Server "localhost" Key "page_key" Regex "(\d+) bytes sent" ExcludeRegex "" DSType CounterAdd Type "ipt_octets" Instance "type_instance"

#

# Socket "/var/run/memcached.sock" or: Host "127.0.0.1" Port "11211"

#

# RegisterBase 1234 RegisterType float Type gauge Instance "..."

# Address "addr" Port "1234" Interval 60

# Instance "foobar" # optional Collect "data_name"

#

# Host "database.serv.er" Port "3306" User "db_user" Password "secret" Database "db_name" MasterStats true

# Host "localhost" Socket "/var/run/mysql/mysqld.sock" SlaveStats true SlaveNotifications true

#

# Interface "All" VerboseInterface "All" QDisc "eth0" "pfifo_fast-1:0" Class "ppp0" "htb-1:10" Filter "ppp0" "u32-1:0" IgnoreSelected false

#

#

client setup: Server "ff18::efc0:4a42" "25826" SecurityLevel Encrypt Username

"user" Password "secret" Interface "eth0" TimeToLive "128"

#

server setup: Listen "ff18::efc0:4a42" "25826" SecurityLevel Sign AuthFile

"/etc/collectd/passwd" Interface "eth0" MaxPacketSize 1024

#

proxy setup (client and server as above): Forward true

#

statistics about the network plugin itself ReportStats false

#

"garbage collection" CacheFlush 1800

#

# URL "http://localhost/status?auto" User "www-user" Password "secret" VerifyPeer false VerifyHost false CACert "/etc/ssl/ca.crt"

#

# OkayTimeout 1000 WarningTimeout 5000 FailureTimeout 0

#

# SMTPServer "localhost" SMTPPort 25 SMTPUser "my-username" SMTPPassword "my-password" From "collectd@main0server.com" # on . # Beware! Do not use not more than two placeholders (%)! Subject "[collectd] %s on %s!" Recipient "email1@domain1.net" Recipient "email2@domain2.com"

#

# Host "localhost" Port 123 ReverseLookups false IncludeUnitID true

#

# UPS "upsname@hostname:port"

#

# Host "127.0.0.1" Port "2006" CollectLinks "Summary" CollectRoutes "Summary" CollectTopology "Summary"

#

# StatusFile "/etc/openvpn/openvpn-status.log" ImprovedNamingSchema false CollectCompression true CollectIndividualUsers true CollectUserCount false

#

# IncludeDir "/my/include/path" BaseName "Collectd::Plugins" EnableDebugger "" LoadPlugin Monitorus LoadPlugin OpenVZ

# Foo "Bar" Qux "Baz"

#

# Address "::0" Port "30002" Host "host name" Server "server name" Script "script name"

#

# Host "host.foo.bar" Host "host.baz.qux" Interval 1.0 Timeout 0.9 TTL 255 SourceAddress "1.2.3.4" Device "eth0" MaxMissed -1

#

# Statement "SELECT magic FROM wizard WHERE host = $1;" Param hostname

# Type gauge InstancePrefix "magic" ValuesFrom "magic"

# Statement "SELECT COUNT(type) AS count, type \ FROM (SELECT CASE \ WHEN resolved = 'epoch' THEN 'open' \ ELSE 'resolved' END AS type \ FROM tickets) type \ GROUP BY type;"

# Type counter InstancePrefix "rt36_tickets" InstancesFrom "type" ValuesFrom "count"

#

See

/usr/share/doc/collectd-core/examples/postgresql/collectd_insert.sql for details Statement "SELECT collectd_insert($1, $2, $3, $4, $5, $6, $7, $8, $9);" StoreRates true

# Host "hostname" Port 5432 User "username" Password "secret"

# SSLMode "prefer" KRBSrvName "kerberos_service_name"

# Query magic

# Interval 60 Service "service_name"

# Query backend # predefined Query rt36_tickets

# Service "collectd_store" Writer sqlstore # see collectd.conf(5) for details CommitInterval 30

#

# Collect "latency" Collect "udp-answers" "udp-queries" Socket "/var/run/pdns.controlsocket" Collect "questions" Collect "cache-hits" "cache-misses" Socket "/var/run/pdns_recursor.controlsocket" LocalSocket "/opt/collectd/var/run/collectd-powerdns"

#

# Process "name" ProcessMatch "foobar" "/usr/bin/perl foobar.pl.*"

#

# Value "/^Tcp:/" IgnoreSelected false

#

# ModulePath "/path/to/your/python/modules" LogTraces true Interactive true Import "spam"

# spam "wonderful" "lovely"

#

# DaemonAddress "unix:/var/run/rrdcached.sock" DataDir "/var/lib/rrdcached/db/collectd" CreateFiles true CreateFilesAsync false CollectStatistics true

# The following settings are rather advanced and should usually not be touched: StepSize 10 HeartBeat 20 RRARows 1200 RRATimespan 158112000 XFF 0.1

#

DataDir "/var/lib/collectd/rrd" CacheTimeout 120 CacheFlush 900 WritesPerSecond 30 CreateFilesAsync false RandomTimeout 0

# The following settings are rather advanced and should usually not be touched: StepSize 10 HeartBeat 20 RRARows 1200 RRATimespan 158112000 XFF 0.1

# SensorConfigFile "/etc/sensors3.conf" Sensor "it8712-isa-0290/temperature-temp1" Sensor "it8712-isa-0290/fanspeed-fan3" Sensor "it8712-isa-0290/voltage-in8" IgnoreSelected false

# See /usr/share/doc/collectd/examples/snmp-data.conf.gz for a comprehensive sample configuration.

# Type "voltage" Table false Instance "input_line1" Scale 0.1 Values "SNMPv2-SMI::enterprises.6050.5.4.1.1.2.1" Type "users" Table false Instance "" Shift -1 Values "HOST-RESOURCES-MIB::hrSystemNumUsers.0" Type "if_octets" Table true InstancePrefix "traffic" Instance "IF-MIB::ifDescr" Values "IF-MIB::ifInOctets" "IF-MIB::ifOutOctets"

# Address "192.168.0.2" Version 1 Community "community_string" Collect "std_traffic" Inverval 120 Address "192.168.0.42" Version 2 Community "another_string" Collect "std_traffic" "hr_users" Address "192.168.0.3" Version 1 Community "more_communities" Collect "powerplus_voltge_input" Interval 300

#

# Host "::" Port "8125" DeleteCounters false DeleteTimers false DeleteGauges false DeleteSets false TimerPercentile 90.0

#

# ReportByDevice false ReportBytes true

#

# Instance "slabinfo" Separator " " Type gauge InstancePrefix "active_objs" InstancesFrom 0 ValuesFrom 1 Type gauge InstancePrefix "objperslab" InstancesFrom 0 ValuesFrom 4

#

# Instance "exim" Regex "S=([1-9][0-9]_)" DSType "CounterAdd" Type "ipt_bytes" Instance "total" Regex "\" ExcludeRegex "._mail_spool defer" DSType "CounterInc" Type "counter" Instance "local_user"

#

# Type "percent" Instance "dropped" ValueFrom 1 Type "bytes" Instance "wire-realtime" ValueFrom 2 Type "alerts_per_second" ValueFrom 3 Type "kpackets_wire_per_sec.realtime" ValueFrom 4 Instance "snort-eth0" Interval 600 Collect "dropped" "mbps" "alerts" "kpps" TimeFrom 0

#

# ListeningPorts false LocalPort "25" RemotePort "25"

#

# Host "127.0.0.1" Port "51234" Server "8767"

#

# Device "/dev/ttyUSB0" Retries 0

#

# ForceUseProcfs false Device "THRM" IgnoreSelected false

#

# Host "localhost" Port "1978"

#

# SocketFile "/var/run/collectd-unixsock" SocketGroup "collectd" SocketPerms "0660" DeleteSocket false

#

# UUIDFile "/etc/uuid"

#

# CollectCache true CollectBackend true CollectBan false # Varnish 3 only CollectConnections true CollectDirectorDNS false # Varnish 3 only CollectSHM true CollectESI false CollectFetch false CollectHCB false CollectObjects false CollectPurge false # Varnish 2 only CollectSession false CollectSMA false # Varnish 2 only CollectSMS false CollectSM false # Varnish 2 only CollectStruct false CollectTotals false CollectUptime false CollectdVCL false CollectWorkers false

# CollectCache true

#

# Verbose false

#

Host "localhost" Port "2003" Protocol "tcp" LogSendErrors true Prefix "collectd" Postfix "collectd" StoreRates true AlwaysAppendDS false EscapeCharacter "_"

# User "collectd" Password "secret" VerifyPeer true VerifyHost true CACert "/etc/ssl/ca.crt" Format "Command" StoreRates false

#

# Host "localhost" Port 5555 Protocol UDP StoreRates true AlwaysAppendDS false TTLFactor 2.0 Tag "foobar"

#

Filter "*.conf"

— Reply to this email directly or view it on GitHub https://github.com/collectd/collectd/issues/1026#issuecomment-100933070.

[srini5884]

I am new to python, can you please help me how can I find and eliminate unneeded files?

Is this blocking me to have clients data to populate in graphtie?

Also please help me in fixing listener issue as well?

12/05/2015 07:43:04 :: invalid line received from client 192.168.30.135:53799, ignoring

[srini5884]

[srini5884]

Thank you,

Finally am able to resolve issues collectd after removing some unneeded files, but still seeing errors in listener log as below.

Can you please guide me how can I fix below? Also, still do not see my clients info in carbon agents, help me to root cause this issue.

12/05/2015 09:59:04 :: MetricLineReceiver connection with 192.168.30.135:54261 established 12/05/2015 09:59:04 :: invalid line received from client 192.168.30.135:54261, ignoring

[rubenk]

As @arielshaqed already mentioned, you may have better luck on our mailing list or IRC channel. We'd like to keep the github issue tracker for bugreports

[askossivi]

Hello, I am having a similar issue when I tried to used collectd as daemonset in k8s cluster.

$ kubectl logs collectd-agent-**** -n graphite Parse error in file /etc/collectd/collectd.conf', line 99 near': syntax error, unexpected $end, expecting EOL yyparse returned error #1 configfile: Cannot read file `/etc/collectd/collectd.conf'. Unable to read config file /etc/collectd/collectd.conf. Error: Reading the config file failed! Read the syslog for details.