search

OpenTSDB / tcollector

Data collection framework for OpenTSDB
http://opentsdb.net
GNU Lesser General Public License v3.0
512 stars 362 forks source link

invalid data : iostat.py and hbase_regionserver_jmx.py #8

Closed WRXrider closed 13 years ago

WRXrider commented 13 years ago

Hi,

Trying to run the tcollector damon and getting this particular error message in the tcollector.log. The other python script works fine. Any idea how to fix this. Thanks

5 18:47:44,051 tcollector[1745] WARNING: iostat.py sent invalid data: iostat.part.ios_in_progress 1298688463 0 dev=cciss/c0d0p2
2011-02-25 18:47:44,051 tcollector[1745] WARNING: iostat.py sent invalid data: iostat.part.msec_total 1298688463 322864445 dev=cciss/c0d0p2
2011-02-25 18:47:44,051 tcollector[1745] WARNING: iostat.py sent invalid data: iostat.part.msec_weighted_total 1298688463 1298115247 dev=cciss/c0d0p2
2011-02-25 18:47:46,054 tcollector[1745] WARNING: hbase_regionserver_jmx.py.orig sent invalid data: hbase.regionserver.hdfsDate 1298688465 Fri Jan 14 10:40:12 PST 2011 cluster=true
2011-02-25 18:47:46,054 tcollector[1745] WARNING: hbase_regionserver_jmx.py.orig sent invalid data: hbase.regionserver.date 1298688465 Wed Feb  9 14:14:17 PST 2011 cluster=true
2011-02-25 18:47:46,058 tcollector[1745] WARNING: hbase_regionserver_jmx.py sent invalid data: hbase.regionserver.hdfsDate 1298688465 Fri Jan 14 10:40:12 PST 2011 cluster=true
2011-02-25 18:47:46,058 tcollector[1745] WARNING: hbase_regionserver_jmx.py sent invalid data: hbase.regionserver.date 1298688465 Wed Feb  9 14:14:17 PST 2011 cluster=true
tsuna commented 13 years ago

Hi, can you show the output of uname -a and cat /proc/diskstats please?

The output of hbase_regionserver_jmx.py baffles me a bit, I'll have to think about it a bit more...

WRXrider commented 13 years ago

Thanks for the quick responds tsuna,

here's the output

[jasonc@hostname1:~]$ uname -a Linux hostname1 2.6.18-128.1.10.el5 #1 SMP Thu May 7 10:35:59 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux [jasonc@hostname1:~]$ cat /proc/diskstats 1 0 ram0 0 0 0 0 0 0 0 0 0 0 0 1 1 ram1 0 0 0 0 0 0 0 0 0 0 0 1 2 ram2 0 0 0 0 0 0 0 0 0 0 0 1 3 ram3 0 0 0 0 0 0 0 0 0 0 0 1 4 ram4 0 0 0 0 0 0 0 0 0 0 0 1 5 ram5 0 0 0 0 0 0 0 0 0 0 0 1 6 ram6 0 0 0 0 0 0 0 0 0 0 0 1 7 ram7 0 0 0 0 0 0 0 0 0 0 0 1 8 ram8 0 0 0 0 0 0 0 0 0 0 0 1 9 ram9 0 0 0 0 0 0 0 0 0 0 0 1 10 ram10 0 0 0 0 0 0 0 0 0 0 0 1 11 ram11 0 0 0 0 0 0 0 0 0 0 0 1 12 ram12 0 0 0 0 0 0 0 0 0 0 0 1 13 ram13 0 0 0 0 0 0 0 0 0 0 0 1 14 ram14 0 0 0 0 0 0 0 0 0 0 0 1 15 ram15 0 0 0 0 0 0 0 0 0 0 0 104 0 cciss/c0d0 3251571 1017909 379220597 25790416 46312130 300753375 2776911180 1325249483 0 326603153 1351039905 104 1 cciss/c0d0p1 515 1286 4284 4417 15 7 44 2268 0 5805 6685 104 2 cciss/c0d0p2 3251047 1016607 379216113 25785935 46312115 300753368 2776911136 1325247215 0 326601018 1351033306 253 0 dm-0 4263616 0 379208730 33640805 347113892 0 2776911136 3723072859 0 326635045 3756725089 2 0 fd0 0 0 0 0 0 0 0 0 0 0 0 3 0 hda 0 0 0 0 0 0 0 0 0 0 0 9 0 md0 0 0 0 0 0 0 0 0 0 0 0 [jasonc@hostname1:~]$

[jasonc@hostname1:/var/opt/tcollector/]$ sudo -u app python ./collectors/0/hbase_regionserver_jmx.py hbase.regionserver.revision 1298778253 Unknown cluster=true hbase.regionserver.hdfsUser 1298778253 httpd cluster=true hbase.regionserver.hdfsDate 1298778253 Fri Jan 14 10:40:12 PST 2011 cluster=true hbase.regionserver.hdfsUrl 1298778253 cluster=true hbase.regionserver.date 1298778253 Wed Feb 9 14:14:17 PST 2011 cluster=true hbase.regionserver.hdfsRevision 1298778253 9b72d268a0b590b4fd7d13aca17c1c453f8bc957 cluster=true hbase.regionserver.user 1298778253 httpd cluster=true hbase.regionserver.hdfsVersion 1298778253 0.20.2_cdh3b2-2 cluster=true hbase.regionserver.url 1298778253 file:///var/tmp/ezbuild.1297289425.17688.23569950987860/topdir/BUILD/hbase/hbase-0.90.0 cluster=true hbase.regionserver.version 1298778253 0.90.0 cluster=true hbase.regionserver.numOps 1298778253 0 cluster=true op=enableTable hbase.regionserver.avgTime 1298778253 0 cluster=true op=enableTable hbase.region

tsuna commented 13 years ago

I pushed stumbleupon/tcollector@a3edd0bbd2937d34c5b1af126931217aba742c60 which should fix the problem with iostat.py – can you please confirm?

Haven't looked at the problem with the HBase collector yet. Can you please give me the output of python -V?

WRXrider commented 13 years ago

thanks tsuna, that fixed the iostat.py issue.

[jasonc@hostname1]$ python -V Python 2.4.3