search

vzaigrin / UniversalStorageCollector

tool for gathering performance information from different storage system
19 stars 2 forks source link

influxdb series missing host key. #4

Closed stephanyespencer closed 7 years ago

stephanyespencer commented 7 years ago

I'm loving the new Universal Storage Collector. I've been able to expand it to collect additional vnx statistics. Thanks!

However, the host key is not coming across from the vnxblock collectors to influxdb. It does get saved if I use the carbon output and pipe it through the graphite influxdb plugin.

use usc Using database usc

show series key

cache,class=vnx,name=spa,type=block cache,class=vnx,name=spb,type=block sp,class=vnx,name=spa,type=block sp,class=vnx,name=spb,type=block storagepool,class=vnx,name=DefaultPool1,type=block storagepool,class=vnx,name=SQLPool0,type=block

select * from storagepool limit 5 name: storagepool time PercentFull class name type

1487884088000000000 58.567 vnx DefaultPool1 block 1487884088000000000 87.826 vnx SQLPool0 block 1487884688000000000 58.567 vnx DefaultPool1 block 1487884688000000000 87.826 vnx SQLPool0 block 1487885288000000000 58.567 vnx DefaultPool1 block

By contract, if I use the carbon extractor (and send it through the influxdb/graphite plugin), hostnames are recorded.

use graphite Using database graphite show series key

vnx,host=VNX01A,resource=cache,type=block vnx,host=VNX01A,resource=sp,type=block vnx,host=VNX01A,resource=storagepool,type=block vnx,host=VNX01L,resource=cache,type=block vnx,host=VNX01L,resource=sp,type=block vnx,host=VNX01L,resource=storagepool,type=block

select * from vnx limit 3 name: vnx time DefaultPool1.AvailableCapacity DefaultPool1.ConsumedCapacity DefaultPool1.PercentFull DefaultPool1.RawCapacity DefaultPool1.UserCapacity SQLPool0.AvailableCapacity SQLPool0.ConsumedCapacity SQLPool0.PercentFull SQLPool0.RawCapacity SQLPool0.UserCapacity host resource spa.Blocks_read spa.Blocks_written spa.PrctBusy spa.PrctCachePagesOwned spa.PrctDirtyCachePages spa.Read_requests spa.Write_requests spb.Blocks_read spb.Blocks_written spb.PrctBusy spb.PrctCachePagesOwned spb.PrctDirtyCachePages spb.Read_requests spb.Write_requests type

1487884088000000000 VNX01A cache 50 77 49 70 block 1487884088000000000 79.94 94.14 VNX01A storagepool block 1487884088000000000 VNX01A sp 5.43391757512e+11 2.99735118429e+11 9.33 2.265496509e+09 3.462504396e+09 2.503953679575e+12 1.049676873395e+12 18.3 8.92362777e+08 1.834676829e+09 block

vzaigrin commented 7 years ago

Thank you for this note, you found an error. The problem is in using field 'name' for host name (storage name) and object name (sp, pool and so on). I will update the source code and change one of them.

vzaigrin commented 7 years ago

I have updated collector. There are no duplicated fields 'name' anymore. Field with name for storage system is ‘storage’ now.

stephanyespencer commented 7 years ago

Thanks!