search

waggle-sensor / data-tools

Data tools for working with Waggle data.
7 stars 2 forks source link

timestamp missing for data-reduction #3

Open rajeeja opened 5 years ago

rajeeja commented 5 years ago

it is bundled with data-reduction: subsystem

pressure2018/05/01 00:15:00 temperature2018/05/01 00:15:00 humidity2018/05/01 00:15:00

Command used to reduce data:

python3 ~/waggle-data-tools/data-reduction-tool/dataReduction.py -i AoT_Chicago.public.2018-08-23.from-2018-05-01-to-2018-07-30/ -t 30m

     

seanshahkarami commented 5 years ago

Hello - would you be able to clarify the problem you're having in more detail?

My understanding is that you've run:

python3 ~/waggle-data-tools/data-reduction-tool/dataReduction.py -i AoT_Chicago.public.2018-08-23.from-2018-05-01-to-2018-07-30/ -t 30m

This should create a new directory inside of AoT_Chicago.public.2018-08-23.from-2018-05-01-to-2018-07-30 called AoT_Chicago.public.2018-08-23.from-2018-05-01-to-2018-07-30_reduced_data_30m.

Would you be able to post a few lines of data from AoT_Chicago.public.2018-08-23.from-2018-05-01-to-2018-07-30_reduced_data_30m/data.csv?

Thank you!

rajeeja commented 5 years ago

jain@jain-VirtualBox:~/waggle-data-tools/3mo-may-june-july/AoT_Chicago.public.2018-08-23.from-2018-05-01-to-2018-07-30/AoT_Chicago.public.2018-08-23.from-2018-05-01-to-2018-07-30_reduced_data_30m$ ==[master]> head data.csv timestamp,node_id,subsystem,sensor,parameter,value_hrf_sum,value_hrf_count,value_hrf_average ,001e0610ba57,pressure2018/05/01 00:15:00,metsense,bmp180,75439.71,76,992.628 ,001e0610ba57,temperature2018/05/01 00:15:00,metsense,bmp180,1908.96,76,25.118 ,001e0610ba57,humidity2018/05/01 00:15:00,metsense,htu21d,264.73,76,3.483 ,001e0610ba57,temperature2018/05/01 00:15:00,metsense,htu21d,1890.36,76,24.873 ,001e0610ba57,temperature2018/05/01 00:15:00,metsense,tsys01,1932.4,76,25.426 ,001e0610bc10,pressure2018/05/01 00:15:00,metsense,bmp180,74654.46,72,1036.867 ,001e0610bc10,temperature2018/05/01 00:15:00,metsense,bmp180,2226.2,72,30.919 ,001e0610bc10,humidity2018/05/01 00:15:00,metsense,htu21d,661.61,72,9.189 ,001e0610bc10,temperature2018/05/01 00:15:00,metsense,htu21d,1824.27,72,25.337