Read the bins.csv from HDFS-restructure script.

RADAR-base / RADAR-RestApi

RESTful interface to access near real-time data

Apache License 2.0

2 stars 0 forks source link

Read the bins.csv from HDFS-restructure script. #35

Closed blootsvoets closed 6 years ago

blootsvoets commented 7 years ago

The bins.csv file generated by the HDFS restructure script currently has entries as follows:

topic,device,timestamp,count
application_uptime,6771326b-36ff-4aec-9593-9525379152f8,20170727_15,81

The REST API could read these and serve them so we have an idea how many records have been added.

yatharthranjan commented 6 years ago

For this to be available, the hdfs_restructure.sh has to be run at regular intervals to produce upto date information. Is that right ? So how can we run this script via the REST-API or maybe can add it to systemd timers to run it periodically ?

blootsvoets commented 6 years ago

In radar-docker, a systemd timer for hdfs_restructure is installed with the install-systemd-wrappers script.

yatharthranjan commented 6 years ago

Okay. Thanks!

yatharthranjan commented 6 years ago

closed by #62