search

carlomazzaferro / kryptoflow

Real-time analysis of bitcoin markets with Kafka and Tensorflow Serving
GNU General Public License v3.0
72 stars 18 forks source link

Fix historic BTC-USD data #1

Closed carlomazzaferro closed 6 years ago

carlomazzaferro commented 6 years ago

Some data streamed from the websockets may be missing from the logs due to:

  1. Failures in the instance that cause restarting of the processes
  2. API may be down
  3. Unhandled errors in the code

For now, the solution to this consists of downloading the historic gdax btc-usd data from https://api.bitcoincharts.com/v1/csv/ , finding the missing values in the gdax table, and filling those with the historic data.

carlomazzaferro commented 6 years ago

not needed, keeping all the messages in kafka