Leo4815162342 / dukascopy-node

✨ Download historical price tick data for Crypto, Stocks, ETFs, CFDs, Forex via CLI and Node.js ✨
https://dukascopy-node.app
MIT License
365 stars 68 forks source link

Invalid string length #12

Closed Dwyte closed 3 years ago

Dwyte commented 4 years ago

dukascopy-cli -i eurusd -from 2016-08-07 -to 2017-08-07 -t tick -f csv

I tried downloading a year worth of data, '16-'17 and it gave an error Invalid string length after the 100% bar.

Leo4815162342 commented 4 years ago

Thanks for raising the issue. Seems I can reproduce it as well.

I think we'll need to update the strategy for downloading and saving the tick data. Since we're downloading quite a lot files and the output file may be super large For example downloading a year of tick data means we'd need to fetch 24 (each hour of tick data is served in a separate file) multiplied by 365, which is 8760 files, some of those can be corrupted for some reason. I'll try to work on a solution in which we'd be able to fetch and save the resulted files properly.