FX31337 / FX-BT-Scripts

:page_facing_up: Useful scripts for backtesting.
MIT License
34 stars 39 forks source link

Add a progress bar for convert_csv_to_mt.py during conversion [$20 awarded] #44

Closed kenorb closed 8 years ago

kenorb commented 8 years ago

When running the script in CI for big files, if fails the build because there is no output for at least 10 minutes. See this build.

The script should have some simple progress bar. Here are some suggestions, but it could be anything easy to implement (less external dependencies, than better).

Could be similar to pv -p command:

20.4MiB 0:00:02 [9.96MiB/s] [   <=>                                                                                                ]

or if the total is known:

100%[======================================>] 578,432     3.28MB/s   in 0.2s   

or anything else. Not be refreshed too often, to not slow down the conversion too much (could be for each next 1%, or each 1000000 ticks if the total is not known).

Testing:

git clone --single-branch --branch EURUSD-2014 https://github.com/FX31337/FX-BT-Data-EURUSD-DS.git
cd FX*
curl -o Makefile https://raw.githubusercontent.com/FX31337/FX-BT-Data-Test/master/Makefile
make

--- The **[$20 bounty](https://www.bountysource.com/issues/32291461-add-a-progress-bar-for-convert_csv_to_mt-py-during-conversion?utm_campaign=plugin&utm_content=tracker%2F20487492&utm_medium=issues&utm_source=github)** on this issue has been claimed at [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F20487492&utm_medium=issues&utm_source=github).