search

dema-trading-ai / engine

https://docs.dematrading.ai
GNU Affero General Public License v3.0
46 stars 11 forks source link

Data downloading Error #270

Closed marijn111 closed 2 years ago

marijn111 commented 3 years ago

Trace:

====================================== 
 Starting up DemaTrading.ai BACKTESTING 
======================================
[INFO] The algorithm will use the inputted value of 0.25% as fee percentage.
[INFO] Configuring timeframe...
[INFO] Connecting to exchange...
[INFO] Connected to exchange: binance.
[INFO] Gathering data from 20200601 until 20210601.
[INFO] Fetching marketchange of BTC/USDT...
[INFO] Watching pairs: BTC/USDT ETH/USDT LTC/USDT LINK/USDT VET/USDT XLM/USDT IOST/USDT ADA/USDT EOS/USDT WAVES/USDT AAVE/USDT DOT/USDT .
[INFO] Starting DemaTrading.ai Data-module...
[INFO] Did not find datafile for BTC/USDT, starting download...
[INFO] Downloading BTC/USDT's data
[INFO] [BTC/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for ETH/USDT, starting download...
[INFO] Downloading ETH/USDT's data
[INFO] [ETH/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for LTC/USDT, starting download...
[INFO] Downloading LTC/USDT's data
[INFO] [LTC/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for LINK/USDT, starting download...
[INFO] Downloading LINK/USDT's data
[INFO] [LINK/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for VET/USDT, starting download...
[INFO] Downloading VET/USDT's data
[INFO] [VET/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for XLM/USDT, starting download...
[INFO] Downloading XLM/USDT's data
[INFO] [XLM/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for IOST/USDT, starting download...
[INFO] Downloading IOST/USDT's data
[INFO] [IOST/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for ADA/USDT, starting download...
[INFO] Downloading ADA/USDT's data
[INFO] [ADA/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for EOS/USDT, starting download...
[INFO] Downloading EOS/USDT's data
[INFO] [EOS/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for WAVES/USDT, starting download...
[INFO] Downloading WAVES/USDT's data
[INFO] [WAVES/USDT] 34964 candles downloaded.
[INFO] Did not find datafile for AAVE/USDT, starting download...
[INFO] Downloading AAVE/USDT's data
[INFO] [AAVE/USDT] 21910 candles downloaded.
[INFO] Did not find datafile for DOT/USDT, starting download...
[INFO] Downloading DOT/USDT's data
[INFO] [DOT/USDT] 27398 candles downloaded.
[WARNING] Pair 'BTC/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'ETH/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'LTC/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'LINK/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'VET/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'XLM/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'IOST/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'ADA/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'EOS/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'WAVES/USDT' is missing 76 ticks (rows)
[WARNING] Pair 'AAVE/USDT' is missing 13130 ticks (rows)
[WARNING] Pair 'DOT/USDT' is missing 7642 ticks (rows)
Traceback (most recent call last):
  File "/usr/src/engine/main.py", line 25, in <module>
    main()
  File "/usr/src/engine/main.py", line 8, in main
    execute_for_args({
  File "/usr/src/engine/cli/arg_parse.py", line 39, in execute_for_args
    args.func(args)
  File "/usr/src/engine/main.py", line 17, in run_engine
    controller.run()
  File "/usr/src/engine/main_controller.py", line 18, in run
    algo_module = self.setup_module.setup()
  File "/usr/src/engine/modules/setup/__init__.py", line 14, in setup
    ohlcv_pair_frames = DataModule(self.config).load_historical_data()
  File "/usr/src/engine/modules/setup/datamodule.py", line 53, in load_historical_data
    raise Exception("[ERROR] Dataframes don't have equal backtesting periods.")
Exception: [ERROR] Dataframes don't have equal backtesting periods.
ERROR: 1

What went wrong:

Clean download of all pairs in config. Somehow this message pops up (everytime I try again too). Probably has something to do with the fact that DOT/USDT has many missing ticks because the coin didn't exist yet on the starting point of backtesting. But then again, so does AAVE/USDT and that one seem to have succeeded before DOT? Should be investigated and fixed.

sheridavandenbent commented 2 years ago

This has been fixed. Closing issue