ReinforcementLearner - raised exception ValueError. Message: Observation spaces do not match

CryptoRahino commented 1 year ago

Describe your environment

Operating system: ubuntu
Python Version: 3.9 (python -V)
CCXT version: 2.4.60 (pip freeze | grep ccxt)
Freqtrade Version: freqtrade 2022.12 (freqtrade -V or docker compose run --rm freqtrade -V for Freqtrade running in docker)

Describe the problem:

when trading with ReinforcementLearner and continual_learning=true the bot showing the following error: `freqtrade.freqai.freqai_interface - WARNING - Training ALGO/USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.

Steps to reproduce:

run trade in "dry run" mode trade -c user_data/config.json --strategy rl_test --freqaimodel ReinforcementLearner

use my config (nothing special)

"freqai": {
    "enabled": true,
    "purge_old_models": false,
    "save_backtest_models": true,
    "continual_learning": true,
    "train_period_days": 16,
    "backtest_period_days": 8,
    "live_retrain_hours": 0,
    "identifier": "rl_test",
    "rl_config": {
        "train_cycles": 10,
        "add_state_info": true,
        "randomize_starting_position": true,
        "max_trade_duration_candles": 600,
        "max_training_drawdown_pct": 0.4,
        "cpu_count": 8,
        "model_type": "PPO",
        "policy_type": "MlpPolicy",
        "model_reward_parameters": {
            "rr": 1,
            "profit_aim": 0.8
        }
    },
    "feature_parameters": {
            "include_timeframes": [
            "15m",
            "1h"
        ],
        "include_corr_pairlist": [
        "BTC/USDT"
        ],
        "label_period_candles": 20,
        "include_shifted_candles": 2,
        "DI_threshold": 0.9,
        "weight_factor": 0.9,
        "principal_component_analysis": false,
        "use_SVM_to_remove_outliers": true,
        "use_DBSCAN_to_remove_outliers": true,
        "indicator_periods_candles": [
            10,
            20
        ],
        "plot_feature_importances": 0
    },
    "data_split_parameters": {
        "test_size": 0.25,
        "random_state": 1235
    },
    "model_training_parameters": {}
}

Observed Results:

seems that the problem is in the train function that executes dk.normalize_data(data_dictionary) in freqtrade/freqai/data_kitchen.py:318 when looping over data_dictionary["train_labels"].keys() the if condition to is wrong as it filters only dtype == object, but in ReinforcementLearner the target field is type int64 which causing NaN all over that df.

robcaulk commented 1 year ago

Hello,

This is likely a problem within your strategy. Can you please provide the file? Else reproduce it using the tests/strategy/strats/freqai_rl_test.py file.

Cheers,

Rober

CryptoRahino commented 1 year ago

i noticed that this happens only if i have a backtested model and then i run trade on it (with continual_learning). if i delete the model and run trade, it work as expected. RR_bug.txt

madamenko commented 1 year ago

In my case it's happens when switched on options "continual_learning" and "principal_component_analysis". After starting next cycle and if PCA give another quantity of features than in previous cycle of learning we receiving this error and empty model.

madamenko commented 1 year ago

2023-02-24 12:34:37,944 - freqtrade.freqai.prediction_models.ReinforcementLearner - INFO - Continual training activated - starting training from previously trained agent. 2023-02-24 12:34:37,947 - freqtrade.freqai.freqai_interface - WARNING - Training SHIB/USDT:USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. ... -1. -1. -1.] [-1. -1. -1. ... -1. -1. -1.] [-1. -1. -1. ... -1. -1. -1.] [-1. -1. -1. ... -1. -1. -1.]], [[1. 1. 1. ... 1. 1. 1.] [1. 1. 1. ... 1. 1. 1.] [1. 1. 1. ... 1. 1. 1.] [1. 1. 1. ... 1. 1. 1.]], (4, 265), float32) != Box([[-1. -1. -1. ... -1. -1. -1.] [-1. -1. -1. ... -1. -1. -1.] [-1. -1. -1. ... -1. -1. -1.] [-1. -1. -1. ... -1. -1. -1.]], [[1. 1. 1. ... 1. 1. 1.] [1. 1. 1. ... 1. 1. 1.] [1. 1. 1. ... 1. 1. 1.] [1. 1. 1. ... 1. 1. 1.]], (4, 269), float32), skipping.

DavF27 commented 1 year ago

Hello,

Exact same problem here. I tried running it with my own strategy, and then with the tests/strategy/strats/freqai_rl_test.py, but the result was the same. So, if I train a model with a backtest and then try to do a dry run, I encounter these errors. It depends on whether I include "continual_learning" in my config file or not.

Here are my logs without continual learning :

2023-03-21 15:36:45,152 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
2023-03-21 15:36:45,166 - freqtrade.configuration.load_config - INFO - Using config: user_data/config.json ...
2023-03-21 15:36:45,170 - freqtrade.loggers - INFO - Verbosity set to 0
2023-03-21 15:36:45,170 - freqtrade.configuration.configuration - INFO - Parameter -i/--timeframe detected ... Using timeframe: 5m ...
2023-03-21 15:36:45,171 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
2023-03-21 15:36:45,171 - freqtrade.configuration.configuration - INFO - Parameter --timerange detected: 20230315-20230321 ...
2023-03-21 15:36:53,938 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Overriding timeframe with Command line argument
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Parameter --cache=day detected ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Filter trades by timerange: 20230315-20230321
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
2023-03-21 15:36:53,943 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
2023-03-21 15:36:53,964 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
2023-03-21 15:36:53,964 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
2023-03-21 15:36:53,964 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
2023-03-21 15:36:53,970 - freqtrade.commands.optimize_commands - INFO - Starting freqtrade in Backtesting mode
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
2023-03-21 15:36:53,993 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
2023-03-21 15:36:54,029 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
2023-03-21 15:36:55,318 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
2023-03-21 15:36:55,318 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
2023-03-21 15:36:55,325 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
2023-03-21 15:36:55,460 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
2023-03-21 15:36:55,461 - freqtrade.strategy.hyper - INFO - Found no parameter file.
2023-03-21 15:36:55,461 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'timeframe' with value in config file: 5m.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
2023-03-21 15:36:55,466 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
2023-03-21 15:36:55,476 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
2023-03-21 15:36:55,486 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
2023-03-21 15:36:55,486 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:55,486 - freqtrade.data.history.history_utils - INFO - Using indicator startup period: 4620 ...
2023-03-21 15:36:55,683 - freqtrade.optimize.backtesting - INFO - Loading data from 2023-02-26 23:00:00 up to 2023-03-21 00:00:00 (22 days).
2023-03-21 15:36:55,720 - freqtrade.data.converter - INFO - Missing data fillup for ETH/USDT:USDT: before: 19 - after: 37 - 94.74%
2023-03-21 15:36:55,791 - freqtrade.optimize.backtesting - INFO - Dataload complete. Calculating indicators
2023-03-21 15:36:56,038 - freqtrade.optimize.backtesting - INFO - Running backtesting for Strategy freqai_rl_test_strat
2023-03-21 15:36:57,768 - matplotlib.font_manager - INFO - generated new fontManager
2023-03-21 15:36:58,184 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
2023-03-21 15:36:58,187 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
2023-03-21 15:36:58,189 - freqtrade.freqai.data_drawer - INFO - Could not find existing datadrawer, starting from scratch
2023-03-21 15:36:58,192 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
2023-03-21 15:36:58,193 - freqtrade.freqai.freqai_interface - INFO - Set fresh train queue from whitelist. Queue: ['ETH/USDT:USDT']
2023-03-21 15:36:58,207 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
2023-03-21 15:36:58,218 - freqtrade.freqai.freqai_interface - INFO - Training 1 timeranges
2023-03-21 15:36:58,220 - freqtrade.freqai.freqai_interface - INFO - Training ETH/USDT:USDT, 1/1 pairs from 2023-02-28 00:00:00 to 2023-03-15 00:00:00, 1/1 trains
2023-03-21 15:36:58,222 - freqtrade.freqai.data_kitchen - INFO - Could not find backtesting prediction file at /freqtrade/user_data/models/ETH81/backtesting_predictions/cb_eth_1678838400_prediction.feather
2023-03-21 15:36:58,226 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,466 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,591 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,803 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,962 - freqtrade.freqai.freqai_interface - INFO - Could not find model at /freqtrade/user_data/models/ETH81/sub-train-ETH_1678838400/cb_eth_1678838400
2023-03-21 15:36:58,963 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
2023-03-21 15:36:59,014 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4320.
2023-03-21 15:36:59,642 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3240 data points
2023-03-21 15:36:59,643 - freqtrade.freqai.RL.BaseEnvironment - WARNING - add_state_info is not available in backtesting. Deactivating.
2023-03-21 15:36:59,644 - freqtrade.freqai.RL.BaseEnvironment - WARNING - add_state_info is not available in backtesting. Deactivating.
Eval num_timesteps=3240, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=6480, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=9720, episode_reward=-1401.46 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=12960, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=16200, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=19440, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=22680, episode_reward=-1113.41 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=25920, episode_reward=-1209.58 +/- 0.00
Episode length: 673.00 +/- 0.00
Eval num_timesteps=29160, episode_reward=-997.00 +/- 0.00
Episode length: 512.00 +/- 0.00
New best mean reward!
Eval num_timesteps=32400, episode_reward=-1052.55 +/- 0.00
Episode length: 740.00 +/- 0.00
2023-03-21 15:41:12,297 - ReinforcementLearner - INFO - Callback found a best model.
2023-03-21 15:41:12,321 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------done training ETH/USDT:USDT--------------------
2023-03-21 15:41:12,321 - freqtrade.freqai.freqai_interface - INFO - Saving backtest model to disk.
2023-03-21 15:41:12,580 - freqtrade.freqai.data_kitchen - INFO - DI tossed 12 predictions for being too far from training data.
2023-03-21 15:41:14,759 - freqtrade.optimize.backtesting - INFO - Backtesting with data from 2023-03-15 00:00:00 up to 2023-03-21 00:00:00 (6 days).
2023-03-21 15:41:17,975 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/backtest-result-2023-03-21_15-41-17.meta.json"
2023-03-21 15:41:17,980 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/backtest-result-2023-03-21_15-41-17.json"
2023-03-21 15:41:17,986 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/.last_result.json"
Result for strategy freqai_rl_test_strat
============================================================== BACKTESTING REPORT =============================================================
|          Pair |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|---------------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
|         TOTAL |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
=========================================================== ENTER TAG STATS ===========================================================
|   TAG |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|-------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
| short |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
| TOTAL |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
===================================================== EXIT REASON STATS =====================================================
|   Exit Reason |   Exits |   Win  Draws  Loss  Win% |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |
|---------------+---------+--------------------------+----------------+----------------+-------------------+----------------|
|           roi |      34 |     19     0    15  55.9 |          -0    |          -0.09 |            -8.457 |          -0.09 |
|     stop_loss |       1 |      0     0     1     0 |          -5.01 |          -5.01 |           -94.423 |          -5.01 |
|    force_exit |       1 |      1     0     0   100 |           0.9  |           0.9  |            16.862 |           0.9  |
=========================================================== LEFT OPEN TRADES REPORT ===========================================================
|          Pair |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|---------------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
| ETH/USDT:USDT |         1 |           0.90 |           0.90 |            16.862 |           0.84 |        1:20:00 |     1     0     0   100 |
|         TOTAL |         1 |           0.90 |           0.90 |            16.862 |           0.84 |        1:20:00 |     1     0     0   100 |
================== SUMMARY METRICS ===================
| Metric                      | Value                |
|-----------------------------+----------------------|
| Backtesting from            | 2023-03-15 00:00:00  |
| Backtesting to              | 2023-03-21 00:00:00  |
| Max open trades             | 1                    |
|                             |                      |
| Total/Daily Avg Trades      | 36 / 6.0             |
| Starting balance            | 2000 USDT            |
| Final balance               | 1913.981 USDT        |
| Absolute profit             | -86.019 USDT         |
| Total profit %              | -4.30%               |
| CAGR %                      | -93.10%              |
| Sortino                     | -12.73               |
| Sharpe                      | -11.26               |
| Calmar                      | -117.06              |
| Profit factor               | 0.75                 |
| Expectancy                  | -0.11                |
| Trades per day              | 6.0                  |
| Avg. daily profit %         | -0.72%               |
| Avg. stake amount           | 1905.133 USDT        |
| Total trade volume          | 68584.783 USDT       |
|                             |                      |
| Long / Short                | 0 / 36               |
| Total profit Long %         | 0.00%                |
| Total profit Short %        | -4.30%               |
| Absolute profit Long        | 0 USDT               |
| Absolute profit Short       | -86.019 USDT         |
|                             |                      |
| Best Pair                   | ETH/USDT:USDT -4.20% |
| Worst Pair                  | ETH/USDT:USDT -4.20% |
| Best trade                  | ETH/USDT:USDT 2.61%  |
| Worst trade                 | ETH/USDT:USDT -5.01% |
| Best day                    | 59.114 USDT          |
| Worst day                   | -111.812 USDT        |
| Days win/draw/lose          | 3 / 0 / 4            |
| Avg. Duration Winners       | 3:52:00              |
| Avg. Duration Loser         | 3:58:00              |
| Rejected Entry signals      | 0                    |
| Entry/Exit Timeouts         | 0 / 0                |
|                             |                      |
| Min balance                 | 1823.778 USDT        |
| Max balance                 | 2065.399 USDT        |
| Max % of account underwater | 11.70%               |
| Absolute Drawdown (Account) | 11.70%               |
| Absolute Drawdown           | 241.621 USDT         |
| Drawdown high               | 65.399 USDT          |
| Drawdown low                | -176.222 USDT        |
| Drawdown Start              | 2023-03-15 16:20:00  |
| Drawdown End                | 2023-03-18 01:05:00  |
| Market change               | 5.85%                |
======================================================

PS C:\Users\tigge\Documents\VsCode\FreqAI> docker-compose up
[+] Running 1/0
 - Container freqtrade_AI  Created                                                                                                                                                                                                                                        0.0s
Attaching to freqtrade_AI
freqtrade_AI  | 2023-03-21 15:42:06,782 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:42:07,014 - freqtrade.worker - INFO - Starting worker docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:42:07,014 - freqtrade.configuration.load_config - INFO - Using config: /freqtrade/user_data/config.json ...
freqtrade_AI  | 2023-03-21 15:42:07,021 - freqtrade.loggers - INFO - Verbosity set to 0
freqtrade_AI  | 2023-03-21 15:42:07,022 - freqtrade.configuration.configuration - INFO - Runmode set to dry_run.
freqtrade_AI  | 2023-03-21 15:42:07,023 - freqtrade.configuration.configuration - INFO - Parameter --db-url detected ...
freqtrade_AI  | 2023-03-21 15:42:07,024 - freqtrade.configuration.configuration - INFO - Dry run is enabled
freqtrade_AI  | 2023-03-21 15:42:07,026 - freqtrade.configuration.configuration - INFO - Using DB: "sqlite:////freqtrade/user_data/tradesv3.sqlite"
freqtrade_AI  | 2023-03-21 15:42:07,027 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
freqtrade_AI  | 2023-03-21 15:42:15,510 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
freqtrade_AI  | 2023-03-21 15:42:15,513 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
freqtrade_AI  | 2023-03-21 15:42:15,514 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
freqtrade_AI  | 2023-03-21 15:42:15,516 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
freqtrade_AI  | 2023-03-21 15:42:15,539 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
freqtrade_AI  | 2023-03-21 15:42:15,540 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
freqtrade_AI  | 2023-03-21 15:42:15,650 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
freqtrade_AI  | 2023-03-21 15:42:15,651 - freqtrade.strategy.hyper - INFO - Found no parameter file.
freqtrade_AI  | 2023-03-21 15:42:15,653 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
freqtrade_AI  | 2023-03-21 15:42:15,654 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
freqtrade_AI  | 2023-03-21 15:42:15,655 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
freqtrade_AI  | 2023-03-21 15:42:15,656 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
freqtrade_AI  | 2023-03-21 15:42:15,657 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
freqtrade_AI  | 2023-03-21 15:42:15,658 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
freqtrade_AI  | 2023-03-21 15:42:15,660 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
freqtrade_AI  | 2023-03-21 15:42:15,660 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
freqtrade_AI  | 2023-03-21 15:42:15,661 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
freqtrade_AI  | 2023-03-21 15:42:15,662 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
freqtrade_AI  | 2023-03-21 15:42:15,663 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
freqtrade_AI  | 2023-03-21 15:42:15,664 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
freqtrade_AI  | 2023-03-21 15:42:15,665 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
freqtrade_AI  | 2023-03-21 15:42:15,666 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
freqtrade_AI  | 2023-03-21 15:42:15,667 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
freqtrade_AI  | 2023-03-21 15:42:15,668 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
freqtrade_AI  | 2023-03-21 15:42:15,669 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
freqtrade_AI  | 2023-03-21 15:42:15,670 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
freqtrade_AI  | 2023-03-21 15:42:15,671 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
freqtrade_AI  | 2023-03-21 15:42:15,672 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
freqtrade_AI  | 2023-03-21 15:42:15,673 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
freqtrade_AI  | 2023-03-21 15:42:15,674 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
freqtrade_AI  | 2023-03-21 15:42:15,676 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
freqtrade_AI  | 2023-03-21 15:42:15,677 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
freqtrade_AI  | 2023-03-21 15:42:15,678 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
freqtrade_AI  | 2023-03-21 15:42:15,679 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
freqtrade_AI  | 2023-03-21 15:42:15,680 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
freqtrade_AI  | 2023-03-21 15:42:15,682 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
freqtrade_AI  | 2023-03-21 15:42:15,683 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
freqtrade_AI  | 2023-03-21 15:42:15,694 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
freqtrade_AI  | 2023-03-21 15:42:15,697 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
freqtrade_AI  | 2023-03-21 15:42:15,698 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:42:15,720 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:42:15,743 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
freqtrade_AI  | 2023-03-21 15:42:16,977 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
freqtrade_AI  | 2023-03-21 15:42:17,020 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
freqtrade_AI  | 2023-03-21 15:42:17,021 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
freqtrade_AI  | 2023-03-21 15:42:17,028 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
freqtrade_AI  | 2023-03-21 15:42:17,115 - freqtrade.wallets - INFO - Wallets synced.
freqtrade_AI  | 2023-03-21 15:42:17,120 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:42:18,083 - freqtrade.rpc.api_server.webserver - INFO - Starting HTTP Server at 0.0.0.0:8021
freqtrade_AI  | 2023-03-21 15:42:18,085 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - Local Rest Server listening to external connections
freqtrade_AI  | 2023-03-21 15:42:18,087 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - This is insecure please set to your loopback,e.g 127.0.0.1 in config.json
freqtrade_AI  | 2023-03-21 15:42:18,088 - freqtrade.rpc.api_server.webserver - INFO - Starting Local Rest Server.
freqtrade_AI  | 2023-03-21 15:42:18,099 - uvicorn.error - INFO - Started server process [1]
freqtrade_AI  | 2023-03-21 15:42:18,100 - uvicorn.error - INFO - Waiting for application startup.
freqtrade_AI  | 2023-03-21 15:42:18,102 - uvicorn.error - INFO - Application startup complete.
freqtrade_AI  | 2023-03-21 15:42:18,103 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8021 (Press CTRL+C to quit)
freqtrade_AI  | 2023-03-21 15:42:18,110 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:42:18,118 - freqtrade.plugins.pairlistmanager - INFO - Whitelist with 1 pairs: ['ETH/USDT:USDT']
freqtrade_AI  | 2023-03-21 15:42:19,998 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
freqtrade_AI  | 2023-03-21 15:42:20,002 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
freqtrade_AI  | 2023-03-21 15:42:20,011 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
freqtrade_AI  | 2023-03-21 15:42:20,012 - freqtrade.freqai.freqai_interface - INFO - Set existing queue from trained timestamps. Best approximation queue: deque(['ETH/USDT:USDT'])
freqtrade_AI  | 2023-03-21 15:42:20,030 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
freqtrade_AI  | 2023-03-21 15:42:20,032 - freqtrade.strategy.interface - INFO - Downloading all training data for all pairs in whitelist and corr_pairlist, this may take a while if the data is not already on disk.
freqtrade_AI  | 2023-03-21 15:42:20,036 - freqtrade.freqai.utils - INFO - FreqAI auto-downloader using 450 startup candles.
freqtrade_AI  | 2023-03-21 15:42:20,040 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:42:20,232 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:20:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:20,441 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-21 15:42:20,578 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:42:20,647 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:20,856 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:20,938 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,147 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:21,205 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,418 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:21,447 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:42:21,614 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:20:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,823 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-21 15:42:21,955 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:42:22,023 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:22,560 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:22,647 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:23,183 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:23,235 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:23,771 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:23,802 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,803 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,805 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,807 - freqtrade.plugins.protectionmanager - INFO - No protection Handlers defined.
freqtrade_AI  | 2023-03-21 15:42:23,810 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': status, 'status': 'running'}
freqtrade_AI  | 2023-03-21 15:42:23,811 - freqtrade.worker - INFO - Changing state to: RUNNING
freqtrade_AI  | 2023-03-21 15:42:23,813 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': warning, 'status': 'Dry run is enabled. All trades are simulated.'}
freqtrade_AI  | 2023-03-21 15:42:23,814 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "*Exchange:* `bybit`\n*Stake per trade:* `unlimited USDT`\n*Minimum ROI:* `{'0': 0.1, '240': -1}`\n*Stoploss:* `-0.05`\n*Position adjustment:* `Off`\n*Timeframe:* `5m`\n*Strategy:* `freqai_rl_test_strat`"}
freqtrade_AI  | 2023-03-21 15:42:23,816 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "Searching for USDT pairs to buy and sell based on [{'StaticPairList': 'StaticPairList'}]"}
freqtrade_AI  | 2023-03-21 15:42:25,538 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:42:25,623 - freqtrade.freqai.data_kitchen - INFO - DI tossed 27 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:42:25,636 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7fb21ca3df30>>
freqtrade_AI  | 2023-03-21 15:42:25,637 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:42:25,680 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:42:26,529 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:42:26,571 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:42:27,078 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:42:28,828 - freqtrade.worker - INFO - Bot heartbeat. PID=1, version='docker-2023.3.dev-b710bdaf', state='RUNNING'
freqtrade_AI  | 2023-03-21 15:42:29,088 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:42:29,252 - freqtrade.freqai.data_kitchen - INFO - DI tossed 27 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:42:29,272 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7fb21ca3df30>>
freqtrade_AI  | 2023-03-21 15:42:29,285 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:42:29,317 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:42:33,981 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
Gracefully stopping... (press Ctrl+C again to force)
[+] Running 1/1
 - Container freqtrade_AI  Stopped

and this is my logs with continual_learning :

 `PS C:\Users\tigge\Documents\VsCode\FreqAI> docker-compose up
[+] Running 1/0
 - Container freqtrade_AI  Created                                                                                                                                                                                                                                        0.0s
Attaching to freqtrade_AI
freqtrade_AI  | 2023-03-21 15:48:33,315 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:48:33,543 - freqtrade.worker - INFO - Starting worker docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:48:33,543 - freqtrade.configuration.load_config - INFO - Using config: /freqtrade/user_data/config.json ...
freqtrade_AI  | 2023-03-21 15:48:33,549 - freqtrade.loggers - INFO - Verbosity set to 0
freqtrade_AI  | 2023-03-21 15:48:33,550 - freqtrade.configuration.configuration - INFO - Runmode set to dry_run.
freqtrade_AI  | 2023-03-21 15:48:33,551 - freqtrade.configuration.configuration - INFO - Parameter --db-url detected ...
freqtrade_AI  | 2023-03-21 15:48:33,552 - freqtrade.configuration.configuration - INFO - Dry run is enabled
freqtrade_AI  | 2023-03-21 15:48:33,553 - freqtrade.configuration.configuration - INFO - Using DB: "sqlite:////freqtrade/user_data/tradesv3.sqlite"
freqtrade_AI  | 2023-03-21 15:48:33,554 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
freqtrade_AI  | 2023-03-21 15:48:42,232 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
freqtrade_AI  | 2023-03-21 15:48:42,235 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
freqtrade_AI  | 2023-03-21 15:48:42,237 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
freqtrade_AI  | 2023-03-21 15:48:42,239 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
freqtrade_AI  | 2023-03-21 15:48:42,263 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
freqtrade_AI  | 2023-03-21 15:48:42,264 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
freqtrade_AI  | 2023-03-21 15:48:42,389 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
freqtrade_AI  | 2023-03-21 15:48:42,391 - freqtrade.strategy.hyper - INFO - Found no parameter file.
freqtrade_AI  | 2023-03-21 15:48:42,393 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
freqtrade_AI  | 2023-03-21 15:48:42,395 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
freqtrade_AI  | 2023-03-21 15:48:42,396 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
freqtrade_AI  | 2023-03-21 15:48:42,397 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
freqtrade_AI  | 2023-03-21 15:48:42,398 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
freqtrade_AI  | 2023-03-21 15:48:42,399 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
freqtrade_AI  | 2023-03-21 15:48:42,400 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
freqtrade_AI  | 2023-03-21 15:48:42,402 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
freqtrade_AI  | 2023-03-21 15:48:42,403 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
freqtrade_AI  | 2023-03-21 15:48:42,404 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
freqtrade_AI  | 2023-03-21 15:48:42,405 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
freqtrade_AI  | 2023-03-21 15:48:42,406 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
freqtrade_AI  | 2023-03-21 15:48:42,407 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
freqtrade_AI  | 2023-03-21 15:48:42,409 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
freqtrade_AI  | 2023-03-21 15:48:42,410 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
freqtrade_AI  | 2023-03-21 15:48:42,411 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
freqtrade_AI  | 2023-03-21 15:48:42,412 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
freqtrade_AI  | 2023-03-21 15:48:42,413 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
freqtrade_AI  | 2023-03-21 15:48:42,414 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
freqtrade_AI  | 2023-03-21 15:48:42,415 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
freqtrade_AI  | 2023-03-21 15:48:42,417 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
freqtrade_AI  | 2023-03-21 15:48:42,418 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
freqtrade_AI  | 2023-03-21 15:48:42,419 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
freqtrade_AI  | 2023-03-21 15:48:42,420 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
freqtrade_AI  | 2023-03-21 15:48:42,421 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
freqtrade_AI  | 2023-03-21 15:48:42,422 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
freqtrade_AI  | 2023-03-21 15:48:42,423 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
freqtrade_AI  | 2023-03-21 15:48:42,425 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
freqtrade_AI  | 2023-03-21 15:48:42,426 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
freqtrade_AI  | 2023-03-21 15:48:42,437 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
freqtrade_AI  | 2023-03-21 15:48:42,438 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
freqtrade_AI  | 2023-03-21 15:48:42,439 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:48:42,462 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:48:42,488 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
freqtrade_AI  | 2023-03-21 15:48:45,017 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
freqtrade_AI  | 2023-03-21 15:48:45,059 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
freqtrade_AI  | 2023-03-21 15:48:45,060 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
freqtrade_AI  | 2023-03-21 15:48:45,067 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
freqtrade_AI  | 2023-03-21 15:48:45,150 - freqtrade.wallets - INFO - Wallets synced.
freqtrade_AI  | 2023-03-21 15:48:45,156 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:48:45,409 - freqtrade.rpc.rpc_manager - INFO - Enabling rpc.api_server
freqtrade_AI  | 2023-03-21 15:48:46,100 - freqtrade.rpc.api_server.webserver - INFO - Starting HTTP Server at 0.0.0.0:8021
freqtrade_AI  | 2023-03-21 15:48:46,101 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - Local Rest Server listening to external connections
freqtrade_AI  | 2023-03-21 15:48:46,103 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - This is insecure please set to your loopback,e.g 127.0.0.1 in config.json
freqtrade_AI  | 2023-03-21 15:48:46,104 - freqtrade.rpc.api_server.webserver - INFO - Starting Local Rest Server.
freqtrade_AI  | 2023-03-21 15:48:46,116 - uvicorn.error - INFO - Started server process [1]
freqtrade_AI  | 2023-03-21 15:48:46,117 - uvicorn.error - INFO - Waiting for application startup.
freqtrade_AI  | 2023-03-21 15:48:46,119 - uvicorn.error - INFO - Application startup complete.
freqtrade_AI  | 2023-03-21 15:48:46,121 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8021 (Press CTRL+C to quit)
freqtrade_AI  | 2023-03-21 15:48:46,127 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:48:46,137 - freqtrade.plugins.pairlistmanager - INFO - Whitelist with 1 pairs: ['ETH/USDT:USDT']
freqtrade_AI  | 2023-03-21 15:48:48,009 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
freqtrade_AI  | 2023-03-21 15:48:48,014 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
freqtrade_AI  | 2023-03-21 15:48:48,022 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
freqtrade_AI  | 2023-03-21 15:48:48,024 - freqtrade.freqai.freqai_interface - INFO - Set existing queue from trained timestamps. Best approximation queue: deque(['ETH/USDT:USDT'])
freqtrade_AI  | 2023-03-21 15:48:48,049 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
freqtrade_AI  | 2023-03-21 15:48:48,051 - freqtrade.strategy.interface - INFO - Downloading all training data for all pairs in whitelist and corr_pairlist, this may take a while if the data is not already on disk.
freqtrade_AI  | 2023-03-21 15:48:48,054 - freqtrade.freqai.utils - INFO - FreqAI auto-downloader using 450 startup candles.
freqtrade_AI  | 2023-03-21 15:48:48,057 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:48:48,253 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:35:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:48,465 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:48,601 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:48:48,676 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:15:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,214 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,303 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,521 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,577 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,787 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,817 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:48:49,989 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:35:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,197 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,353 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:48:50,436 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:15:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,644 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,731 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,939 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,990 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:51,527 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:51,555 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,557 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,559 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,561 - freqtrade.plugins.protectionmanager - INFO - No protection Handlers defined.
freqtrade_AI  | 2023-03-21 15:48:51,562 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': status, 'status': 'running'}
freqtrade_AI  | 2023-03-21 15:48:51,563 - freqtrade.worker - INFO - Changing state to: RUNNING
freqtrade_AI  | 2023-03-21 15:48:51,564 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': warning, 'status': 'Dry run is enabled. All trades are simulated.'}
freqtrade_AI  | 2023-03-21 15:48:51,566 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "*Exchange:* `bybit`\n*Stake per trade:* `unlimited USDT`\n*Minimum ROI:* `{'0': 0.1, '240': -1}`\n*Stoploss:* `-0.05`\n*Position adjustment:* `Off`\n*Timeframe:* `5m`\n*Strategy:* `freqai_rl_test_strat`"}
freqtrade_AI  | 2023-03-21 15:48:51,567 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "Searching for USDT pairs to buy and sell based on [{'StaticPairList': 'StaticPairList'}]"}
freqtrade_AI  | 2023-03-21 15:48:52,922 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:48:53,040 - freqtrade.freqai.data_kitchen - INFO - DI tossed 28 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:48:53,054 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f28bab99f30>>
freqtrade_AI  | 2023-03-21 15:48:53,056 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:48:53,106 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:48:53,938 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:53,981 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:48:54,657 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:48:54,661 - ReinforcementLearner - INFO - Continual training activated - starting training from previously trained agent.
freqtrade_AI  | 2023-03-21 15:48:54,666 - freqtrade.freqai.freqai_interface - WARNING - Training ETH/USDT:USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1.]], (1, 102), float32) != Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1.]], (1, 105), float32), skipping.
freqtrade_AI  | 2023-03-21 15:48:54,668 - freqtrade.freqai.freqai_interface - INFO - Total time spent training pairlist 0.94 seconds
freqtrade_AI  | 2023-03-21 15:48:55,913 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:55,953 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:48:56,477 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:48:56,480 - ReinforcementLearner - INFO - Continual training activated - starting training from previously trained agent.
freqtrade_AI  | 2023-03-21 15:48:56,486 - freqtrade.freqai.freqai_interface - WARNING - Training ETH/USDT:USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1.]], (1, 102), float32) != Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1.]], (1, 105), float32), skipping.
freqtrade_AI  | 2023-03-21 15:48:56,488 - freqtrade.freqai.freqai_interface - INFO - Total time spent training pairlist 0.79 seconds
freqtrade_AI  | 2023-03-21 15:48:56,579 - freqtrade.worker - INFO - Bot heartbeat. PID=1, version='docker-2023.3.dev-b710bdaf', state='RUNNING'
freqtrade_AI  | 2023-03-21 15:48:56,789 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:48:56,893 - freqtrade.freqai.data_kitchen - INFO - DI tossed 28 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:48:56,906 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f28bab99f30>>
freqtrade_AI  | 2023-03-21 15:48:56,910 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:48:56,927 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:48:57,704 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:57,746 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
Gracefully stopping... (press Ctrl+C again to force)
[+] Running 1/1
 - Container freqtrade_AI  Stopped                                                                                                                                                                                                                                        2.1s
canceled
PS C:\Users\tigge\Documents\VsCode\FreqAI>`

But, it work well if I train a new model from scratch in dryrun.

robcaulk commented 1 year ago

Hello,

Exact same problem here. I tried running it with my own strategy, and then with the tests/strategy/strats/freqai_rl_test.py, but the result was the same. So, if I train a model with a backtest and then try to do a dry run, I encounter these errors. It depends on whether I include "continual_learning" in my config file or not.

Here are my logs without continual learning :

2023-03-21 15:36:45,152 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
2023-03-21 15:36:45,166 - freqtrade.configuration.load_config - INFO - Using config: user_data/config.json ...
2023-03-21 15:36:45,170 - freqtrade.loggers - INFO - Verbosity set to 0
2023-03-21 15:36:45,170 - freqtrade.configuration.configuration - INFO - Parameter -i/--timeframe detected ... Using timeframe: 5m ...
2023-03-21 15:36:45,171 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
2023-03-21 15:36:45,171 - freqtrade.configuration.configuration - INFO - Parameter --timerange detected: 20230315-20230321 ...
2023-03-21 15:36:53,938 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Overriding timeframe with Command line argument
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Parameter --cache=day detected ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Filter trades by timerange: 20230315-20230321
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
2023-03-21 15:36:53,943 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
2023-03-21 15:36:53,964 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
2023-03-21 15:36:53,964 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
2023-03-21 15:36:53,964 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
2023-03-21 15:36:53,970 - freqtrade.commands.optimize_commands - INFO - Starting freqtrade in Backtesting mode
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
2023-03-21 15:36:53,993 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
2023-03-21 15:36:54,029 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
2023-03-21 15:36:55,318 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
2023-03-21 15:36:55,318 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
2023-03-21 15:36:55,325 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
2023-03-21 15:36:55,460 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
2023-03-21 15:36:55,461 - freqtrade.strategy.hyper - INFO - Found no parameter file.
2023-03-21 15:36:55,461 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'timeframe' with value in config file: 5m.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
2023-03-21 15:36:55,466 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
2023-03-21 15:36:55,476 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
2023-03-21 15:36:55,486 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
2023-03-21 15:36:55,486 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:55,486 - freqtrade.data.history.history_utils - INFO - Using indicator startup period: 4620 ...
2023-03-21 15:36:55,683 - freqtrade.optimize.backtesting - INFO - Loading data from 2023-02-26 23:00:00 up to 2023-03-21 00:00:00 (22 days).
2023-03-21 15:36:55,720 - freqtrade.data.converter - INFO - Missing data fillup for ETH/USDT:USDT: before: 19 - after: 37 - 94.74%
2023-03-21 15:36:55,791 - freqtrade.optimize.backtesting - INFO - Dataload complete. Calculating indicators
2023-03-21 15:36:56,038 - freqtrade.optimize.backtesting - INFO - Running backtesting for Strategy freqai_rl_test_strat
2023-03-21 15:36:57,768 - matplotlib.font_manager - INFO - generated new fontManager
2023-03-21 15:36:58,184 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
2023-03-21 15:36:58,187 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
2023-03-21 15:36:58,189 - freqtrade.freqai.data_drawer - INFO - Could not find existing datadrawer, starting from scratch
2023-03-21 15:36:58,192 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
2023-03-21 15:36:58,193 - freqtrade.freqai.freqai_interface - INFO - Set fresh train queue from whitelist. Queue: ['ETH/USDT:USDT']
2023-03-21 15:36:58,207 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
2023-03-21 15:36:58,218 - freqtrade.freqai.freqai_interface - INFO - Training 1 timeranges
2023-03-21 15:36:58,220 - freqtrade.freqai.freqai_interface - INFO - Training ETH/USDT:USDT, 1/1 pairs from 2023-02-28 00:00:00 to 2023-03-15 00:00:00, 1/1 trains
2023-03-21 15:36:58,222 - freqtrade.freqai.data_kitchen - INFO - Could not find backtesting prediction file at /freqtrade/user_data/models/ETH81/backtesting_predictions/cb_eth_1678838400_prediction.feather
2023-03-21 15:36:58,226 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,466 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,591 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,803 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,962 - freqtrade.freqai.freqai_interface - INFO - Could not find model at /freqtrade/user_data/models/ETH81/sub-train-ETH_1678838400/cb_eth_1678838400
2023-03-21 15:36:58,963 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
2023-03-21 15:36:59,014 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4320.
2023-03-21 15:36:59,642 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3240 data points
2023-03-21 15:36:59,643 - freqtrade.freqai.RL.BaseEnvironment - WARNING - add_state_info is not available in backtesting. Deactivating.
2023-03-21 15:36:59,644 - freqtrade.freqai.RL.BaseEnvironment - WARNING - add_state_info is not available in backtesting. Deactivating.
Eval num_timesteps=3240, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=6480, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=9720, episode_reward=-1401.46 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=12960, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=16200, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=19440, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=22680, episode_reward=-1113.41 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=25920, episode_reward=-1209.58 +/- 0.00
Episode length: 673.00 +/- 0.00
Eval num_timesteps=29160, episode_reward=-997.00 +/- 0.00
Episode length: 512.00 +/- 0.00
New best mean reward!
Eval num_timesteps=32400, episode_reward=-1052.55 +/- 0.00
Episode length: 740.00 +/- 0.00
2023-03-21 15:41:12,297 - ReinforcementLearner - INFO - Callback found a best model.
2023-03-21 15:41:12,321 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------done training ETH/USDT:USDT--------------------
2023-03-21 15:41:12,321 - freqtrade.freqai.freqai_interface - INFO - Saving backtest model to disk.
2023-03-21 15:41:12,580 - freqtrade.freqai.data_kitchen - INFO - DI tossed 12 predictions for being too far from training data.
2023-03-21 15:41:14,759 - freqtrade.optimize.backtesting - INFO - Backtesting with data from 2023-03-15 00:00:00 up to 2023-03-21 00:00:00 (6 days).
2023-03-21 15:41:17,975 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/backtest-result-2023-03-21_15-41-17.meta.json"
2023-03-21 15:41:17,980 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/backtest-result-2023-03-21_15-41-17.json"
2023-03-21 15:41:17,986 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/.last_result.json"
Result for strategy freqai_rl_test_strat
============================================================== BACKTESTING REPORT =============================================================
|          Pair |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|---------------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
|         TOTAL |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
=========================================================== ENTER TAG STATS ===========================================================
|   TAG |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|-------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
| short |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
| TOTAL |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
===================================================== EXIT REASON STATS =====================================================
|   Exit Reason |   Exits |   Win  Draws  Loss  Win% |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |
|---------------+---------+--------------------------+----------------+----------------+-------------------+----------------|
|           roi |      34 |     19     0    15  55.9 |          -0    |          -0.09 |            -8.457 |          -0.09 |
|     stop_loss |       1 |      0     0     1     0 |          -5.01 |          -5.01 |           -94.423 |          -5.01 |
|    force_exit |       1 |      1     0     0   100 |           0.9  |           0.9  |            16.862 |           0.9  |
=========================================================== LEFT OPEN TRADES REPORT ===========================================================
|          Pair |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|---------------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
| ETH/USDT:USDT |         1 |           0.90 |           0.90 |            16.862 |           0.84 |        1:20:00 |     1     0     0   100 |
|         TOTAL |         1 |           0.90 |           0.90 |            16.862 |           0.84 |        1:20:00 |     1     0     0   100 |
================== SUMMARY METRICS ===================
| Metric                      | Value                |
|-----------------------------+----------------------|
| Backtesting from            | 2023-03-15 00:00:00  |
| Backtesting to              | 2023-03-21 00:00:00  |
| Max open trades             | 1                    |
|                             |                      |
| Total/Daily Avg Trades      | 36 / 6.0             |
| Starting balance            | 2000 USDT            |
| Final balance               | 1913.981 USDT        |
| Absolute profit             | -86.019 USDT         |
| Total profit %              | -4.30%               |
| CAGR %                      | -93.10%              |
| Sortino                     | -12.73               |
| Sharpe                      | -11.26               |
| Calmar                      | -117.06              |
| Profit factor               | 0.75                 |
| Expectancy                  | -0.11                |
| Trades per day              | 6.0                  |
| Avg. daily profit %         | -0.72%               |
| Avg. stake amount           | 1905.133 USDT        |
| Total trade volume          | 68584.783 USDT       |
|                             |                      |
| Long / Short                | 0 / 36               |
| Total profit Long %         | 0.00%                |
| Total profit Short %        | -4.30%               |
| Absolute profit Long        | 0 USDT               |
| Absolute profit Short       | -86.019 USDT         |
|                             |                      |
| Best Pair                   | ETH/USDT:USDT -4.20% |
| Worst Pair                  | ETH/USDT:USDT -4.20% |
| Best trade                  | ETH/USDT:USDT 2.61%  |
| Worst trade                 | ETH/USDT:USDT -5.01% |
| Best day                    | 59.114 USDT          |
| Worst day                   | -111.812 USDT        |
| Days win/draw/lose          | 3 / 0 / 4            |
| Avg. Duration Winners       | 3:52:00              |
| Avg. Duration Loser         | 3:58:00              |
| Rejected Entry signals      | 0                    |
| Entry/Exit Timeouts         | 0 / 0                |
|                             |                      |
| Min balance                 | 1823.778 USDT        |
| Max balance                 | 2065.399 USDT        |
| Max % of account underwater | 11.70%               |
| Absolute Drawdown (Account) | 11.70%               |
| Absolute Drawdown           | 241.621 USDT         |
| Drawdown high               | 65.399 USDT          |
| Drawdown low                | -176.222 USDT        |
| Drawdown Start              | 2023-03-15 16:20:00  |
| Drawdown End                | 2023-03-18 01:05:00  |
| Market change               | 5.85%                |
======================================================

PS C:\Users\tigge\Documents\VsCode\FreqAI> docker-compose up
[+] Running 1/0
 - Container freqtrade_AI  Created                                                                                                                                                                                                                                        0.0s
Attaching to freqtrade_AI
freqtrade_AI  | 2023-03-21 15:42:06,782 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:42:07,014 - freqtrade.worker - INFO - Starting worker docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:42:07,014 - freqtrade.configuration.load_config - INFO - Using config: /freqtrade/user_data/config.json ...
freqtrade_AI  | 2023-03-21 15:42:07,021 - freqtrade.loggers - INFO - Verbosity set to 0
freqtrade_AI  | 2023-03-21 15:42:07,022 - freqtrade.configuration.configuration - INFO - Runmode set to dry_run.
freqtrade_AI  | 2023-03-21 15:42:07,023 - freqtrade.configuration.configuration - INFO - Parameter --db-url detected ...
freqtrade_AI  | 2023-03-21 15:42:07,024 - freqtrade.configuration.configuration - INFO - Dry run is enabled
freqtrade_AI  | 2023-03-21 15:42:07,026 - freqtrade.configuration.configuration - INFO - Using DB: "sqlite:////freqtrade/user_data/tradesv3.sqlite"
freqtrade_AI  | 2023-03-21 15:42:07,027 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
freqtrade_AI  | 2023-03-21 15:42:15,510 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
freqtrade_AI  | 2023-03-21 15:42:15,513 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
freqtrade_AI  | 2023-03-21 15:42:15,514 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
freqtrade_AI  | 2023-03-21 15:42:15,516 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
freqtrade_AI  | 2023-03-21 15:42:15,539 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
freqtrade_AI  | 2023-03-21 15:42:15,540 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
freqtrade_AI  | 2023-03-21 15:42:15,650 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
freqtrade_AI  | 2023-03-21 15:42:15,651 - freqtrade.strategy.hyper - INFO - Found no parameter file.
freqtrade_AI  | 2023-03-21 15:42:15,653 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
freqtrade_AI  | 2023-03-21 15:42:15,654 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
freqtrade_AI  | 2023-03-21 15:42:15,655 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
freqtrade_AI  | 2023-03-21 15:42:15,656 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
freqtrade_AI  | 2023-03-21 15:42:15,657 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
freqtrade_AI  | 2023-03-21 15:42:15,658 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
freqtrade_AI  | 2023-03-21 15:42:15,660 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
freqtrade_AI  | 2023-03-21 15:42:15,660 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
freqtrade_AI  | 2023-03-21 15:42:15,661 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
freqtrade_AI  | 2023-03-21 15:42:15,662 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
freqtrade_AI  | 2023-03-21 15:42:15,663 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
freqtrade_AI  | 2023-03-21 15:42:15,664 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
freqtrade_AI  | 2023-03-21 15:42:15,665 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
freqtrade_AI  | 2023-03-21 15:42:15,666 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
freqtrade_AI  | 2023-03-21 15:42:15,667 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
freqtrade_AI  | 2023-03-21 15:42:15,668 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
freqtrade_AI  | 2023-03-21 15:42:15,669 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
freqtrade_AI  | 2023-03-21 15:42:15,670 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
freqtrade_AI  | 2023-03-21 15:42:15,671 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
freqtrade_AI  | 2023-03-21 15:42:15,672 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
freqtrade_AI  | 2023-03-21 15:42:15,673 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
freqtrade_AI  | 2023-03-21 15:42:15,674 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
freqtrade_AI  | 2023-03-21 15:42:15,676 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
freqtrade_AI  | 2023-03-21 15:42:15,677 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
freqtrade_AI  | 2023-03-21 15:42:15,678 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
freqtrade_AI  | 2023-03-21 15:42:15,679 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
freqtrade_AI  | 2023-03-21 15:42:15,680 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
freqtrade_AI  | 2023-03-21 15:42:15,682 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
freqtrade_AI  | 2023-03-21 15:42:15,683 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
freqtrade_AI  | 2023-03-21 15:42:15,694 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
freqtrade_AI  | 2023-03-21 15:42:15,697 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
freqtrade_AI  | 2023-03-21 15:42:15,698 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:42:15,720 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:42:15,743 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
freqtrade_AI  | 2023-03-21 15:42:16,977 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
freqtrade_AI  | 2023-03-21 15:42:17,020 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
freqtrade_AI  | 2023-03-21 15:42:17,021 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
freqtrade_AI  | 2023-03-21 15:42:17,028 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
freqtrade_AI  | 2023-03-21 15:42:17,115 - freqtrade.wallets - INFO - Wallets synced.
freqtrade_AI  | 2023-03-21 15:42:17,120 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:42:18,083 - freqtrade.rpc.api_server.webserver - INFO - Starting HTTP Server at 0.0.0.0:8021
freqtrade_AI  | 2023-03-21 15:42:18,085 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - Local Rest Server listening to external connections
freqtrade_AI  | 2023-03-21 15:42:18,087 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - This is insecure please set to your loopback,e.g 127.0.0.1 in config.json
freqtrade_AI  | 2023-03-21 15:42:18,088 - freqtrade.rpc.api_server.webserver - INFO - Starting Local Rest Server.
freqtrade_AI  | 2023-03-21 15:42:18,099 - uvicorn.error - INFO - Started server process [1]
freqtrade_AI  | 2023-03-21 15:42:18,100 - uvicorn.error - INFO - Waiting for application startup.
freqtrade_AI  | 2023-03-21 15:42:18,102 - uvicorn.error - INFO - Application startup complete.
freqtrade_AI  | 2023-03-21 15:42:18,103 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8021 (Press CTRL+C to quit)
freqtrade_AI  | 2023-03-21 15:42:18,110 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:42:18,118 - freqtrade.plugins.pairlistmanager - INFO - Whitelist with 1 pairs: ['ETH/USDT:USDT']
freqtrade_AI  | 2023-03-21 15:42:19,998 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
freqtrade_AI  | 2023-03-21 15:42:20,002 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
freqtrade_AI  | 2023-03-21 15:42:20,011 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
freqtrade_AI  | 2023-03-21 15:42:20,012 - freqtrade.freqai.freqai_interface - INFO - Set existing queue from trained timestamps. Best approximation queue: deque(['ETH/USDT:USDT'])
freqtrade_AI  | 2023-03-21 15:42:20,030 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
freqtrade_AI  | 2023-03-21 15:42:20,032 - freqtrade.strategy.interface - INFO - Downloading all training data for all pairs in whitelist and corr_pairlist, this may take a while if the data is not already on disk.
freqtrade_AI  | 2023-03-21 15:42:20,036 - freqtrade.freqai.utils - INFO - FreqAI auto-downloader using 450 startup candles.
freqtrade_AI  | 2023-03-21 15:42:20,040 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:42:20,232 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:20:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:20,441 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-21 15:42:20,578 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:42:20,647 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:20,856 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:20,938 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,147 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:21,205 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,418 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:21,447 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:42:21,614 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:20:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,823 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-21 15:42:21,955 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:42:22,023 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:22,560 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:22,647 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:23,183 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:23,235 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:23,771 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:23,802 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,803 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,805 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,807 - freqtrade.plugins.protectionmanager - INFO - No protection Handlers defined.
freqtrade_AI  | 2023-03-21 15:42:23,810 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': status, 'status': 'running'}
freqtrade_AI  | 2023-03-21 15:42:23,811 - freqtrade.worker - INFO - Changing state to: RUNNING
freqtrade_AI  | 2023-03-21 15:42:23,813 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': warning, 'status': 'Dry run is enabled. All trades are simulated.'}
freqtrade_AI  | 2023-03-21 15:42:23,814 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "*Exchange:* `bybit`\n*Stake per trade:* `unlimited USDT`\n*Minimum ROI:* `{'0': 0.1, '240': -1}`\n*Stoploss:* `-0.05`\n*Position adjustment:* `Off`\n*Timeframe:* `5m`\n*Strategy:* `freqai_rl_test_strat`"}
freqtrade_AI  | 2023-03-21 15:42:23,816 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "Searching for USDT pairs to buy and sell based on [{'StaticPairList': 'StaticPairList'}]"}
freqtrade_AI  | 2023-03-21 15:42:25,538 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:42:25,623 - freqtrade.freqai.data_kitchen - INFO - DI tossed 27 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:42:25,636 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7fb21ca3df30>>
freqtrade_AI  | 2023-03-21 15:42:25,637 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:42:25,680 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:42:26,529 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:42:26,571 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:42:27,078 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:42:28,828 - freqtrade.worker - INFO - Bot heartbeat. PID=1, version='docker-2023.3.dev-b710bdaf', state='RUNNING'
freqtrade_AI  | 2023-03-21 15:42:29,088 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:42:29,252 - freqtrade.freqai.data_kitchen - INFO - DI tossed 27 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:42:29,272 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7fb21ca3df30>>
freqtrade_AI  | 2023-03-21 15:42:29,285 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:42:29,317 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:42:33,981 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
Gracefully stopping... (press Ctrl+C again to force)
[+] Running 1/1
 - Container freqtrade_AI  Stopped

and this is my logs with continual_learning :

`PS C:\Users\tigge\Documents\VsCode\FreqAI> docker-compose up
[+] Running 1/0
- Container freqtrade_AI  Created                                                                                                                                                                                                                                        0.0s
Attaching to freqtrade_AI
freqtrade_AI  | 2023-03-21 15:48:33,315 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:48:33,543 - freqtrade.worker - INFO - Starting worker docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:48:33,543 - freqtrade.configuration.load_config - INFO - Using config: /freqtrade/user_data/config.json ...
freqtrade_AI  | 2023-03-21 15:48:33,549 - freqtrade.loggers - INFO - Verbosity set to 0
freqtrade_AI  | 2023-03-21 15:48:33,550 - freqtrade.configuration.configuration - INFO - Runmode set to dry_run.
freqtrade_AI  | 2023-03-21 15:48:33,551 - freqtrade.configuration.configuration - INFO - Parameter --db-url detected ...
freqtrade_AI  | 2023-03-21 15:48:33,552 - freqtrade.configuration.configuration - INFO - Dry run is enabled
freqtrade_AI  | 2023-03-21 15:48:33,553 - freqtrade.configuration.configuration - INFO - Using DB: "sqlite:////freqtrade/user_data/tradesv3.sqlite"
freqtrade_AI  | 2023-03-21 15:48:33,554 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
freqtrade_AI  | 2023-03-21 15:48:42,232 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
freqtrade_AI  | 2023-03-21 15:48:42,235 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
freqtrade_AI  | 2023-03-21 15:48:42,237 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
freqtrade_AI  | 2023-03-21 15:48:42,239 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
freqtrade_AI  | 2023-03-21 15:48:42,263 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
freqtrade_AI  | 2023-03-21 15:48:42,264 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
freqtrade_AI  | 2023-03-21 15:48:42,389 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
freqtrade_AI  | 2023-03-21 15:48:42,391 - freqtrade.strategy.hyper - INFO - Found no parameter file.
freqtrade_AI  | 2023-03-21 15:48:42,393 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
freqtrade_AI  | 2023-03-21 15:48:42,395 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
freqtrade_AI  | 2023-03-21 15:48:42,396 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
freqtrade_AI  | 2023-03-21 15:48:42,397 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
freqtrade_AI  | 2023-03-21 15:48:42,398 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
freqtrade_AI  | 2023-03-21 15:48:42,399 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
freqtrade_AI  | 2023-03-21 15:48:42,400 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
freqtrade_AI  | 2023-03-21 15:48:42,402 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
freqtrade_AI  | 2023-03-21 15:48:42,403 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
freqtrade_AI  | 2023-03-21 15:48:42,404 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
freqtrade_AI  | 2023-03-21 15:48:42,405 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
freqtrade_AI  | 2023-03-21 15:48:42,406 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
freqtrade_AI  | 2023-03-21 15:48:42,407 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
freqtrade_AI  | 2023-03-21 15:48:42,409 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
freqtrade_AI  | 2023-03-21 15:48:42,410 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
freqtrade_AI  | 2023-03-21 15:48:42,411 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
freqtrade_AI  | 2023-03-21 15:48:42,412 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
freqtrade_AI  | 2023-03-21 15:48:42,413 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
freqtrade_AI  | 2023-03-21 15:48:42,414 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
freqtrade_AI  | 2023-03-21 15:48:42,415 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
freqtrade_AI  | 2023-03-21 15:48:42,417 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
freqtrade_AI  | 2023-03-21 15:48:42,418 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
freqtrade_AI  | 2023-03-21 15:48:42,419 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
freqtrade_AI  | 2023-03-21 15:48:42,420 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
freqtrade_AI  | 2023-03-21 15:48:42,421 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
freqtrade_AI  | 2023-03-21 15:48:42,422 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
freqtrade_AI  | 2023-03-21 15:48:42,423 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
freqtrade_AI  | 2023-03-21 15:48:42,425 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
freqtrade_AI  | 2023-03-21 15:48:42,426 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
freqtrade_AI  | 2023-03-21 15:48:42,437 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
freqtrade_AI  | 2023-03-21 15:48:42,438 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
freqtrade_AI  | 2023-03-21 15:48:42,439 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:48:42,462 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:48:42,488 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
freqtrade_AI  | 2023-03-21 15:48:45,017 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
freqtrade_AI  | 2023-03-21 15:48:45,059 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
freqtrade_AI  | 2023-03-21 15:48:45,060 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
freqtrade_AI  | 2023-03-21 15:48:45,067 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
freqtrade_AI  | 2023-03-21 15:48:45,150 - freqtrade.wallets - INFO - Wallets synced.
freqtrade_AI  | 2023-03-21 15:48:45,156 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:48:45,409 - freqtrade.rpc.rpc_manager - INFO - Enabling rpc.api_server
freqtrade_AI  | 2023-03-21 15:48:46,100 - freqtrade.rpc.api_server.webserver - INFO - Starting HTTP Server at 0.0.0.0:8021
freqtrade_AI  | 2023-03-21 15:48:46,101 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - Local Rest Server listening to external connections
freqtrade_AI  | 2023-03-21 15:48:46,103 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - This is insecure please set to your loopback,e.g 127.0.0.1 in config.json
freqtrade_AI  | 2023-03-21 15:48:46,104 - freqtrade.rpc.api_server.webserver - INFO - Starting Local Rest Server.
freqtrade_AI  | 2023-03-21 15:48:46,116 - uvicorn.error - INFO - Started server process [1]
freqtrade_AI  | 2023-03-21 15:48:46,117 - uvicorn.error - INFO - Waiting for application startup.
freqtrade_AI  | 2023-03-21 15:48:46,119 - uvicorn.error - INFO - Application startup complete.
freqtrade_AI  | 2023-03-21 15:48:46,121 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8021 (Press CTRL+C to quit)
freqtrade_AI  | 2023-03-21 15:48:46,127 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:48:46,137 - freqtrade.plugins.pairlistmanager - INFO - Whitelist with 1 pairs: ['ETH/USDT:USDT']
freqtrade_AI  | 2023-03-21 15:48:48,009 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
freqtrade_AI  | 2023-03-21 15:48:48,014 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
freqtrade_AI  | 2023-03-21 15:48:48,022 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
freqtrade_AI  | 2023-03-21 15:48:48,024 - freqtrade.freqai.freqai_interface - INFO - Set existing queue from trained timestamps. Best approximation queue: deque(['ETH/USDT:USDT'])
freqtrade_AI  | 2023-03-21 15:48:48,049 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
freqtrade_AI  | 2023-03-21 15:48:48,051 - freqtrade.strategy.interface - INFO - Downloading all training data for all pairs in whitelist and corr_pairlist, this may take a while if the data is not already on disk.
freqtrade_AI  | 2023-03-21 15:48:48,054 - freqtrade.freqai.utils - INFO - FreqAI auto-downloader using 450 startup candles.
freqtrade_AI  | 2023-03-21 15:48:48,057 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:48:48,253 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:35:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:48,465 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:48,601 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:48:48,676 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:15:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,214 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,303 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,521 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,577 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,787 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,817 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:48:49,989 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:35:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,197 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,353 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:48:50,436 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:15:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,644 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,731 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,939 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,990 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:51,527 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:51,555 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,557 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,559 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,561 - freqtrade.plugins.protectionmanager - INFO - No protection Handlers defined.
freqtrade_AI  | 2023-03-21 15:48:51,562 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': status, 'status': 'running'}
freqtrade_AI  | 2023-03-21 15:48:51,563 - freqtrade.worker - INFO - Changing state to: RUNNING
freqtrade_AI  | 2023-03-21 15:48:51,564 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': warning, 'status': 'Dry run is enabled. All trades are simulated.'}
freqtrade_AI  | 2023-03-21 15:48:51,566 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "*Exchange:* `bybit`\n*Stake per trade:* `unlimited USDT`\n*Minimum ROI:* `{'0': 0.1, '240': -1}`\n*Stoploss:* `-0.05`\n*Position adjustment:* `Off`\n*Timeframe:* `5m`\n*Strategy:* `freqai_rl_test_strat`"}
freqtrade_AI  | 2023-03-21 15:48:51,567 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "Searching for USDT pairs to buy and sell based on [{'StaticPairList': 'StaticPairList'}]"}
freqtrade_AI  | 2023-03-21 15:48:52,922 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:48:53,040 - freqtrade.freqai.data_kitchen - INFO - DI tossed 28 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:48:53,054 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f28bab99f30>>
freqtrade_AI  | 2023-03-21 15:48:53,056 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:48:53,106 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:48:53,938 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:53,981 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:48:54,657 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:48:54,661 - ReinforcementLearner - INFO - Continual training activated - starting training from previously trained agent.
freqtrade_AI  | 2023-03-21 15:48:54,666 - freqtrade.freqai.freqai_interface - WARNING - Training ETH/USDT:USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1.]], (1, 102), float32) != Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1.]], (1, 105), float32), skipping.
freqtrade_AI  | 2023-03-21 15:48:54,668 - freqtrade.freqai.freqai_interface - INFO - Total time spent training pairlist 0.94 seconds
freqtrade_AI  | 2023-03-21 15:48:55,913 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:55,953 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:48:56,477 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:48:56,480 - ReinforcementLearner - INFO - Continual training activated - starting training from previously trained agent.
freqtrade_AI  | 2023-03-21 15:48:56,486 - freqtrade.freqai.freqai_interface - WARNING - Training ETH/USDT:USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1.]], (1, 102), float32) != Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1.]], (1, 105), float32), skipping.
freqtrade_AI  | 2023-03-21 15:48:56,488 - freqtrade.freqai.freqai_interface - INFO - Total time spent training pairlist 0.79 seconds
freqtrade_AI  | 2023-03-21 15:48:56,579 - freqtrade.worker - INFO - Bot heartbeat. PID=1, version='docker-2023.3.dev-b710bdaf', state='RUNNING'
freqtrade_AI  | 2023-03-21 15:48:56,789 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:48:56,893 - freqtrade.freqai.data_kitchen - INFO - DI tossed 28 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:48:56,906 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f28bab99f30>>
freqtrade_AI  | 2023-03-21 15:48:56,910 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:48:56,927 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:48:57,704 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:57,746 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
Gracefully stopping... (press Ctrl+C again to force)
[+] Running 1/1
- Container freqtrade_AI  Stopped                                                                                                                                                                                                                                        2.1s
canceled
PS C:\Users\tigge\Documents\VsCode\FreqAI>`

But, it work well if I train a new model from scratch in dryrun.

Hello, thank you for the information.

Can you please tell me if it works after setting "continual_learning": false in your freqai config?

Cheers,

Robert

robcaulk commented 1 year ago

In my case it's happens when switched on options "continual_learning" and "principal_component_analysis". After starting next cycle and if PCA give another quantity of features than in previous cycle of learning we receiving this error and empty model.

Yes, PCA is not compatible with continual learning.

DavF27 commented 1 year ago

Hello, Exact same problem here. I tried running it with my own strategy, and then with the tests/strategy/strats/freqai_rl_test.py, but the result was the same. So, if I train a model with a backtest and then try to do a dry run, I encounter these errors. It depends on whether I include "continual_learning" in my config file or not. Here are my logs without continual learning :

2023-03-21 15:36:45,152 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
2023-03-21 15:36:45,166 - freqtrade.configuration.load_config - INFO - Using config: user_data/config.json ...
2023-03-21 15:36:45,170 - freqtrade.loggers - INFO - Verbosity set to 0
2023-03-21 15:36:45,170 - freqtrade.configuration.configuration - INFO - Parameter -i/--timeframe detected ... Using timeframe: 5m ...
2023-03-21 15:36:45,171 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
2023-03-21 15:36:45,171 - freqtrade.configuration.configuration - INFO - Parameter --timerange detected: 20230315-20230321 ...
2023-03-21 15:36:53,938 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Overriding timeframe with Command line argument
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Parameter --cache=day detected ...
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Filter trades by timerange: 20230315-20230321
2023-03-21 15:36:53,941 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
2023-03-21 15:36:53,943 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
2023-03-21 15:36:53,964 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
2023-03-21 15:36:53,964 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
2023-03-21 15:36:53,964 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
2023-03-21 15:36:53,970 - freqtrade.commands.optimize_commands - INFO - Starting freqtrade in Backtesting mode
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
2023-03-21 15:36:53,971 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
2023-03-21 15:36:53,993 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
2023-03-21 15:36:54,029 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
2023-03-21 15:36:55,318 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
2023-03-21 15:36:55,318 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
2023-03-21 15:36:55,325 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
2023-03-21 15:36:55,460 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
2023-03-21 15:36:55,461 - freqtrade.strategy.hyper - INFO - Found no parameter file.
2023-03-21 15:36:55,461 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'timeframe' with value in config file: 5m.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
2023-03-21 15:36:55,462 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
2023-03-21 15:36:55,463 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
2023-03-21 15:36:55,464 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
2023-03-21 15:36:55,465 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
2023-03-21 15:36:55,466 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
2023-03-21 15:36:55,476 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
2023-03-21 15:36:55,486 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
2023-03-21 15:36:55,486 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:55,486 - freqtrade.data.history.history_utils - INFO - Using indicator startup period: 4620 ...
2023-03-21 15:36:55,683 - freqtrade.optimize.backtesting - INFO - Loading data from 2023-02-26 23:00:00 up to 2023-03-21 00:00:00 (22 days).
2023-03-21 15:36:55,720 - freqtrade.data.converter - INFO - Missing data fillup for ETH/USDT:USDT: before: 19 - after: 37 - 94.74%
2023-03-21 15:36:55,791 - freqtrade.optimize.backtesting - INFO - Dataload complete. Calculating indicators
2023-03-21 15:36:56,038 - freqtrade.optimize.backtesting - INFO - Running backtesting for Strategy freqai_rl_test_strat
2023-03-21 15:36:57,768 - matplotlib.font_manager - INFO - generated new fontManager
2023-03-21 15:36:58,184 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
2023-03-21 15:36:58,187 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
2023-03-21 15:36:58,189 - freqtrade.freqai.data_drawer - INFO - Could not find existing datadrawer, starting from scratch
2023-03-21 15:36:58,192 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
2023-03-21 15:36:58,193 - freqtrade.freqai.freqai_interface - INFO - Set fresh train queue from whitelist. Queue: ['ETH/USDT:USDT']
2023-03-21 15:36:58,207 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
2023-03-21 15:36:58,208 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
2023-03-21 15:36:58,218 - freqtrade.freqai.freqai_interface - INFO - Training 1 timeranges
2023-03-21 15:36:58,220 - freqtrade.freqai.freqai_interface - INFO - Training ETH/USDT:USDT, 1/1 pairs from 2023-02-28 00:00:00 to 2023-03-15 00:00:00, 1/1 trains
2023-03-21 15:36:58,222 - freqtrade.freqai.data_kitchen - INFO - Could not find backtesting prediction file at /freqtrade/user_data/models/ETH81/backtesting_predictions/cb_eth_1678838400_prediction.feather
2023-03-21 15:36:58,226 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,466 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,591 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,803 - freqtrade.data.dataprovider - INFO - Increasing startup_candle_count for freqai to 4620
2023-03-21 15:36:58,962 - freqtrade.freqai.freqai_interface - INFO - Could not find model at /freqtrade/user_data/models/ETH81/sub-train-ETH_1678838400/cb_eth_1678838400
2023-03-21 15:36:58,963 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
2023-03-21 15:36:59,014 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4320.
2023-03-21 15:36:59,642 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3240 data points
2023-03-21 15:36:59,643 - freqtrade.freqai.RL.BaseEnvironment - WARNING - add_state_info is not available in backtesting. Deactivating.
2023-03-21 15:36:59,644 - freqtrade.freqai.RL.BaseEnvironment - WARNING - add_state_info is not available in backtesting. Deactivating.
Eval num_timesteps=3240, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=6480, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=9720, episode_reward=-1401.46 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=12960, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=16200, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=19440, episode_reward=-2156.00 +/- 0.00
Episode length: 1078.00 +/- 0.00
Eval num_timesteps=22680, episode_reward=-1113.41 +/- 0.00
Episode length: 1078.00 +/- 0.00
New best mean reward!
Eval num_timesteps=25920, episode_reward=-1209.58 +/- 0.00
Episode length: 673.00 +/- 0.00
Eval num_timesteps=29160, episode_reward=-997.00 +/- 0.00
Episode length: 512.00 +/- 0.00
New best mean reward!
Eval num_timesteps=32400, episode_reward=-1052.55 +/- 0.00
Episode length: 740.00 +/- 0.00
2023-03-21 15:41:12,297 - ReinforcementLearner - INFO - Callback found a best model.
2023-03-21 15:41:12,321 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------done training ETH/USDT:USDT--------------------
2023-03-21 15:41:12,321 - freqtrade.freqai.freqai_interface - INFO - Saving backtest model to disk.
2023-03-21 15:41:12,580 - freqtrade.freqai.data_kitchen - INFO - DI tossed 12 predictions for being too far from training data.
2023-03-21 15:41:14,759 - freqtrade.optimize.backtesting - INFO - Backtesting with data from 2023-03-15 00:00:00 up to 2023-03-21 00:00:00 (6 days).
2023-03-21 15:41:17,975 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/backtest-result-2023-03-21_15-41-17.meta.json"
2023-03-21 15:41:17,980 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/backtest-result-2023-03-21_15-41-17.json"
2023-03-21 15:41:17,986 - freqtrade.misc - INFO - dumping json to "/freqtrade/user_data/backtest_results/.last_result.json"
Result for strategy freqai_rl_test_strat
============================================================== BACKTESTING REPORT =============================================================
|          Pair |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|---------------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
|         TOTAL |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
=========================================================== ENTER TAG STATS ===========================================================
|   TAG |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|-------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
| short |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
| TOTAL |        36 |          -0.12 |          -4.20 |           -86.019 |          -4.30 |        3:55:00 |    20     0    16  55.6 |
===================================================== EXIT REASON STATS =====================================================
|   Exit Reason |   Exits |   Win  Draws  Loss  Win% |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |
|---------------+---------+--------------------------+----------------+----------------+-------------------+----------------|
|           roi |      34 |     19     0    15  55.9 |          -0    |          -0.09 |            -8.457 |          -0.09 |
|     stop_loss |       1 |      0     0     1     0 |          -5.01 |          -5.01 |           -94.423 |          -5.01 |
|    force_exit |       1 |      1     0     0   100 |           0.9  |           0.9  |            16.862 |           0.9  |
=========================================================== LEFT OPEN TRADES REPORT ===========================================================
|          Pair |   Entries |   Avg Profit % |   Cum Profit % |   Tot Profit USDT |   Tot Profit % |   Avg Duration |   Win  Draw  Loss  Win% |
|---------------+-----------+----------------+----------------+-------------------+----------------+----------------+-------------------------|
| ETH/USDT:USDT |         1 |           0.90 |           0.90 |            16.862 |           0.84 |        1:20:00 |     1     0     0   100 |
|         TOTAL |         1 |           0.90 |           0.90 |            16.862 |           0.84 |        1:20:00 |     1     0     0   100 |
================== SUMMARY METRICS ===================
| Metric                      | Value                |
|-----------------------------+----------------------|
| Backtesting from            | 2023-03-15 00:00:00  |
| Backtesting to              | 2023-03-21 00:00:00  |
| Max open trades             | 1                    |
|                             |                      |
| Total/Daily Avg Trades      | 36 / 6.0             |
| Starting balance            | 2000 USDT            |
| Final balance               | 1913.981 USDT        |
| Absolute profit             | -86.019 USDT         |
| Total profit %              | -4.30%               |
| CAGR %                      | -93.10%              |
| Sortino                     | -12.73               |
| Sharpe                      | -11.26               |
| Calmar                      | -117.06              |
| Profit factor               | 0.75                 |
| Expectancy                  | -0.11                |
| Trades per day              | 6.0                  |
| Avg. daily profit %         | -0.72%               |
| Avg. stake amount           | 1905.133 USDT        |
| Total trade volume          | 68584.783 USDT       |
|                             |                      |
| Long / Short                | 0 / 36               |
| Total profit Long %         | 0.00%                |
| Total profit Short %        | -4.30%               |
| Absolute profit Long        | 0 USDT               |
| Absolute profit Short       | -86.019 USDT         |
|                             |                      |
| Best Pair                   | ETH/USDT:USDT -4.20% |
| Worst Pair                  | ETH/USDT:USDT -4.20% |
| Best trade                  | ETH/USDT:USDT 2.61%  |
| Worst trade                 | ETH/USDT:USDT -5.01% |
| Best day                    | 59.114 USDT          |
| Worst day                   | -111.812 USDT        |
| Days win/draw/lose          | 3 / 0 / 4            |
| Avg. Duration Winners       | 3:52:00              |
| Avg. Duration Loser         | 3:58:00              |
| Rejected Entry signals      | 0                    |
| Entry/Exit Timeouts         | 0 / 0                |
|                             |                      |
| Min balance                 | 1823.778 USDT        |
| Max balance                 | 2065.399 USDT        |
| Max % of account underwater | 11.70%               |
| Absolute Drawdown (Account) | 11.70%               |
| Absolute Drawdown           | 241.621 USDT         |
| Drawdown high               | 65.399 USDT          |
| Drawdown low                | -176.222 USDT        |
| Drawdown Start              | 2023-03-15 16:20:00  |
| Drawdown End                | 2023-03-18 01:05:00  |
| Market change               | 5.85%                |
======================================================

PS C:\Users\tigge\Documents\VsCode\FreqAI> docker-compose up
[+] Running 1/0
 - Container freqtrade_AI  Created                                                                                                                                                                                                                                        0.0s
Attaching to freqtrade_AI
freqtrade_AI  | 2023-03-21 15:42:06,782 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:42:07,014 - freqtrade.worker - INFO - Starting worker docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:42:07,014 - freqtrade.configuration.load_config - INFO - Using config: /freqtrade/user_data/config.json ...
freqtrade_AI  | 2023-03-21 15:42:07,021 - freqtrade.loggers - INFO - Verbosity set to 0
freqtrade_AI  | 2023-03-21 15:42:07,022 - freqtrade.configuration.configuration - INFO - Runmode set to dry_run.
freqtrade_AI  | 2023-03-21 15:42:07,023 - freqtrade.configuration.configuration - INFO - Parameter --db-url detected ...
freqtrade_AI  | 2023-03-21 15:42:07,024 - freqtrade.configuration.configuration - INFO - Dry run is enabled
freqtrade_AI  | 2023-03-21 15:42:07,026 - freqtrade.configuration.configuration - INFO - Using DB: "sqlite:////freqtrade/user_data/tradesv3.sqlite"
freqtrade_AI  | 2023-03-21 15:42:07,027 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
freqtrade_AI  | 2023-03-21 15:42:15,510 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
freqtrade_AI  | 2023-03-21 15:42:15,513 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
freqtrade_AI  | 2023-03-21 15:42:15,514 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
freqtrade_AI  | 2023-03-21 15:42:15,516 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
freqtrade_AI  | 2023-03-21 15:42:15,539 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
freqtrade_AI  | 2023-03-21 15:42:15,540 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
freqtrade_AI  | 2023-03-21 15:42:15,650 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
freqtrade_AI  | 2023-03-21 15:42:15,651 - freqtrade.strategy.hyper - INFO - Found no parameter file.
freqtrade_AI  | 2023-03-21 15:42:15,653 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
freqtrade_AI  | 2023-03-21 15:42:15,654 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
freqtrade_AI  | 2023-03-21 15:42:15,655 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
freqtrade_AI  | 2023-03-21 15:42:15,656 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
freqtrade_AI  | 2023-03-21 15:42:15,657 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
freqtrade_AI  | 2023-03-21 15:42:15,658 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
freqtrade_AI  | 2023-03-21 15:42:15,660 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
freqtrade_AI  | 2023-03-21 15:42:15,660 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
freqtrade_AI  | 2023-03-21 15:42:15,661 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
freqtrade_AI  | 2023-03-21 15:42:15,662 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
freqtrade_AI  | 2023-03-21 15:42:15,663 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
freqtrade_AI  | 2023-03-21 15:42:15,664 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
freqtrade_AI  | 2023-03-21 15:42:15,665 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
freqtrade_AI  | 2023-03-21 15:42:15,666 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
freqtrade_AI  | 2023-03-21 15:42:15,667 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
freqtrade_AI  | 2023-03-21 15:42:15,668 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
freqtrade_AI  | 2023-03-21 15:42:15,669 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
freqtrade_AI  | 2023-03-21 15:42:15,670 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
freqtrade_AI  | 2023-03-21 15:42:15,671 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
freqtrade_AI  | 2023-03-21 15:42:15,672 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
freqtrade_AI  | 2023-03-21 15:42:15,673 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
freqtrade_AI  | 2023-03-21 15:42:15,674 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
freqtrade_AI  | 2023-03-21 15:42:15,676 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
freqtrade_AI  | 2023-03-21 15:42:15,677 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
freqtrade_AI  | 2023-03-21 15:42:15,678 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
freqtrade_AI  | 2023-03-21 15:42:15,679 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
freqtrade_AI  | 2023-03-21 15:42:15,680 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
freqtrade_AI  | 2023-03-21 15:42:15,682 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
freqtrade_AI  | 2023-03-21 15:42:15,683 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
freqtrade_AI  | 2023-03-21 15:42:15,694 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
freqtrade_AI  | 2023-03-21 15:42:15,697 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
freqtrade_AI  | 2023-03-21 15:42:15,698 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:42:15,720 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:42:15,743 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
freqtrade_AI  | 2023-03-21 15:42:16,977 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
freqtrade_AI  | 2023-03-21 15:42:17,020 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
freqtrade_AI  | 2023-03-21 15:42:17,021 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
freqtrade_AI  | 2023-03-21 15:42:17,028 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
freqtrade_AI  | 2023-03-21 15:42:17,115 - freqtrade.wallets - INFO - Wallets synced.
freqtrade_AI  | 2023-03-21 15:42:17,120 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:42:18,083 - freqtrade.rpc.api_server.webserver - INFO - Starting HTTP Server at 0.0.0.0:8021
freqtrade_AI  | 2023-03-21 15:42:18,085 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - Local Rest Server listening to external connections
freqtrade_AI  | 2023-03-21 15:42:18,087 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - This is insecure please set to your loopback,e.g 127.0.0.1 in config.json
freqtrade_AI  | 2023-03-21 15:42:18,088 - freqtrade.rpc.api_server.webserver - INFO - Starting Local Rest Server.
freqtrade_AI  | 2023-03-21 15:42:18,099 - uvicorn.error - INFO - Started server process [1]
freqtrade_AI  | 2023-03-21 15:42:18,100 - uvicorn.error - INFO - Waiting for application startup.
freqtrade_AI  | 2023-03-21 15:42:18,102 - uvicorn.error - INFO - Application startup complete.
freqtrade_AI  | 2023-03-21 15:42:18,103 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8021 (Press CTRL+C to quit)
freqtrade_AI  | 2023-03-21 15:42:18,110 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:42:18,118 - freqtrade.plugins.pairlistmanager - INFO - Whitelist with 1 pairs: ['ETH/USDT:USDT']
freqtrade_AI  | 2023-03-21 15:42:19,998 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
freqtrade_AI  | 2023-03-21 15:42:20,002 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
freqtrade_AI  | 2023-03-21 15:42:20,011 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
freqtrade_AI  | 2023-03-21 15:42:20,012 - freqtrade.freqai.freqai_interface - INFO - Set existing queue from trained timestamps. Best approximation queue: deque(['ETH/USDT:USDT'])
freqtrade_AI  | 2023-03-21 15:42:20,030 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
freqtrade_AI  | 2023-03-21 15:42:20,032 - freqtrade.strategy.interface - INFO - Downloading all training data for all pairs in whitelist and corr_pairlist, this may take a while if the data is not already on disk.
freqtrade_AI  | 2023-03-21 15:42:20,036 - freqtrade.freqai.utils - INFO - FreqAI auto-downloader using 450 startup candles.
freqtrade_AI  | 2023-03-21 15:42:20,040 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:42:20,232 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:20:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:20,441 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-21 15:42:20,578 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:42:20,647 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:20,856 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:20,938 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,147 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:21,205 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,418 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:21,447 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:42:21,614 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:20:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:21,823 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-21 15:42:21,955 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:42:22,023 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:22,560 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:22,647 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:23,183 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:23,235 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:42:20
freqtrade_AI  | 2023-03-21 15:42:23,771 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:42:23,802 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,803 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,805 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
freqtrade_AI  | 2023-03-21 15:42:23,807 - freqtrade.plugins.protectionmanager - INFO - No protection Handlers defined.
freqtrade_AI  | 2023-03-21 15:42:23,810 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': status, 'status': 'running'}
freqtrade_AI  | 2023-03-21 15:42:23,811 - freqtrade.worker - INFO - Changing state to: RUNNING
freqtrade_AI  | 2023-03-21 15:42:23,813 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': warning, 'status': 'Dry run is enabled. All trades are simulated.'}
freqtrade_AI  | 2023-03-21 15:42:23,814 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "*Exchange:* `bybit`\n*Stake per trade:* `unlimited USDT`\n*Minimum ROI:* `{'0': 0.1, '240': -1}`\n*Stoploss:* `-0.05`\n*Position adjustment:* `Off`\n*Timeframe:* `5m`\n*Strategy:* `freqai_rl_test_strat`"}
freqtrade_AI  | 2023-03-21 15:42:23,816 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "Searching for USDT pairs to buy and sell based on [{'StaticPairList': 'StaticPairList'}]"}
freqtrade_AI  | 2023-03-21 15:42:25,538 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:42:25,623 - freqtrade.freqai.data_kitchen - INFO - DI tossed 27 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:42:25,636 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7fb21ca3df30>>
freqtrade_AI  | 2023-03-21 15:42:25,637 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:42:25,680 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:42:26,529 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:42:26,571 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:42:27,078 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:42:28,828 - freqtrade.worker - INFO - Bot heartbeat. PID=1, version='docker-2023.3.dev-b710bdaf', state='RUNNING'
freqtrade_AI  | 2023-03-21 15:42:29,088 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:42:29,252 - freqtrade.freqai.data_kitchen - INFO - DI tossed 27 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:42:29,272 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7fb21ca3df30>>
freqtrade_AI  | 2023-03-21 15:42:29,285 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:42:29,317 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:42:33,981 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
Gracefully stopping... (press Ctrl+C again to force)
[+] Running 1/1
 - Container freqtrade_AI  Stopped

and this is my logs with continual_learning :

`PS C:\Users\tigge\Documents\VsCode\FreqAI> docker-compose up
[+] Running 1/0
- Container freqtrade_AI  Created                                                                                                                                                                                                                                        0.0s
Attaching to freqtrade_AI
freqtrade_AI  | 2023-03-21 15:48:33,315 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:48:33,543 - freqtrade.worker - INFO - Starting worker docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-21 15:48:33,543 - freqtrade.configuration.load_config - INFO - Using config: /freqtrade/user_data/config.json ...
freqtrade_AI  | 2023-03-21 15:48:33,549 - freqtrade.loggers - INFO - Verbosity set to 0
freqtrade_AI  | 2023-03-21 15:48:33,550 - freqtrade.configuration.configuration - INFO - Runmode set to dry_run.
freqtrade_AI  | 2023-03-21 15:48:33,551 - freqtrade.configuration.configuration - INFO - Parameter --db-url detected ...
freqtrade_AI  | 2023-03-21 15:48:33,552 - freqtrade.configuration.configuration - INFO - Dry run is enabled
freqtrade_AI  | 2023-03-21 15:48:33,553 - freqtrade.configuration.configuration - INFO - Using DB: "sqlite:////freqtrade/user_data/tradesv3.sqlite"
freqtrade_AI  | 2023-03-21 15:48:33,554 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
freqtrade_AI  | 2023-03-21 15:48:42,232 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
freqtrade_AI  | 2023-03-21 15:48:42,235 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
freqtrade_AI  | 2023-03-21 15:48:42,237 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
freqtrade_AI  | 2023-03-21 15:48:42,239 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
freqtrade_AI  | 2023-03-21 15:48:42,263 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
freqtrade_AI  | 2023-03-21 15:48:42,264 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
freqtrade_AI  | 2023-03-21 15:48:42,389 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
freqtrade_AI  | 2023-03-21 15:48:42,391 - freqtrade.strategy.hyper - INFO - Found no parameter file.
freqtrade_AI  | 2023-03-21 15:48:42,393 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
freqtrade_AI  | 2023-03-21 15:48:42,395 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
freqtrade_AI  | 2023-03-21 15:48:42,396 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
freqtrade_AI  | 2023-03-21 15:48:42,397 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
freqtrade_AI  | 2023-03-21 15:48:42,398 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
freqtrade_AI  | 2023-03-21 15:48:42,399 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
freqtrade_AI  | 2023-03-21 15:48:42,400 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
freqtrade_AI  | 2023-03-21 15:48:42,402 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
freqtrade_AI  | 2023-03-21 15:48:42,403 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
freqtrade_AI  | 2023-03-21 15:48:42,404 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
freqtrade_AI  | 2023-03-21 15:48:42,405 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
freqtrade_AI  | 2023-03-21 15:48:42,406 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
freqtrade_AI  | 2023-03-21 15:48:42,407 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'limit', 'exit': 'limit', 'stoploss': 'limit', 'stoploss_on_exchange': False, 'stoploss_on_exchange_interval': 60}
freqtrade_AI  | 2023-03-21 15:48:42,409 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
freqtrade_AI  | 2023-03-21 15:48:42,410 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
freqtrade_AI  | 2023-03-21 15:48:42,411 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
freqtrade_AI  | 2023-03-21 15:48:42,412 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
freqtrade_AI  | 2023-03-21 15:48:42,413 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
freqtrade_AI  | 2023-03-21 15:48:42,414 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
freqtrade_AI  | 2023-03-21 15:48:42,415 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
freqtrade_AI  | 2023-03-21 15:48:42,417 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
freqtrade_AI  | 2023-03-21 15:48:42,418 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
freqtrade_AI  | 2023-03-21 15:48:42,419 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
freqtrade_AI  | 2023-03-21 15:48:42,420 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
freqtrade_AI  | 2023-03-21 15:48:42,421 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
freqtrade_AI  | 2023-03-21 15:48:42,422 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
freqtrade_AI  | 2023-03-21 15:48:42,423 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
freqtrade_AI  | 2023-03-21 15:48:42,425 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
freqtrade_AI  | 2023-03-21 15:48:42,426 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
freqtrade_AI  | 2023-03-21 15:48:42,437 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
freqtrade_AI  | 2023-03-21 15:48:42,438 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
freqtrade_AI  | 2023-03-21 15:48:42,439 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:48:42,462 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-21 15:48:42,488 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
freqtrade_AI  | 2023-03-21 15:48:45,017 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
freqtrade_AI  | 2023-03-21 15:48:45,059 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
freqtrade_AI  | 2023-03-21 15:48:45,060 - freqtrade.exchange.exchange - INFO - Done initializing 204 markets.
freqtrade_AI  | 2023-03-21 15:48:45,067 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
freqtrade_AI  | 2023-03-21 15:48:45,150 - freqtrade.wallets - INFO - Wallets synced.
freqtrade_AI  | 2023-03-21 15:48:45,156 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:48:45,409 - freqtrade.rpc.rpc_manager - INFO - Enabling rpc.api_server
freqtrade_AI  | 2023-03-21 15:48:46,100 - freqtrade.rpc.api_server.webserver - INFO - Starting HTTP Server at 0.0.0.0:8021
freqtrade_AI  | 2023-03-21 15:48:46,101 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - Local Rest Server listening to external connections
freqtrade_AI  | 2023-03-21 15:48:46,103 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - This is insecure please set to your loopback,e.g 127.0.0.1 in config.json
freqtrade_AI  | 2023-03-21 15:48:46,104 - freqtrade.rpc.api_server.webserver - INFO - Starting Local Rest Server.
freqtrade_AI  | 2023-03-21 15:48:46,116 - uvicorn.error - INFO - Started server process [1]
freqtrade_AI  | 2023-03-21 15:48:46,117 - uvicorn.error - INFO - Waiting for application startup.
freqtrade_AI  | 2023-03-21 15:48:46,119 - uvicorn.error - INFO - Application startup complete.
freqtrade_AI  | 2023-03-21 15:48:46,121 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8021 (Press CTRL+C to quit)
freqtrade_AI  | 2023-03-21 15:48:46,127 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-21 15:48:46,137 - freqtrade.plugins.pairlistmanager - INFO - Whitelist with 1 pairs: ['ETH/USDT:USDT']
freqtrade_AI  | 2023-03-21 15:48:48,009 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
freqtrade_AI  | 2023-03-21 15:48:48,014 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
freqtrade_AI  | 2023-03-21 15:48:48,022 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
freqtrade_AI  | 2023-03-21 15:48:48,024 - freqtrade.freqai.freqai_interface - INFO - Set existing queue from trained timestamps. Best approximation queue: deque(['ETH/USDT:USDT'])
freqtrade_AI  | 2023-03-21 15:48:48,049 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
freqtrade_AI  | 2023-03-21 15:48:48,051 - freqtrade.strategy.interface - INFO - Downloading all training data for all pairs in whitelist and corr_pairlist, this may take a while if the data is not already on disk.
freqtrade_AI  | 2023-03-21 15:48:48,054 - freqtrade.freqai.utils - INFO - FreqAI auto-downloader using 450 startup candles.
freqtrade_AI  | 2023-03-21 15:48:48,057 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:48:48,253 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:35:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:48,465 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:48,601 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:48:48,676 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:15:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,214 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,303 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,521 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,577 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:49,787 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:49,817 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-21 15:48:49,989 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:35:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,197 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,353 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-21 15:48:50,436 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-21T15:15:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,644 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,731 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-20T16:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:50,939 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:50,990 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-21T04:00:00 to 2023-03-21T15:48:48
freqtrade_AI  | 2023-03-21 15:48:51,527 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-21 15:48:51,555 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,557 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,559 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
freqtrade_AI  | 2023-03-21 15:48:51,561 - freqtrade.plugins.protectionmanager - INFO - No protection Handlers defined.
freqtrade_AI  | 2023-03-21 15:48:51,562 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': status, 'status': 'running'}
freqtrade_AI  | 2023-03-21 15:48:51,563 - freqtrade.worker - INFO - Changing state to: RUNNING
freqtrade_AI  | 2023-03-21 15:48:51,564 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': warning, 'status': 'Dry run is enabled. All trades are simulated.'}
freqtrade_AI  | 2023-03-21 15:48:51,566 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "*Exchange:* `bybit`\n*Stake per trade:* `unlimited USDT`\n*Minimum ROI:* `{'0': 0.1, '240': -1}`\n*Stoploss:* `-0.05`\n*Position adjustment:* `Off`\n*Timeframe:* `5m`\n*Strategy:* `freqai_rl_test_strat`"}
freqtrade_AI  | 2023-03-21 15:48:51,567 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "Searching for USDT pairs to buy and sell based on [{'StaticPairList': 'StaticPairList'}]"}
freqtrade_AI  | 2023-03-21 15:48:52,922 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:48:53,040 - freqtrade.freqai.data_kitchen - INFO - DI tossed 28 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:48:53,054 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f28bab99f30>>
freqtrade_AI  | 2023-03-21 15:48:53,056 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:48:53,106 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:48:53,938 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:53,981 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:48:54,657 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:48:54,661 - ReinforcementLearner - INFO - Continual training activated - starting training from previously trained agent.
freqtrade_AI  | 2023-03-21 15:48:54,666 - freqtrade.freqai.freqai_interface - WARNING - Training ETH/USDT:USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1.]], (1, 102), float32) != Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1.]], (1, 105), float32), skipping.
freqtrade_AI  | 2023-03-21 15:48:54,668 - freqtrade.freqai.freqai_interface - INFO - Total time spent training pairlist 0.94 seconds
freqtrade_AI  | 2023-03-21 15:48:55,913 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:55,953 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-21 15:48:56,477 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-21 15:48:56,480 - ReinforcementLearner - INFO - Continual training activated - starting training from previously trained agent.
freqtrade_AI  | 2023-03-21 15:48:56,486 - freqtrade.freqai.freqai_interface - WARNING - Training ETH/USDT:USDT raised exception ValueError. Message: Observation spaces do not match: Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1.]], (1, 102), float32) != Box([[-1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.
freqtrade_AI  |   -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1.]], [[1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1.
freqtrade_AI  |   1. 1. 1. 1. 1. 1. 1. 1. 1.]], (1, 105), float32), skipping.
freqtrade_AI  | 2023-03-21 15:48:56,488 - freqtrade.freqai.freqai_interface - INFO - Total time spent training pairlist 0.79 seconds
freqtrade_AI  | 2023-03-21 15:48:56,579 - freqtrade.worker - INFO - Bot heartbeat. PID=1, version='docker-2023.3.dev-b710bdaf', state='RUNNING'
freqtrade_AI  | 2023-03-21 15:48:56,789 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-21 15:48:56,893 - freqtrade.freqai.data_kitchen - INFO - DI tossed 28 predictions for being too far from training data.
freqtrade_AI  | 2023-03-21 15:48:56,906 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f28bab99f30>>
freqtrade_AI  | 2023-03-21 15:48:56,910 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-21 15:48:56,927 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-21 15:48:57,704 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-21 15:48:57,746 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
Gracefully stopping... (press Ctrl+C again to force)
[+] Running 1/1
- Container freqtrade_AI  Stopped                                                                                                                                                                                                                                        2.1s
canceled
PS C:\Users\tigge\Documents\VsCode\FreqAI>`

But, it work well if I train a new model from scratch in dryrun.

Hello, thank you for the information.

Can you please tell me if it works after setting "continual_learning": false in your freqai config?

Cheers,

Robert

Yep, so I tried with 'continual_learning: false' and I think I got the same result as when I didn't include it in the config file

PS C:\Users\tigge\Documents\VsCode\FreqAI> docker-compose up
[+] Running 1/1
 - Container freqtrade_AI  Recreated                                                                                                                                                                                                                                      0.2s
Attaching to freqtrade_AI
freqtrade_AI  | 2023-03-22 14:27:31,737 - freqtrade - INFO - freqtrade docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-22 14:27:31,987 - freqtrade.worker - INFO - Starting worker docker-2023.3.dev-b710bdaf
freqtrade_AI  | 2023-03-22 14:27:31,987 - freqtrade.configuration.load_config - INFO - Using config: /freqtrade/user_data/config.json ...
freqtrade_AI  | 2023-03-22 14:27:31,995 - freqtrade.loggers - INFO - Verbosity set to 0
freqtrade_AI  | 2023-03-22 14:27:31,996 - freqtrade.configuration.configuration - INFO - Runmode set to dry_run.
freqtrade_AI  | 2023-03-22 14:27:31,997 - freqtrade.configuration.configuration - INFO - Parameter --db-url detected ...
freqtrade_AI  | 2023-03-22 14:27:31,998 - freqtrade.configuration.configuration - INFO - Dry run is enabled
freqtrade_AI  | 2023-03-22 14:27:31,999 - freqtrade.configuration.configuration - INFO - Using DB: "sqlite:////freqtrade/user_data/tradesv3.sqlite"
freqtrade_AI  | 2023-03-22 14:27:32,001 - freqtrade.configuration.configuration - INFO - Using max_open_trades: 1 ...
freqtrade_AI  | 2023-03-22 14:27:41,853 - freqtrade.configuration.configuration - INFO - Using user-data directory: /freqtrade/user_data ...
freqtrade_AI  | 2023-03-22 14:27:41,856 - freqtrade.configuration.configuration - INFO - Using data directory: /freqtrade/user_data/data/bybit ...
freqtrade_AI  | 2023-03-22 14:27:41,857 - freqtrade.configuration.configuration - INFO - Using freqaimodel class name: ReinforcementLearner
freqtrade_AI  | 2023-03-22 14:27:41,860 - freqtrade.exchange.check_exchange - INFO - Checking exchange...
freqtrade_AI  | 2023-03-22 14:27:41,892 - freqtrade.exchange.check_exchange - WARNING - Exchange "bybit" is known to the the ccxt library, available for the bot, but not officially supported by the Freqtrade development team. It may work flawlessly (please report back) or have serious issues. Use it at your own discretion.
freqtrade_AI  | 2023-03-22 14:27:41,895 - freqtrade.configuration.configuration - INFO - Using pairlist from configuration.
freqtrade_AI  | 2023-03-22 14:27:42,096 - freqtrade.resolvers.iresolver - INFO - Using resolved strategy freqai_rl_test_strat from '/freqtrade/user_data/strategies/test_freqai_rl_strat.py'...
freqtrade_AI  | 2023-03-22 14:27:42,098 - freqtrade.strategy.hyper - INFO - Found no parameter file.
freqtrade_AI  | 2023-03-22 14:27:42,100 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'order_types' with value in config file: {'entry': 'market', 'exit': 'market', 'emergency_exit': 'market', 'force_entry': 'market', 'force_exit': 'market', 'stoploss': 'market', 'stoploss_on_exchange': True, 'stoploss_on_exchange_interval': 60}.
freqtrade_AI  | 2023-03-22 14:27:42,101 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_currency' with value in config file: USDT.
freqtrade_AI  | 2023-03-22 14:27:42,102 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'stake_amount' with value in config file: unlimited.
freqtrade_AI  | 2023-03-22 14:27:42,103 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'unfilledtimeout' with value in config file: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}.
freqtrade_AI  | 2023-03-22 14:27:42,104 - freqtrade.resolvers.strategy_resolver - INFO - Override strategy 'max_open_trades' with value in config file: 1.
freqtrade_AI  | 2023-03-22 14:27:42,105 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using minimal_roi: {'0': 0.1, '240': -1}
freqtrade_AI  | 2023-03-22 14:27:42,106 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using timeframe: 5m
freqtrade_AI  | 2023-03-22 14:27:42,106 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stoploss: -0.05
freqtrade_AI  | 2023-03-22 14:27:42,107 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop: False
freqtrade_AI  | 2023-03-22 14:27:42,108 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_stop_positive_offset: 0.0
freqtrade_AI  | 2023-03-22 14:27:42,110 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using trailing_only_offset_is_reached: False
freqtrade_AI  | 2023-03-22 14:27:42,111 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_custom_stoploss: False
freqtrade_AI  | 2023-03-22 14:27:42,113 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using process_only_new_candles: True
freqtrade_AI  | 2023-03-22 14:27:42,114 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_types: {'entry': 'market', 'exit': 'market', 'emergency_exit': 'market', 'force_entry': 'market', 'force_exit': 'market', 'stoploss': 'market', 'stoploss_on_exchange': True, 'stoploss_on_exchange_interval': 60}
freqtrade_AI  | 2023-03-22 14:27:42,115 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using order_time_in_force: {'entry': 'GTC', 'exit': 'GTC'}
freqtrade_AI  | 2023-03-22 14:27:42,116 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_currency: USDT
freqtrade_AI  | 2023-03-22 14:27:42,117 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using stake_amount: unlimited
freqtrade_AI  | 2023-03-22 14:27:42,118 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using protections: []
freqtrade_AI  | 2023-03-22 14:27:42,119 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using startup_candle_count: 300
freqtrade_AI  | 2023-03-22 14:27:42,119 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using unfilledtimeout: {'entry': 30, 'exit': 30, 'exit_timeout_count': 1, 'unit': 'seconds'}
freqtrade_AI  | 2023-03-22 14:27:42,120 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using use_exit_signal: True
freqtrade_AI  | 2023-03-22 14:27:42,121 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_only: False
freqtrade_AI  | 2023-03-22 14:27:42,122 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_roi_if_entry_signal: False
freqtrade_AI  | 2023-03-22 14:27:42,123 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using exit_profit_offset: 0.0
freqtrade_AI  | 2023-03-22 14:27:42,124 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using disable_dataframe_checks: False
freqtrade_AI  | 2023-03-22 14:27:42,125 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using ignore_buying_expired_candle_after: 0
freqtrade_AI  | 2023-03-22 14:27:42,126 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using position_adjustment_enable: False
freqtrade_AI  | 2023-03-22 14:27:42,128 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_entry_position_adjustment: -1
freqtrade_AI  | 2023-03-22 14:27:42,129 - freqtrade.resolvers.strategy_resolver - INFO - Strategy using max_open_trades: 1
freqtrade_AI  | 2023-03-22 14:27:42,131 - freqtrade.configuration.config_validation - INFO - Validating configuration ...
freqtrade_AI  | 2023-03-22 14:27:42,139 - freqtrade.exchange.exchange - INFO - Instance is running with dry_run enabled
freqtrade_AI  | 2023-03-22 14:27:42,140 - freqtrade.exchange.exchange - INFO - Using CCXT 2.9.4
freqtrade_AI  | 2023-03-22 14:27:42,142 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-22 14:27:42,163 - freqtrade.exchange.exchange - INFO - Applying additional ccxt config: {'options': {'defaultType': 'swap'}}
freqtrade_AI  | 2023-03-22 14:27:42,186 - freqtrade.exchange.exchange - INFO - Using Exchange "Bybit"
freqtrade_AI  | 2023-03-22 14:27:43,571 - freqtrade.exchange.exchange - WARNING - Using 2 calls to get OHLCV. This can result in slower operations for the bot. Please check if you really need 300 candles for your strategy
freqtrade_AI  | 2023-03-22 14:27:43,613 - freqtrade.exchange.exchange - INFO - Using cached leverage_tiers.
freqtrade_AI  | 2023-03-22 14:27:43,615 - freqtrade.exchange.exchange - INFO - Done initializing 205 markets.
freqtrade_AI  | 2023-03-22 14:27:43,621 - freqtrade.resolvers.exchange_resolver - INFO - Using resolved exchange 'Bybit'...
freqtrade_AI  | 2023-03-22 14:27:43,812 - freqtrade.wallets - INFO - Wallets synced.
freqtrade_AI  | 2023-03-22 14:27:43,818 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-22 14:27:44,092 - freqtrade.rpc.rpc_manager - INFO - Enabling rpc.api_server
freqtrade_AI  | 2023-03-22 14:27:44,952 - freqtrade.rpc.api_server.webserver - INFO - Starting HTTP Server at 0.0.0.0:8021
freqtrade_AI  | 2023-03-22 14:27:44,954 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - Local Rest Server listening to external connections
freqtrade_AI  | 2023-03-22 14:27:44,955 - freqtrade.rpc.api_server.webserver - WARNING - SECURITY WARNING - This is insecure please set to your loopback,e.g 127.0.0.1 in config.json
freqtrade_AI  | 2023-03-22 14:27:44,957 - freqtrade.rpc.api_server.webserver - INFO - Starting Local Rest Server.
freqtrade_AI  | 2023-03-22 14:27:44,969 - uvicorn.error - INFO - Started server process [1]
freqtrade_AI  | 2023-03-22 14:27:44,971 - uvicorn.error - INFO - Waiting for application startup.
freqtrade_AI  | 2023-03-22 14:27:44,972 - uvicorn.error - INFO - Application startup complete.
freqtrade_AI  | 2023-03-22 14:27:44,973 - uvicorn.error - INFO - Uvicorn running on http://0.0.0.0:8021 (Press CTRL+C to quit)
freqtrade_AI  | 2023-03-22 14:27:44,979 - freqtrade.resolvers.iresolver - INFO - Using resolved pairlist StaticPairList from '/freqtrade/freqtrade/plugins/pairlist/StaticPairList.py'...
freqtrade_AI  | 2023-03-22 14:27:44,986 - freqtrade.plugins.pairlistmanager - INFO - Whitelist with 1 pairs: ['ETH/USDT:USDT']
freqtrade_AI  | 2023-03-22 14:27:46,838 - matplotlib.font_manager - INFO - generated new fontManager
freqtrade_AI  | 2023-03-22 14:27:47,215 - freqtrade.resolvers.iresolver - INFO - Using resolved freqaimodel ReinforcementLearner from '/freqtrade/freqtrade/freqai/prediction_models/ReinforcementLearner.py'...
freqtrade_AI  | 2023-03-22 14:27:47,220 - freqtrade.freqai.freqai_interface - INFO - Backtesting module configured to save all models.
freqtrade_AI  | 2023-03-22 14:27:47,228 - freqtrade.freqai.data_drawer - INFO - Could not find existing historic_predictions, starting from scratch
freqtrade_AI  | 2023-03-22 14:27:47,229 - freqtrade.freqai.freqai_interface - INFO - Set existing queue from trained timestamps. Best approximation queue: deque(['ETH/USDT:USDT'])
freqtrade_AI  | 2023-03-22 14:27:47,247 - freqtrade.freqai.RL.BaseReinforcementLearningModel - WARNING - User tried to use SVM with RL. Deactivating SVM.
freqtrade_AI  | 2023-03-22 14:27:47,249 - freqtrade.strategy.interface - INFO - Downloading all training data for all pairs in whitelist and corr_pairlist, this may take a while if the data is not already on disk.
freqtrade_AI  | 2023-03-22 14:27:47,251 - freqtrade.freqai.utils - INFO - FreqAI auto-downloader using 450 startup candles.
freqtrade_AI  | 2023-03-22 14:27:47,255 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-22 14:27:47,451 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-22T13:35:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:47,665 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 11.
freqtrade_AI  | 2023-03-22 14:27:47,793 - freqtrade.data.history.history_utils - INFO - Downloading pair ETH/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-22 14:27:47,866 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-22T13:15:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:48,076 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-22 14:27:48,217 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-21T16:00:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:48,427 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-22 14:27:48,497 - freqtrade.data.history.history_utils - INFO - (1/2) - Download history data for "ETH/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-22T04:00:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:48,736 - freqtrade.exchange.exchange - INFO - Downloaded data for ETH/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-22 14:27:48,768 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 5m.
freqtrade_AI  | 2023-03-22 14:27:48,956 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 5m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-22T13:35:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:49,190 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 11.
freqtrade_AI  | 2023-03-22 14:27:49,323 - freqtrade.data.history.history_utils - INFO - Downloading pair BTC/USDT:USDT, interval 15m.
freqtrade_AI  | 2023-03-22 14:27:49,397 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 15m, futures and store in /freqtrade/user_data/data/bybit. From 2023-03-22T13:15:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:49,932 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 5.
freqtrade_AI  | 2023-03-22 14:27:50,018 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, funding_rate and store in /freqtrade/user_data/data/bybit. From 2023-03-21T16:00:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:50,561 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-22 14:27:50,615 - freqtrade.data.history.history_utils - INFO - (2/2) - Download history data for "BTC/USDT:USDT", 4h, mark and store in /freqtrade/user_data/data/bybit. From 2023-03-22T04:00:00 to 2023-03-22T14:27:47
freqtrade_AI  | 2023-03-22 14:27:51,152 - freqtrade.exchange.exchange - INFO - Downloaded data for BTC/USDT:USDT with length 3.
freqtrade_AI  | 2023-03-22 14:27:51,180 - freqtrade.strategy.hyper - INFO - No params for buy found, using default values.
freqtrade_AI  | 2023-03-22 14:27:51,182 - freqtrade.strategy.hyper - INFO - No params for sell found, using default values.
freqtrade_AI  | 2023-03-22 14:27:51,185 - freqtrade.strategy.hyper - INFO - No params for protection found, using default values.
freqtrade_AI  | 2023-03-22 14:27:51,186 - freqtrade.plugins.protectionmanager - INFO - No protection Handlers defined.
freqtrade_AI  | 2023-03-22 14:27:51,188 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': status, 'status': 'running'}
freqtrade_AI  | 2023-03-22 14:27:51,189 - freqtrade.worker - INFO - Changing state to: RUNNING
freqtrade_AI  | 2023-03-22 14:27:51,191 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': warning, 'status': 'Dry run is enabled. All trades are simulated.'}
freqtrade_AI  | 2023-03-22 14:27:51,192 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "*Exchange:* `bybit`\n*Stake per trade:* `unlimited USDT`\n*Minimum ROI:* `{'0': 0.1, '240': -1}`\n*Stoploss:* `-0.05`\n*Position adjustment:* `Off`\n*Timeframe:* `5m`\n*Strategy:* `freqai_rl_test_strat`"}
freqtrade_AI  | 2023-03-22 14:27:51,194 - freqtrade.rpc.rpc_manager - INFO - Sending rpc message: {'type': startup, 'status': "Searching for USDT pairs to buy and sell based on [{'StaticPairList': 'StaticPairList'}]"}
freqtrade_AI  | 2023-03-22 14:27:52,403 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-22 14:27:52,483 - freqtrade.freqai.data_kitchen - INFO - DI tossed 25 predictions for being too far from training data.
freqtrade_AI  | 2023-03-22 14:27:52,493 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f7147631f00>>
freqtrade_AI  | 2023-03-22 14:27:52,497 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-22 14:27:52,537 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-22 14:27:53,437 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - --------------------Starting training ETH/USDT:USDT --------------------
freqtrade_AI  | 2023-03-22 14:27:53,481 - freqtrade.freqai.data_kitchen - INFO - dropped 0 training points due to NaNs in populated dataset 4319.
freqtrade_AI  | 2023-03-22 14:27:54,053 - freqtrade.freqai.RL.BaseReinforcementLearningModel - INFO - Training model on 102 features and 3239 data points
freqtrade_AI  | 2023-03-22 14:27:56,204 - freqtrade.worker - INFO - Bot heartbeat. PID=1, version='docker-2023.3.dev-b710bdaf', state='RUNNING'
freqtrade_AI  | 2023-03-22 14:27:56,505 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-22 14:27:56,704 - freqtrade.freqai.data_kitchen - INFO - DI tossed 25 predictions for being too far from training data.
freqtrade_AI  | 2023-03-22 14:27:56,718 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f7147631f00>>
freqtrade_AI  | 2023-03-22 14:27:56,720 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-22 14:27:56,742 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-22 14:28:01,367 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-22 14:28:01,497 - freqtrade.freqai.data_kitchen - INFO - DI tossed 25 predictions for being too far from training data.
freqtrade_AI  | 2023-03-22 14:28:01,507 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f7147631f00>>
freqtrade_AI  | 2023-03-22 14:28:01,510 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
freqtrade_AI  | 2023-03-22 14:28:01,531 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
freqtrade_AI  | 2023-03-22 14:28:06,365 - freqtrade.freqai.data_kitchen - INFO - dropped 15 of 399 prediction data points due to NaNs.
freqtrade_AI  | 2023-03-22 14:28:06,522 - freqtrade.freqai.data_kitchen - INFO - DI tossed 25 predictions for being too far from training data.
freqtrade_AI  | 2023-03-22 14:28:06,534 - freqtrade.strategy.strategy_wrapper - WARNING - Strategy caused the following exception: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.<bound method IStrategy._analyze_ticker_internal of <test_freqai_rl_strat.freqai_rl_test_strat object at 0x7f7147631f00>>
freqtrade_AI  | 2023-03-22 14:28:06,536 - freqtrade.strategy.interface - WARNING - Unable to analyze candle (OHLCV) data for pair ETH/USDT:USDT: Error: Unexpected observation shape (1, 105) for Box environment, please use (1, 102) or (n_env, 1, 102) for the observation shape.
[+] Running 1/1 2023-03-22 14:28:06,553 - freqtrade.strategy.interface - WARNING - Empty candle (OHLCV) data for pair ETH/USDT:USDT
 - Container freqtrade_AI  Stopped                                                                                                                                                                                                                                       10.6s
canceleding 0/1

this is my frequi config :


    "freqai": {
        "enabled": true,
        "purge_old_models": true,
        "train_period_days": 15,
        "identifier": "ETH87",
        "continual_learning": false,
        "feature_parameters": {
            "include_timeframes": [
                "15m"
            ],
            "include_corr_pairlist": [
                "BTC/USDT:USDT"
            ],
            "label_period_candles": 10,
            "include_shifted_candles": 5,
            "DI_threshold": 0.9,
            "weight_factor": 0.9,
            "principal_component_analysis": false,
            "use_SVM_to_remove_outliers": true,
            "indicator_periods_candles": [
                5,
                10
            ]
        },
        "data_split_parameters": {
            "test_size": 0.25,
            "random_state": 1
        },
        "model_training_parameters": {
        },
        "rl_config": {
            "train_cycles": 10,
            "add_state_info": true,
            "max_trade_duration_candles": 10,
            "max_training_drawdown_pct": 0.1,
            "cpu_count": 8,
            "model_type": "PPO",
            "policy_type": "MlpPolicy",
            "model_reward_parameters": {
                "rr": 0.8,
                "profit_aim": 0.0025
            }
        }
    }

Thanks :)

Silur commented 1 year ago

issue still present in 2023.7 even with continual_learning: false

robcaulk commented 1 year ago

Hello, this is likely due to the fact that you are trying to add_state_info to a backtest trained model. add_state_info is not available in backtesting, so please deactivate that in dry/live if you would like to use the backtest trained model in dry/live.

Otherwise, start fresh with dry/live and add_state_info: true if you want to use state info in your model.

Please see the related issue: https://github.com/freqtrade/freqtrade/issues/8763

freqtrade / freqtrade