Closed keesvanbemmel closed 3 years ago
xmatthias
commented
3 years ago Best reduce either your timerange, the amount of pairs, or use a longer timeframe.
I don't think you'll be able to use hyperopt on 1m data for +1 year on this many pairs. Hyperopt would eventually start if you give it long enough - HOWEVER, it'll run out of memory almost certainly - simply because you're using too much data.
keesvanbemmel
commented
3 years ago Well, the thing is, hyperopia doesn't start. After that last line the container stops.
On Sat, 27 Feb 2021, 17:45 Matthias, notifications@github.com wrote:
Best reduce either your timerange, the amount of pairs, or use a longer timeframe.
I don't think you'll be able to use hyperopt on 1m data for +1 year on this many pairs. Hyperopt would eventually start if you give it long enough - HOWEVER, it'll run out of memory almost certainly - simply because you're using too much data.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/freqtrade/freqtrade/issues/4455#issuecomment-787100515, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABDLKFATBQ3UT52BOQBD4QTTBEOSNANCNFSM4YJZSBTQ .
xmatthias
commented
3 years ago that's the point, it doesn't stop - it's busy shuffling data around, and you think it's not doing anything and stop it. Be patient enough (with the amount of data, startup alone can take multiple minutes, or even hours if you've got a swap-file configured ...).
Just try it with a small amount of data (reduce timerange for example) and you'll see that it'll start up just fine.
keesvanbemmel
commented
3 years ago Why does the container quit then? I don't mind waiting but it won't let me.
Apart from that I'll try a smaller dataset and pairlist, but still weird the container quits without telling me anything. Waiting doesn't help as the container is already gone.
On Sat, 27 Feb 2021, 17:51 Matthias, notifications@github.com wrote:
that's the point, it doesn't stop - it's busy shuffling data around. Be patient enough (with the amount of data, startup alone can take multiple minutes).
Just try it with a small amount of data (reduce timerange for example) and you'll see that it'll start up just fine.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/freqtrade/freqtrade/issues/4455#issuecomment-787101411, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABDLKFENWNAKQI6EBO55PMLTBEPKZANCNFSM4YJZSBTQ .
xmatthias
commented
3 years ago it'll be an out of memory error.
different systems behave differently with it - and since it's a (kindof) system-wide error, behaviour will differ. It can also be docker that's killing it silently (it's more likely it's the system itself that's killing the "offending" process) - so best check your system log.
keesvanbemmel
commented
3 years ago Still think it's an out of memory error even if it stops not even a minute after that last line?
On Sat, 27 Feb 2021, 19:38 Matthias, notifications@github.com wrote:
it'll be an out of memory error.
different systems behave differently with it - and since it's a (kindof) system-wide error, behaviour will differ. It can also be docker that's killing it silently (it's more likely it's the system itself that's killing the "offending" process) - so best check your system log.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/freqtrade/freqtrade/issues/4455#issuecomment-787116847, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABDLKFFM27OBZ7VMFKPMVNDTBE32TANCNFSM4YJZSBTQ .
xmatthias
commented
3 years ago considering the amount of pairs and data - for sure.
you've got 50 or 100 pairs - and each pair is ~500k lines ...
keesvanbemmel
commented
3 years ago Ok! Thanks for the clarification!
On Sat, 27 Feb 2021, 19:43 Matthias, notifications@github.com wrote:
considering the amount of pairs and data - for sure.
you've got 50 or 100 pairs - and each pair is ~500k lines ...
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/freqtrade/freqtrade/issues/4455#issuecomment-787117479, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABDLKFFRMW7QTHJUAPDDGN3TBE4OJANCNFSM4YJZSBTQ .
Describe your environment
Your question
I don't know what I'm doing wrong, before I was able to run hyperopt just fine with this command:
docker-compose run --rm freqtrade hyperopt --hyperopt BinHV45HyperOpt --strategy BinHV45 -e 500 --spaces all --hyperopt-loss OnlyProfitHyperOptLossGave me results and worked flawlessly. I updated my static pairlist now in config.json to just include ".*/BTC". Downloaded new data and now the exact same command does nothing. It shows no errors, even the verbose debug lines show nothing wrong. Here's my full output.