DLR-RM / rl-baselines3-zoo

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.
https://rl-baselines3-zoo.readthedocs.io
MIT License
1.98k stars 507 forks source link

"MySQLdb._exceptions.OperationalError: (1054, "Unknown column 'infe0' in 'field list'") #146

Closed jkterry1 closed 3 years ago

jkterry1 commented 3 years ago

I've recently been using RL Baselines Zoo and I'm getting an error message that I'm not able to comprehend, and is almost certainly a bug. I've attached the giant traceback as a txt file to this. I'd be willing to fix it if I actually understood what was happening because this is holding up moderately important work. After some Googling, the issue appears to be somehow related to the inf showing up in the logs: https://github.com/pandas-dev/pandas/issues/34431

magical_error.txt

jkterry1 commented 3 years ago

It looks like something somewhere is trying to store an inf in the parameter database for reasons unknown to me and that's causing the giant error

jkterry1 commented 3 years ago

Ya, here's the problem (no idea the cause or fix):

[SQL: INSERT INTO trial_values (trial_id, objective, value) VALUES (%s, %s, %s)] [parameters: (34, 0, -inf)]

jkterry1 commented 3 years ago

So I found a bad merge of my personal fork that I use and master and fixing that fixed this (though I have no idea how). There's an upstream issue with Optuna's error handling here that I'm going to file though.