danijar / dreamerv3

Mastering Diverse Domains through World Models
https://danijar.com/dreamerv3
MIT License
1.35k stars 229 forks source link

Broken pipe error with WandB #71

Open Ashminator opened 1 year ago

Ashminator commented 1 year ago

Hey Danijar, I hope is well with you! I've been trying to run the DreamerV3 code with WandB - it works for a few hours (sometimes for up to 4 hrs with higher RAM) in Colab. Then I get the following error, seems like it's coming from WandB:

BrokenPipeError: [Errno 32] Broken pipe wandb: While tearing down the service manager. The following error has occurred: [Errno 32] Broken pipe

I can ofc run DreamerV3 without logging to WandB, but I was wondering if you or anyone else had a fix for this problem - I'm currently doing a run with a downgraded version of WandB (from December, when I was able to run the code for 24 hrs as a Colab Pro+ subscriber).

Thanks a lot for your help! Btw I think the project is amazing, so congrats.

danijar commented 6 months ago

Hmm interesting, I don't use WandB often so I'm not able to debug this myself.