Closed jm-glowienke closed 3 years ago
This is something about exceeding the memory of the cpu. Didn't came up on the Aachen cluster up to now.
This can be easily fixed by reducing the batch-size when training the fairseq model. By this, we can ensure that the cpu is not overloaded.
/Users/jan_marcglowienke/anaconda3/envs/nqm_fairseq/lib/python3.8/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown\