Open BUPT-BownZ opened 1 week ago
When I try to crop the image patches, I encountered a "time-out" error. Therefore, I changed the code in the following way.
executor.update_parameters(slurm_partition="prod", name="data_prep", slurm_time='24:00:00', mem_gb=8, slurm_array_parallelism=1)
and
kwargs = {'num_workers': 1, 'pin_memory': True} if device.type == "cuda" else {}
However, every time I run convert_h5_to_jpg.py, the server still runs out of memory, causing a direct disconnection from the server and the program to terminate. Could you please advise me on how to modify the code to resolve this issue? Thank you!
I use the dataset is c16.
BUPT-BownZ
commented
1 week ago
When I try to crop the image patches, I encountered a "time-out" error. Therefore, I changed the code in the following way.
and
However, every time I run convert_h5_to_jpg.py, the server still runs out of memory, causing a direct disconnection from the server and the program to terminate. Could you please advise me on how to modify the code to resolve this issue? Thank you!