I ran into this error when resuming the pre-training on the pre-trained weights:
"ImportError: cannot import name '_FaultTolerantMode' from 'pytorch_lightning.utilities.enums' "
Has anyone seen this issue before?
Thanks!
I modified the config file by adding the pretrained model path:
train:
gpu_mem: ${eval:"round(float(import('subprocess').check_output('nvidia-smi -i 0 --query-gpu=memory.total --format=csv,noheader,nounits', shell=True).strip().decode()) / 1000)"}
seed: 2222
global_batch_size: 256 # effects the scheduler, need to set properly
pretrained_model_path: 'data/project/hg38/weights.ckpt'
I ran into this error when resuming the pre-training on the pre-trained weights: "ImportError: cannot import name '_FaultTolerantMode' from 'pytorch_lightning.utilities.enums' " Has anyone seen this issue before? Thanks!
I modified the config file by adding the pretrained model path: train: gpu_mem: ${eval:"round(float(import('subprocess').check_output('nvidia-smi -i 0 --query-gpu=memory.total --format=csv,noheader,nounits', shell=True).strip().decode()) / 1000)"} seed: 2222 global_batch_size: 256 # effects the scheduler, need to set properly pretrained_model_path: 'data/project/hg38/weights.ckpt'