3xxx Killed Error

[yusuf-wadi]

Video 13 frame 12
Full res images loaded: 167.72947998046874

scripts/run_one_immersive.sh: line 19:  3547 Killed  
CUDA_VISIBLE_DEVICES=$1 python main.py experiment/dataset=immersive experiment/training=immersive_tensorf experiment.training.val_every=5 experiment.training.test_every=10 experiment.training.ckpt_every=10 experiment.training.render_every=30 experiment.training.num_epochs=30 experiment/model=immersive_sphere experiment.params.print_loss=True experiment.dataset.collection=$2 +experiment/regularizers/tensorf=tv_4000 experiment.dataset.start_frame=$3 experiment.params.name=immersive_$2_start_$3

Im getting this error that occurs at every run on video 13 at around the same frame. Im running the script in WSL2 with CUDA access. My command to start the script was:

bash scripts/run_one_immersive.sh 0 02_Flames `0`

I would greatly appreciate any help in understanding what went wrong. Thank you!

[benattal]

Hi! My guess is that you're running out of RAM. Please see https://github.com/facebookresearch/hyperreel/issues/3 for some possible fixes / workarounds.

[yusuf-wadi]

thank you so much!