when I try python3 run.py --ginc configs/nerf/blender.gin --scene chair
after training,this happened,can you help me?
logs:
`Global seed set to 220901
GPU available: True (cuda), used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
HPU available: False, using: 0 HPUs
[rank: 0] Global seed set to 220901
Initializing distributed: GLOBAL_RANK: 0, MEMBER: 1/2
[rank: 1] Global seed set to 220901
[rank: 1] Global seed set to 220901
Initializing distributed: GLOBAL_RANK: 1, MEMBER: 2/2
distributed_backend=nccl
All distributed processes registered. Starting with 2 processes
You are using a CUDA device ('NVIDIA GeForce RTX 3090') that has Tensor Cores. To properly utilize them, you should set torch.set_float32_matmul_precision('medium' | 'high') which will trade-off precision for performance. For more details, read https://pytorch.org/docs/stable/generated/torch.set_float32_matmul_precision.html#torch.set_float32_matmul_precision
/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/callbacks/model_checkpoint.py:613: UserWarning: Checkpoint directory /home/disk1/lcy/pycharm/nerf-factory/logs/nerf_blender_chair_220901 exists and is not empty.
rank_zero_warn(f"Checkpoint directory {dirpath} exists and is not empty.")
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1]
LOCAL_RANK: 1 - CUDA_VISIBLE_DEVICES: [0,1]
| Name | Type | Params
0 | model | NeRF | 1.2 M
1.2 M Trainable params
0 Non-trainable params
1.2 M Total params
4.767 Total estimated model params size (MB)
/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py:1609: PossibleUserWarning: The number of training batches (50) is smaller than the logging interval Trainer(log_every_n_steps=100). Set a lower value for log_every_n_steps if you want to see logs for the training epoch.
rank_zero_warn(
Epoch 0: 0%| | 0/3957 [00:00<?, ?it/s]/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py:362: LightningDeprecationWarning: The NVIDIA/apex AMP implementation has been deprecated upstream. Consequently, its integration inside PyTorch Lightning has been deprecated in v1.9.0 and will be removed in v2.0.0. The LitNeRF.optimizer_step() hook is overridden, including the using_native_amp argument. Removing this argument will avoid this message, you can expect it to return True.
rank_zero_deprecation(
Epoch 0: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3957/3957 [20:52<00:00, 3.16it/s, loss=0.208, v_num=0, train/psnr1=9.500, train/psnr0=9.490]Downloading: "https://github.com/richzhang/PerceptualSimilarity/raw/master/lpips/weights/v0.1/vgg.pth" to /home/lcy/.cache/torch/hub/checkpoints/vgg.pth█████████████████████████████████████████████████████| 3907/3907 [20:45<00:00, 3.14it/s]
Downloading: "https://github.com/richzhang/PerceptualSimilarity/raw/master/lpips/weights/v0.1/vgg.pth" to /home/lcy/.cache/torch/hub/checkpoints/vgg.pth
Traceback (most recent call last):
File "run.py", line 229, in
run(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1605, in gin_wrapper
utils.augment_exception_message_and_reraise(e, err_str)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/utils.py", line 41, in augment_exception_message_and_reraise
raise proxy.with_traceback(exception.traceback) from None
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1582, in gin_wrapper
return fn(*new_args, new_kwargs)
File "run.py", line 173, in run
trainer.fit(model, data_module, ckpt_path=ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 608, in fit
call._call_and_handle_interrupt(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/call.py", line 36, in _call_and_handle_interrupt
return trainer.strategy.launcher.launch(trainer_fn, *args, trainer=trainer, *kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/strategies/launchers/subprocess_script.py", line 88, in launch
return function(args, kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 650, in _fit_impl
self._run(model, ckpt_path=self.ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1112, in _run
results = self._run_stage()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1191, in _run_stage
self._run_train()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1214, in _run_train
self.fit_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 199, in run
self.advance(*args, kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/fit_loop.py", line 267, in advance
self._outputs = self.epoch_loop.run(self._data_fetcher)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
self.on_advance_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 250, in on_advance_end
self._run_validation()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 308, in _run_validation
self.val_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 206, in run
output = self.on_run_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 180, in on_run_end
self._evaluation_epoch_end(self._outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 288, in _evaluation_epoch_end
self.trainer._call_lightning_module_hook(hook_name, output_or_outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1356, in _call_lightning_module_hook
output = fn(*args, *kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/nerf/model.py", line 297, in validation_epoch_end
lpips_mean = self.lpips_each(rgbs, targets).mean()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(args, kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/interface.py", line 62, in lpips_each
lpips_model = LPIPS(network="vgg").to(device=self.device)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 131, in init
self.weights = nn.ParameterList(get_weights(network=network))
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 38, in get_weights
weights = torch.hub.load_state_dict_from_url(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 727, in load_state_dict_from_url
download_url_to_file(url, cached_file, hash_prefix, progress=progress)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 593, in download_url_to_file
u = urlopen(req)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 525, in open
response = self._open(req, data)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 542, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(args)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1397, in https_open
return self.do_open(http.client.HTTPSConnection, req,
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1357, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1131)>
In call to configurable 'run' (<function run at 0x7faccce38430>)
Traceback (most recent call last):
File "/home/disk1/lcy/pycharm/nerf-factory/run.py", line 229, in
run(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1605, in gin_wrapper
utils.augment_exception_message_and_reraise(e, err_str)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/utils.py", line 41, in augment_exception_message_and_reraise
raise proxy.with_traceback(exception.traceback) from None
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1582, in gin_wrapper
return fn(new_args, new_kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/run.py", line 173, in run
trainer.fit(model, data_module, ckpt_path=ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 608, in fit
call._call_and_handle_interrupt(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/call.py", line 38, in _call_and_handle_interrupt
return trainer_fn(*args, *kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 650, in _fit_impl
self._run(model, ckpt_path=self.ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1112, in _run
results = self._run_stage()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1191, in _run_stage
self._run_train()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1214, in _run_train
self.fit_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 199, in run
self.advance(args, kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/fit_loop.py", line 267, in advance
self._outputs = self.epoch_loop.run(self._data_fetcher)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
self.on_advance_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 250, in on_advance_end
self._run_validation()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 308, in _run_validation
self.val_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 206, in run
output = self.on_run_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 180, in on_run_end
self._evaluation_epoch_end(self._outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 288, in _evaluation_epoch_end
self.trainer._call_lightning_module_hook(hook_name, output_or_outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1356, in _call_lightning_module_hook
output = fn(*args, *kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/nerf/model.py", line 297, in validation_epoch_end
lpips_mean = self.lpips_each(rgbs, targets).mean()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(args, *kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/interface.py", line 62, in lpips_each
lpips_model = LPIPS(network="vgg").to(device=self.device)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 131, in init
self.weights = nn.ParameterList(get_weights(network=network))
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 38, in get_weights
weights = torch.hub.load_state_dict_from_url(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 727, in load_state_dict_from_url
download_url_to_file(url, cached_file, hash_prefix, progress=progress)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 593, in download_url_to_file
u = urlopen(req)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 525, in open
response = self._open(req, data)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 542, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(args)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1397, in https_open
return self.do_open(http.client.HTTPSConnection, req,
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1357, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1131)>
In call to configurable 'run' (<function run at 0x7fce11f52550>)
Epoch 0: 100%|██████████| 3957/3957 [22:18<00:00, 2.96it/s, loss=0.208, v_num=0, train/psnr1=9.500, train/psnr0=9.490] `
when I try
python3 run.py --ginc configs/nerf/blender.gin --scene chair
after training,this happened,can you help me?logs: `Global seed set to 220901 GPU available: True (cuda), used: True TPU available: False, using: 0 TPU cores IPU available: False, using: 0 IPUs HPU available: False, using: 0 HPUs [rank: 0] Global seed set to 220901 Initializing distributed: GLOBAL_RANK: 0, MEMBER: 1/2 [rank: 1] Global seed set to 220901 [rank: 1] Global seed set to 220901 Initializing distributed: GLOBAL_RANK: 1, MEMBER: 2/2
distributed_backend=nccl All distributed processes registered. Starting with 2 processes
You are using a CUDA device ('NVIDIA GeForce RTX 3090') that has Tensor Cores. To properly utilize them, you should set
torch.set_float32_matmul_precision('medium' | 'high')
which will trade-off precision for performance. For more details, read https://pytorch.org/docs/stable/generated/torch.set_float32_matmul_precision.html#torch.set_float32_matmul_precision /home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/callbacks/model_checkpoint.py:613: UserWarning: Checkpoint directory /home/disk1/lcy/pycharm/nerf-factory/logs/nerf_blender_chair_220901 exists and is not empty. rank_zero_warn(f"Checkpoint directory {dirpath} exists and is not empty.") LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1] LOCAL_RANK: 1 - CUDA_VISIBLE_DEVICES: [0,1]| Name | Type | Params
0 | model | NeRF | 1.2 M
1.2 M Trainable params 0 Non-trainable params 1.2 M Total params 4.767 Total estimated model params size (MB) /home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py:1609: PossibleUserWarning: The number of training batches (50) is smaller than the logging interval Trainer(log_every_n_steps=100). Set a lower value for log_every_n_steps if you want to see logs for the training epoch. rank_zero_warn( Epoch 0: 0%| | 0/3957 [00:00<?, ?it/s]/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py:362: LightningDeprecationWarning: The NVIDIA/apex AMP implementation has been deprecated upstream. Consequently, its integration inside PyTorch Lightning has been deprecated in v1.9.0 and will be removed in v2.0.0. The
run(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1605, in gin_wrapper
utils.augment_exception_message_and_reraise(e, err_str)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/utils.py", line 41, in augment_exception_message_and_reraise
raise proxy.with_traceback(exception.traceback) from None
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1582, in gin_wrapper
return fn(*new_args, new_kwargs)
File "run.py", line 173, in run
trainer.fit(model, data_module, ckpt_path=ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 608, in fit
call._call_and_handle_interrupt(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/call.py", line 36, in _call_and_handle_interrupt
return trainer.strategy.launcher.launch(trainer_fn, *args, trainer=trainer, *kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/strategies/launchers/subprocess_script.py", line 88, in launch
return function(args, kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 650, in _fit_impl
self._run(model, ckpt_path=self.ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1112, in _run
results = self._run_stage()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1191, in _run_stage
self._run_train()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1214, in _run_train
self.fit_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 199, in run
self.advance(*args, kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/fit_loop.py", line 267, in advance
self._outputs = self.epoch_loop.run(self._data_fetcher)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
self.on_advance_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 250, in on_advance_end
self._run_validation()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 308, in _run_validation
self.val_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 206, in run
output = self.on_run_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 180, in on_run_end
self._evaluation_epoch_end(self._outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 288, in _evaluation_epoch_end
self.trainer._call_lightning_module_hook(hook_name, output_or_outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1356, in _call_lightning_module_hook
output = fn(*args, *kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/nerf/model.py", line 297, in validation_epoch_end
lpips_mean = self.lpips_each(rgbs, targets).mean()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(args, kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/interface.py", line 62, in lpips_each
lpips_model = LPIPS(network="vgg").to(device=self.device)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 131, in init
self.weights = nn.ParameterList(get_weights(network=network))
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 38, in get_weights
weights = torch.hub.load_state_dict_from_url(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 727, in load_state_dict_from_url
download_url_to_file(url, cached_file, hash_prefix, progress=progress)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 593, in download_url_to_file
u = urlopen(req)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 525, in open
response = self._open(req, data)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 542, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(args)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1397, in https_open
return self.do_open(http.client.HTTPSConnection, req,
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1357, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1131)>
In call to configurable 'run' (<function run at 0x7faccce38430>)
Traceback (most recent call last):
File "/home/disk1/lcy/pycharm/nerf-factory/run.py", line 229, in
run(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1605, in gin_wrapper
utils.augment_exception_message_and_reraise(e, err_str)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/utils.py", line 41, in augment_exception_message_and_reraise
raise proxy.with_traceback(exception.traceback) from None
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/gin/config.py", line 1582, in gin_wrapper
return fn( new_args, new_kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/run.py", line 173, in run
trainer.fit(model, data_module, ckpt_path=ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 608, in fit
call._call_and_handle_interrupt(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/call.py", line 38, in _call_and_handle_interrupt
return trainer_fn(*args, *kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 650, in _fit_impl
self._run(model, ckpt_path=self.ckpt_path)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1112, in _run
results = self._run_stage()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1191, in _run_stage
self._run_train()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1214, in _run_train
self.fit_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 199, in run
self.advance(args, kwargs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/fit_loop.py", line 267, in advance
self._outputs = self.epoch_loop.run(self._data_fetcher)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
self.on_advance_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 250, in on_advance_end
self._run_validation()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 308, in _run_validation
self.val_loop.run()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/loop.py", line 206, in run
output = self.on_run_end()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 180, in on_run_end
self._evaluation_epoch_end(self._outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/loops/dataloader/evaluation_loop.py", line 288, in _evaluation_epoch_end
self.trainer._call_lightning_module_hook(hook_name, output_or_outputs)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1356, in _call_lightning_module_hook
output = fn(*args, *kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/nerf/model.py", line 297, in validation_epoch_end
lpips_mean = self.lpips_each(rgbs, targets).mean()
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(args, *kwargs)
File "/home/disk1/lcy/pycharm/nerf-factory/src/model/interface.py", line 62, in lpips_each
lpips_model = LPIPS(network="vgg").to(device=self.device)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 131, in init
self.weights = nn.ParameterList(get_weights(network=network))
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/piqa/lpips.py", line 38, in get_weights
weights = torch.hub.load_state_dict_from_url(
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 727, in load_state_dict_from_url
download_url_to_file(url, cached_file, hash_prefix, progress=progress)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/site-packages/torch/hub.py", line 593, in download_url_to_file
u = urlopen(req)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 525, in open
response = self._open(req, data)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 542, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(args)
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1397, in https_open
return self.do_open(http.client.HTTPSConnection, req,
File "/home/lcy/anaconda3/envs/nerf_factory/lib/python3.8/urllib/request.py", line 1357, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1131)>
In call to configurable 'run' (<function run at 0x7fce11f52550>)
Epoch 0: 100%|██████████| 3957/3957 [22:18<00:00, 2.96it/s, loss=0.208, v_num=0, train/psnr1=9.500, train/psnr0=9.490] `
LitNeRF.optimizer_step()
hook is overridden, including theusing_native_amp
argument. Removing this argument will avoid this message, you can expect it to return True. rank_zero_deprecation( Epoch 0: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3957/3957 [20:52<00:00, 3.16it/s, loss=0.208, v_num=0, train/psnr1=9.500, train/psnr0=9.490]Downloading: "https://github.com/richzhang/PerceptualSimilarity/raw/master/lpips/weights/v0.1/vgg.pth" to /home/lcy/.cache/torch/hub/checkpoints/vgg.pth█████████████████████████████████████████████████████| 3907/3907 [20:45<00:00, 3.14it/s] Downloading: "https://github.com/richzhang/PerceptualSimilarity/raw/master/lpips/weights/v0.1/vgg.pth" to /home/lcy/.cache/torch/hub/checkpoints/vgg.pth Traceback (most recent call last): File "run.py", line 229, in