训练时无法加载文件

[XxXhyy]

iskBackend. Traceback (most recent call last): File "tools/train.py", line 293, in main() File "tools/train.py", line 282, in main train_model( File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/apis/train.py", line 344, in train_model train_detector( File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/apis/train.py", line 319, in train_detector runner.run(data_loaders, cfg.workflow) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/runner/epoch_based_runner.py", line 136, in run epoch_runner(data_loaders[i], **kwargs) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/runner/epoch_based_runner.py", line 49, in train for i, data_batch in enumerate(self.data_loader): File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 521, in next data = self._next_data() File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1203, in _next_data return self._process_data(data) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1229, in _process_data data.reraise() File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/_utils.py", line 434, in reraise raise exception FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0. Original Traceback (most recent call last): File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 287, in _worker_loop data = fetcher.fetch(index) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 49, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 49, in data = [self.dataset[idx] for idx in possibly_batched_index] File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/dataset_wrappers.py", line 68, in getitem return self.dataset[ori_idx] File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/custom_3d.py", line 435, in getitem data = self.prepare_train_data(idx) File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/custom_3d.py", line 229, in prepare_train_data example = self.pipeline(input_dict) File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/pipelines/compose.py", line 49, in call data = t(data) File "/root/autodl-tmp/CMT/projects/mmdet3d_plugin/datasets/pipelines/transform_3d.py", line 163, in call sampled_dict = self.db_sampler.sample_all( File "/root/autodl-tmp/CMT/projects/mmdet3d_plugin/datasets/pipelines/dbsampler.py", line 194, in sample_all s_points = self.points_loader(results)['points'] File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/pipelines/loading.py", line 429, in call points = self._load_points(pts_filename) File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/pipelines/loading.py", line 405, in _load_points pts_bytes = self.file_client.get(pts_filename) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/fileio/file_client.py", line 1014, in get return self.client.get(filepath) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/fileio/file_client.py", line 535, in get with open(filepath, 'rb') as f: FileNotFoundError: [Errno 2] No such file or directory: 'nuscenes_gt_database/pts_dir/2adeb4a473794ca8b62cc0deb2b554c7_construction_vehicle_9.bin'

[CleanSeaSalt]

I also encountered this problem. It should be that the path prefix of "data/nuscenes" is missing, not that the file does not exist.

[vetsasai]

@CleanSeaSalt @XxXhyy

Where exactly should this prefix be corrected? Config file already has the dataroot set to data/nuscenes

Can you please help me where I can fix it. Debugging takes me too deep and into a loop, without any much help.

53 is also similar but unfortunately closed without solution.

Pls don't mind, I found that #8 closes this

[CleanSeaSalt]

@CleanSeaSalt @XxXhyy

Where exactly should this prefix be corrected? Config file already has the dataroot set to data/nuscenes

Can you please help me where I can fix it. Debugging takes me too deep and into a loop, without any much help.

53 is also similar but unfortunately closed without solution. Pls don't mind, I found that #8 closes this

I was searching for the missing file on my computer and found that it existed in a certain folder, so I just copied it to the path prompted.

[KadAMRN]

iskBackend. Traceback (most recent call last): File "tools/train.py", line 293, in main() File "tools/train.py", line 282, in main train_model( File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/apis/train.py", line 344, in train_model train_detector( File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/apis/train.py", line 319, in train_detector runner.run(data_loaders, cfg.workflow) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/runner/epoch_based_runner.py", line 136, in run epoch_runner(data_loaders[i], kwargs) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/runner/epoch_based_runner.py", line 49, in train for i, data_batch in enumerate(self.data_loader): File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 521, in next data = self._next_data() File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1203, in _next_data return self._process_data(data) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1229, in _process_data data.reraise() File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/_utils.py", line 434, in reraise raise exception FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0. Original Traceback (most recent call last): File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 287, in _worker_loop data = fetcher.fetch(index) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 49, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 49, in data = [self.dataset[idx] for idx in possibly_batched_index] File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/dataset_wrappers.py", line 68, in getitem return self.dataset[ori_idx] File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/custom_3d.py", line 435, in getitem data = self.prepare_train_data(idx) File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/custom_3d.py", line 229, in prepare_train_data example = self.pipeline(input_dict) File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/pipelines/compose.py", line 49, in call data = t(data) File "/root/autodl-tmp/CMT/projects/mmdet3d_plugin/datasets/pipelines/transform_3d.py", line 163, in call sampled_dict = self.db_sampler.sample_all( File "/root/autodl-tmp/CMT/projects/mmdet3d_plugin/datasets/pipelines/dbsampler.py", line 194, in sample_all s_points = self.points_loader(results)['points'] File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/pipelines/loading.py", line 429, in call** points = self._load_points(pts_filename) File "/root/autodl-tmp/CMT/mmdetection3d/mmdet3d/datasets/pipelines/loading.py", line 405, in _load_points pts_bytes = self.file_client.get(pts_filename) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/fileio/file_client.py", line 1014, in get return self.client.get(filepath) File "/root/miniconda3/envs/cmt/lib/python3.8/site-packages/mmcv/fileio/file_client.py", line 535, in get with open(filepath, 'rb') as f: FileNotFoundError: [Errno 2] No such file or directory: 'nuscenes_gt_database/pts_dir/2adeb4a473794ca8b62cc0deb2b554c7_construction_vehicle_9.bin'

I also had the same type of error with another file and adding a symbolic link to nuscenes_gt_database in the project root (CMT) as follow solved the issue : ln -s ./data/nuscenes/nuscenes_gt_database ./