thangvubk / SoftGroup

[CVPR 2022 Oral] SoftGroup for Instance Segmentation on 3D Point Clouds
MIT License
337 stars 80 forks source link

AssertionError: Empty dataset #202

Open darissa opened 5 months ago

darissa commented 5 months ago

./tools/dist_train.sh configs/softgroup/softgroup_stpls3d.yaml 1 2024-01-25 08:18:39,300 - INFO - Config: model: channels: 16 num_blocks: 7 semantic_classes: 15 instance_classes: 14 sem2ins_classes: [] semantic_only: False semantic_weight: [1.0, 1.0, 44.0, 21.9, 1.8, 25.1, 31.5, 21.8, 24.0, 54.4, 114.4, 81.2, 43.6, 9.7, 22.4] ignore_label: -100 with_coords: False grouping_cfg: score_thr: 0.2 radius: 0.9 mean_active: 3 class_numpoint_mean: [-1., 10408., 58., 124., 1351., 162., 430., 1090., 451., 26., 43., 61., 39., 109., 1239] npoint_thr: 0.05 # absolute if class_numpoint == -1, relative if class_numpoint != -1 ignore_classes: [0] instance_voxel_cfg: scale: 3 spatial_shape: 20 train_cfg: max_proposal_num: 300 pos_iou_thr: 0.5 match_low_quality: True min_pos_thr: 0.1 test_cfg: x4_split: False cls_score_thr: 0.001 mask_score_thr: -0.5 min_npoint: 15 eval_tasks: ['semantic', 'instance'] fixed_modules: []

data: train: type: 'stpls3d' data_root: 'dataset/stpls3d' prefix: 'train' suffix: '_inst_nostuff.pth' training: True repeat: 4 voxel_cfg: scale: 3 spatial_shape: [128, 512] max_npoint: 250000 min_npoint: 5000 test: type: 'stpls3d' data_root: 'dataset/stpls3d' prefix: 'val_250m' suffix: '_inst_nostuff.pth' training: False voxel_cfg: scale: 3 spatial_shape: [128, 512] max_npoint: 250000 min_npoint: 5000

dataloader: train: batch_size: 4 num_workers: 4 test: batch_size: 1 num_workers: 1

optimizer: type: 'Adam' lr: 0.004

eval_min_npoint: 10

fp16: False epochs: 108 step_epoch: 20 save_freq: 4 pretrain: './work_dirs/softgroup_stpls3d_backbone/latest.pth' work_dir: ''

2024-01-25 08:18:39,301 - INFO - Distributed: True 2024-01-25 08:18:39,301 - INFO - Mix precision training: False Traceback (most recent call last): File "./tools/train.py", line 206, in main() File "./tools/train.py", line 178, in main train_set = build_dataset(cfg.data.train, logger) File "/home/ubuntu18/SoftGroup/softgroup/data/init.py", line 22, in build_dataset return STPLS3DDataset(*_data_cfg) File "/home/ubuntu18/SoftGroup/softgroup/data/custom.py", line 37, in init self.filenames = self.get_filenames() File "/home/ubuntu18/SoftGroup/softgroup/data/custom.py", line 42, in get_filenames assert len(filenames) > 0, 'Empty dataset.' AssertionError: Empty dataset. ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 24126) of binary: /home/ubuntu18/.conda/envs/softgroup/bin/python Traceback (most recent call last): File "/home/ubuntu18/.conda/envs/softgroup/bin/torchrun", line 8, in sys.exit(main()) File "/home/ubuntu18/.conda/envs/softgroup/lib/python3.7/site-packages/torch/distributed/elastic/multiprocessing/errors/init.py", line 345, in wrapper return f(args, *kwargs) File "/home/ubuntu18/.conda/envs/softgroup/lib/python3.7/site-packages/torch/distributed/run.py", line 724, in main run(args) File "/home/ubuntu18/.conda/envs/softgroup/lib/python3.7/site-packages/torch/distributed/run.py", line 718, in run )(cmd_args) File "/home/ubuntu18/.conda/envs/softgroup/lib/python3.7/site-packages/torch/distributed/launcher/api.py", line 131, in call return launch_agent(self._config, self._entrypoint, list(args)) File "/home/ubuntu18/.conda/envs/softgroup/lib/python3.7/site-packages/torch/distributed/launcher/api.py", line 247, in launch_agent failures=result.failures, torch.distributed.elastic.multiprocessing.errors.ChildFailedError:

./tools/train.py FAILED

Failures:

------------------------------------------------------------ Root Cause (first observed failure): [0]: time : 2024-01-25_08:18:44 host : ubuntu18 rank : 0 (local_rank: 0) exitcode : 1 (pid: 24126) error_file: traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html ============================================================ Hi, I am using stpls3d dataset. But as you noticed, the error " File "/home/ubuntu18/SoftGroup/softgroup/data/custom.py", line 42, in get_filenames assert len(filenames) > 0, 'Empty dataset.' AssertionError: Empty dataset" I don't know why it was called custom.py instead stpls3d.py. Can you please help me to take a look.
Rurouni-z commented 5 months ago

if you overwrite this funtion in stpls3d.py, then you will find it in stpls3d.py. check here to get inheritance knowledge

i think you may put wrong dir or dont download this dataset.