tteepe / GaitGraph2

Official code for "Towards a Deeper Understanding of Skeleton-based Gait Recognition" (CVPRW'22)
40 stars 11 forks source link

RuntimeError: number of dims don't match in permute #16

Open jdyjjj opened 1 year ago

jdyjjj commented 1 year ago

when I run this command, and change ' multi_branch: bool = False' to ' multi_branch: bool = True'.

python3 gaitgraph_casia_b.py --config configs/casia_b.yaml

It doesn't work, I wonder why.

Global seed set to 5318008
GPU available: True, used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0,1,2,3,4,5,6,7]

  | Name       | Type            | Params
-----------------------------------------------
0 | backbone   | ResGCN          | 350 K 
1 | distance   | LpDistance      | 0     
2 | train_loss | SupConLoss      | 0     
3 | val_loss   | ContrastiveLoss | 0     
-----------------------------------------------
350 K     Trainable params
0         Non-trainable params
350 K     Total params
1.403     Total estimated model params size (MB)
Global seed set to 5318008                                                                                                                                                                                                                                                                 
Epoch 0:   0%|                                                                                                                                                                                                                                            | 0/11 [00:00<00:00, 2770.35it/s]Traceback (most recent call last):
  File "gaitgraph_casia_b.py", line 295, in <module>
    cli_main()
  File "gaitgraph_casia_b.py", line 289, in cli_main
    save_config_overwrite=True
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/utilities/cli.py", line 289, in __init__
    self.fit()
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/utilities/cli.py", line 432, in fit
    self.trainer.fit(**self.fit_kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/trainer/trainer.py", line 552, in fit
    self._run(model)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/trainer/trainer.py", line 922, in _run
    self._dispatch()
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/trainer/trainer.py", line 990, in _dispatch
    self.accelerator.start_training(self)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/accelerators/accelerator.py", line 92, in start_training
    self.training_type_plugin.start_training(trainer)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/plugins/training_type/training_type_plugin.py", line 161, in start_training
    self._results = trainer.run_stage()
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/trainer/trainer.py", line 1000, in run_stage
    return self._run_train()
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/trainer/trainer.py", line 1049, in _run_train
    self.fit_loop.run()
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/base.py", line 111, in run
    self.advance(*args, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/fit_loop.py", line 200, in advance
    epoch_output = self.epoch_loop.run(train_dataloader)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/base.py", line 111, in run
    self.advance(*args, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 130, in advance
    batch_output = self.batch_loop.run(batch, self.iteration_count, self._dataloader_idx)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 100, in run
    super().run(batch, batch_idx, dataloader_idx)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/base.py", line 111, in run
    self.advance(*args, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 147, in advance
    result = self._run_optimization(batch_idx, split_batch, opt_idx, optimizer)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 201, in _run_optimization
    self._optimizer_step(optimizer, opt_idx, batch_idx, closure)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 403, in _optimizer_step
    using_lbfgs=is_lbfgs,
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/core/lightning.py", line 1616, in optimizer_step
    optimizer.step(closure=optimizer_closure)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/core/optimizer.py", line 206, in step
    self.__optimizer_step(closure=closure, profiler_name=profiler_name, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/core/optimizer.py", line 128, in __optimizer_step
    trainer.accelerator.optimizer_step(self._optimizer, self._optimizer_idx, lambda_closure=closure, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/accelerators/accelerator.py", line 296, in optimizer_step
    self.run_optimizer_step(optimizer, opt_idx, lambda_closure, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/accelerators/accelerator.py", line 303, in run_optimizer_step
    self.training_type_plugin.optimizer_step(optimizer, lambda_closure=lambda_closure, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/plugins/training_type/training_type_plugin.py", line 226, in optimizer_step
    optimizer.step(closure=lambda_closure, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/torch/optim/lr_scheduler.py", line 65, in wrapper
    return wrapped(*args, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/torch/optim/optimizer.py", line 88, in wrapper
    return func(*args, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/torch/autograd/grad_mode.py", line 28, in decorate_context
    return func(*args, **kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/torch/optim/adamw.py", line 65, in step
    loss = closure()
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 235, in _training_step_and_backward_closure
    result = self.training_step_and_backward(split_batch, batch_idx, opt_idx, optimizer, hiddens)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 536, in training_step_and_backward
    result = self._training_step(split_batch, batch_idx, opt_idx, hiddens)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 306, in _training_step
    training_step_output = self.trainer.accelerator.training_step(step_kwargs)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/accelerators/accelerator.py", line 193, in training_step
    return self.training_type_plugin.training_step(*step_kwargs.values())
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/pytorch_lightning/plugins/training_type/training_type_plugin.py", line 172, in training_step
    return self.model.training_step(*args, **kwargs)
  File "gaitgraph_casia_b.py", line 75, in training_step
    y_hat = self(x)
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1051, in _call_impl
    return forward_call(*input, **kwargs)
  File "gaitgraph_casia_b.py", line 68, in forward
    return self.backbone(x)[0]
  File "/home/jdy/anaconda3/envs/gaitgraph2/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1051, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/jdy/GaitGraph2/GaitGraph/models/ResGCNv1/nets.py", line 61, in forward
    x = x.permute(0, 3, 4, 1, 2)
RuntimeError: number of dims don't match in permute