JulesBelveze / bert-squeeze

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
https://julesbelveze.github.io/bert-squeeze/
78 stars 10 forks source link

Incompatibility with latest `pytorch-lightning` and `neptune` #23

Closed JulesBelveze closed 2 years ago

JulesBelveze commented 2 years ago

It seems the code break with the latest releases of pytorch-lightning and neptune. At least the following config breaks:

pytorch-lightning==1.5.3
neptune-client==0.13.2

Trace:

Error executing job with overrides: []
Traceback (most recent call last):
  File "/home/jules/bert-squeeze/bert-squeeze/main.py", line 70, in run
    trainer.fit(model, data)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/trainer/trainer.py", line 738, in fit
    self._fit_impl, model, train_dataloaders, val_dataloaders, datamodule, ckpt_path
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/trainer/trainer.py", line 682, in _call_and_handle_interrupt
    return trainer_fn(*args, **kwargs)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/trainer/trainer.py", line 772, in _fit_impl
    self._run(model, ckpt_path=ckpt_path)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/trainer/trainer.py", line 1141, in _run
    self.accelerator.setup(self)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/accelerators/cpu.py", line 35, in setup
    return super().setup(trainer)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/accelerators/accelerator.py", line 93, in setup
    self.setup_optimizers(trainer)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/accelerators/accelerator.py", line 352, in setup_optimizers
    trainer=trainer, model=self.lightning_module
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/plugins/training_type/training_type_plugin.py", line 245, in init_optimizers
    return trainer.init_optimizers(model)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/trainer/optimizers.py", line 35, in init_optimizers
    optim_conf = self.call_hook("configure_optimizers", pl_module=pl_module)
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/trainer/trainer.py", line 1496, in call_hook
    output = model_fx(*args, **kwargs)
  File "/home/jules/bert-squeeze/bert-squeeze/models/base_lt_module.py", line 103, in configure_optimizers
    num_training_steps = len(self.train_dataloader()) * self.config.num_epochs // \
  File "/home/jules/data-n-ai/.venv/training/lib/python3.6/site-packages/pytorch_lightning/core/hooks.py", line 477, in train_dataloader
    raise NotImplementedError("`train_dataloader` must be implemented to be used with the Lightning Trainer")
NotImplementedError: `train_dataloader` must be implemented to be used with the Lightning Trainer