Mathux / TEMOS

Official PyTorch implementation of the paper "TEMOS: Generating diverse human motions from textual descriptions", ECCV 2022 (Oral)
https://mathis.petrovich.fr/temos/
MIT License
378 stars 25 forks source link

when I just set 'vae=False' in temos.yaml,I got errors below #19

Closed eanson023 closed 1 year ago

eanson023 commented 1 year ago

hi authors, I want to try a situation when VAE is disabled and save its weights. but I was trapped in some problems(sorry, I just started)

  File "/Users/eanson/opt/miniconda3/envs/temos/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 370, in validation_step
    return self.model.validation_step(*args, **kwargs)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/base.py", line 33, in validation_step
    return self.allsplit_step("val", batch, batch_idx)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/temos.py", line 144, in allsplit_step
    loss = self.losses[split].update(ds_text=datastruct_from_text,
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/compute.py", line 83, in update
    total += self._update_loss("kl_text2motion", dis_text, dis_motion)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/compute.py", line 105, in _update_loss
    val = self._losses_func[loss](outputs, inputs)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/kl.py", line 9, in __call__
    div = torch.distributions.kl_divergence(q, p)
  File "/Users/eanson/opt/miniconda3/envs/temos/lib/python3.9/site-packages/torch/distributions/kl.py", line 170, in kl_divergence
    raise NotImplementedError("No KL(p || q) is implemented for p type {} and q type {}"
NotImplementedError: No KL(p || q) is implemented for p type NoneType and q type NoneType

pip list

Package                 Version
----------------------- -----------
absl-py                 1.3.0
aiohttp                 3.8.3
aiosignal               1.2.0
antlr4-python3-runtime  4.9.3
astroid                 2.12.12
async-timeout           4.0.2
attrs                   22.1.0
beautifulsoup4          4.11.1
cachetools              5.2.0
certifi                 2022.9.24
charset-normalizer      2.1.1
colorlog                6.7.0
commonmark              0.9.1
contourpy               1.0.6
cycler                  0.11.0
decorator               4.4.2
dill                    0.3.6
einops                  0.5.0
filelock                3.8.0
fonttools               4.38.0
frozenlist              1.3.1
fsspec                  2022.10.0
google-auth             2.13.0
google-auth-oauthlib    0.4.6
grpcio                  1.50.0
huggingface-hub         0.10.1
hydra-colorlog          1.2.0
hydra-core              1.2.0
idna                    3.4
imageio                 2.22.2
imageio-ffmpeg          0.4.7
importlib-metadata      5.0.0
isort                   5.10.1
kiwisolver              1.4.4
lazy-object-proxy       1.7.1
Markdown                3.4.1
MarkupSafe              2.1.1
matplotlib              3.6.1
mccabe                  0.7.0
moviepy                 1.0.3
multidict               6.0.2
numpy                   1.23.4
oauthlib                3.2.2
omegaconf               2.2.3
packaging               21.3
pandas                  1.5.1
Pillow                  9.3.0
pip                     22.2.2
platformdirs            2.5.2
proglog                 0.1.10
protobuf                3.19.6
psutil                  5.9.3
pyasn1                  0.4.8
pyasn1-modules          0.2.8
pyDeprecate             0.3.2
Pygments                2.13.0
pylint                  2.15.5
pyparsing               3.0.9
PySocks                 1.7.1
python-dateutil         2.8.2
pytorch-lightning       1.7.7
pytz                    2022.5
PyYAML                  6.0
regex                   2022.9.13
requests                2.28.1
requests-oauthlib       1.3.1
rich                    12.6.0
rsa                     4.9
setuptools              59.5.0
shortuuid               1.0.9
six                     1.16.0
soupsieve               2.3.2.post1
tensorboard             2.10.1
tensorboard-data-server 0.6.1
tensorboard-plugin-wit  1.8.1
tokenizers              0.13.1
tomli                   2.0.1
tomlkit                 0.11.5
torch                   1.13.0
torchmetrics            0.7.0
torchvision             0.14.0
tqdm                    4.64.1
transformers            4.23.1
typing_extensions       4.4.0
urllib3                 1.26.12
Werkzeug                2.2.2
wheel                   0.37.1
wrapt                   1.14.1
yarl                    1.8.1
zipp                    3.9.0
Mathux commented 1 year ago

Hi @eanson023,

I did not support it officially, and with the latest changes of the code, it might not work properly indeed.

What command line did you use there?