camenduru / text-to-video-synthesis-colab

Text To Video Synthesis Colab
The Unlicense
1.42k stars 168 forks source link

potat1_text_to_video_colab.ipynb won’t generate video #27

Open wjk opened 3 months ago

wjk commented 3 months ago

I am running this notebook in Google Colab. It took three goes for the dependencies to install properly. When I try to actually run the model, I get this:

/content/Text-To-Video-Finetuning
2024-04-01 18:39:22.405606: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-04-01 18:39:22.405655: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-04-01 18:39:22.407052: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-04-01 18:39:23.575649: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Traceback (most recent call last):
  File "/content/Text-To-Video-Finetuning/inference.py", line 13, in <module>
    from train import export_to_video, handle_memory_attention, load_primary_models
  File "/content/Text-To-Video-Finetuning/train.py", line 18, in <module>
    import torchvision.transforms as T
  File "/usr/local/lib/python3.10/dist-packages/torchvision/__init__.py", line 6, in <module>
    from torchvision import _meta_registrations, datasets, io, models, ops, transforms, utils
  File "/usr/local/lib/python3.10/dist-packages/torchvision/_meta_registrations.py", line 164, in <module>
    def meta_nms(dets, scores, iou_threshold):
  File "/usr/local/lib/python3.10/dist-packages/torch/_custom_ops.py", line 253, in inner
    custom_op = _find_custom_op(qualname, also_check_torch_library=True)
  File "/usr/local/lib/python3.10/dist-packages/torch/_custom_op/impl.py", line 1076, in _find_custom_op
    overload = get_op(qualname)
  File "/usr/local/lib/python3.10/dist-packages/torch/_custom_op/impl.py", line 1062, in get_op
    error_not_found()
  File "/usr/local/lib/python3.10/dist-packages/torch/_custom_op/impl.py", line 1052, in error_not_found
    raise ValueError(
ValueError: Could not find the operator torchvision::nms. Please make sure you have already registered the operator and (if registered from C++) loaded it via torch.ops.load_library.

This is clearly not supposed to happen. Does anyone know what’s going on?

GARV-k commented 1 month ago

Facing a similar issue.