camenduru / text-to-video-synthesis-colab

Text To Video Synthesis Colab
The Unlicense
1.44k stars 173 forks source link

Where is the generated video supposed to be saved? #2

Closed erikestany closed 1 year ago

erikestany commented 1 year ago

Hi!

Where is the generated video supposed to be saved?

After running the last cell a window of a 0.00 second video appears with the text: /tmp/tmpgv746osq.mp4 but it cannot be played or downloaded.

Thanks.

byakuyamira commented 1 year ago

Same-ish.

Attempt 1: I got this error running the 1st cell using a free colab acc:
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. pandas-gbq 0.17.9 requires pyarrow<10.0dev,>=3.0.0, but you have pyarrow 11.0.0 which is incompatible.

Then I ignored it and ran the 2nd cell with my own custom input (which was 3 sentences) and it crashed due to not enough RAM.

Attempt 2: I clicked restart and run all, and I'm trying again this time with the default input for the 2nd cell and it outputted this 2 sec video but ... the video playback seems bugged its either just a bunch of green or it changes too purple too, but i cant find the file path where its saved either.

/tmpk55v5ish.mp4

Screenshot 2023-03-19 at 11 34 02 PM Screenshot 2023-03-19 at 11 32 30 PM
camenduru commented 1 year ago

Hi @erikestany 👋 please check this

Screenshot 2023-03-20 094558

camenduru commented 1 year ago

Hi @pygymy 👋 maybe codec problem please check this video with same video player https://user-images.githubusercontent.com/54370274/226266698-7fd23019-c7e7-463f-a1bd-e0010de03078.mp4

erikestany commented 1 year ago

Hello,

Yes, it's a codec issue, fixed.

Is there a way to determine the duration of the video? and adjust the rest of the parameters of the generation?

Thank you so much!

camenduru commented 1 year ago

if modelscope developers add new features I will add

we are using this pipeline https://github.com/modelscope/modelscope/blob/master/modelscope/pipelines/multi_modal/text_to_video_synthesis_pipeline.py

camenduru commented 1 year ago

please watch this https://www.youtube.com/watch?v=b8D4am73e6I