Open rafationgson opened 3 months ago
Hi @rafationgson,
What do you mean exactly as blank videos, only black frames?
Why are you using .enable_sequential_cpu_offload()
? Your GPU seems relatively decent. Do you have other processes that need to consume GPU VRAM? Could you replace it with .enable_model_cpu_offload()
or .to('cuda')
?
Hi @standardAI, yes black frames. Actually there are no other processes that need to consume GPU VRAM. I thought I needed to enable the offload.
I replaced it with to .to('cuda')
and used torch.float16
, but I am still encountering black frames.
What about .to('cuda')
and torch.float32
without offloading?
What about
.to('cuda')
andtorch.float32
without offloading?
Tried this too and issue still persists.
In what way are you exactly displaying video, via which function? What is your OpenCV version? Also, self.pipe
is not another unrelated pipeline, right?
I am trying to display the video via the predict
function of the Predictor
class of my custom Cog model in Replicate. Yes self.pipe
is the same pipeline, I forgot to remove it when I put the reproduction code above. As for my OpenCV version I believe it is the latest version: 4.9.0.80
since I didn't specify a version.
I can't reproduce this issue https://colab.research.google.com/drive/1Ul37s8OefIJ-RkpyNkPAqOc7P0gzRL78?usp=sharing
@rafationgson can you check to see if the individual frames of the video are blank as well?
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
@rafationgson is this still an issue?
Describe the bug
I am encountering an issue when using the TextToVideoSDPipeline. It is generating blank videos when I run the model in Replicate. The model is running on A100 (80GB) hardware.
Reproduction
Logs
No response
System Info
Cog yaml file build: gpu: true cuda: "12.1" python_version: "3.11.1" system_packages:
Who can help?
No response