search

hpcaitech / Open-Sora

Open-Sora: Democratizing Efficient Video Production for All
https://hpcaitech.github.io/Open-Sora/
Apache License 2.0
20.41k stars 1.94k forks source link

请问如果用pixart-sigma模型作为config，可以选择num_frames fps>1生成视频吗 #579

Closed foreverpiano closed 1 day ago

foreverpiano commented 5 days ago

/workspace/Open-Sora/configs/pixart/inference/1x2048MS.py config在这里

foreverpiano commented 5 days ago

还是说当前框架仅支持这个模型生成图像？ @zhengzangw @Shen-Chenhui

foreverpiano commented 5 days ago

另外直接运行会报错 Traceback (most recent call last): File "/workspace/Open-Sora/scripts/inference.py", line 304, in main() File "/workspace/Open-Sora/scripts/inference.py", line 266, in main samples = scheduler.sample( File "/workspace/Open-Sora/opensora/schedulers/dpms/init.py", line 27, in sample assert mask is None, "mask is not supported in dpm-solver" AssertionError: mask is not supported in dpm-solver

zhengzangw commented 1 day ago

还是说当前框架仅支持这个模型生成图像？ @zhengzangw @Shen-Chenhui

pixart 这个模型仅支持生成图像。所以 num_frames 和 fps 都固定即可。除非你用这个模型自己训练了视频，才可以修改并生成。

zhengzangw commented 1 day ago

另外直接运行会报错 Traceback (most recent call last): File "/workspace/Open-Sora/scripts/inference.py", line 304, in main() File "/workspace/Open-Sora/scripts/inference.py", line 266, in main samples = scheduler.sample( File "/workspace/Open-Sora/opensora/schedulers/dpms/init.py", line 27, in sample assert mask is None, "mask is not supported in dpm-solver" AssertionError: mask is not supported in dpm-solver

该问题最新版已经修复。