search

Weifeng-Chen / control-a-video

Official Implementation of "Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models"
GNU General Public License v3.0
359 stars 26 forks source link

How to make pretrained controlnet model? #23

Open WebtoonNayoung opened 1 year ago

WebtoonNayoung commented 1 year ago

Hi! I have a question. How can I create a pretrained ControlNet 3D model? Do I need to train additional 3D parameters, or is it possible to use the pretrained ControlNet 2D model? Thank you very much.

Weifeng-Chen commented 1 year ago

Hi! I have a question. How can I create a pretrained ControlNet 3D model? Do I need to train additional 3D parameters, or is it possible to use the pretrained ControlNet 2D model? Thank you very much.

2d controlnet is used during training. you may find the from_2d in the controlnet3D and load from there.

hw-liang commented 10 months ago

May I know how to prepare the "model_path" in from_2d arguments? I didn't find any *.bin model files online.