open-mmlab / FoleyCrafter

FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds. AI拟音大师,给你的无声视频添加生动而且同步的音效 😝
https://foleycrafter.github.io/
Apache License 2.0
471 stars 40 forks source link

How can I adapt the model to new data effectively? 🧐 #25

Open clumsyroot opened 1 week ago

clumsyroot commented 1 week ago

I’ve tried fine-tuning the pre-trained IPAdapter and applying LoRA to fine-tune the UNet, but the results weren’t good. 😤 Any other suggestions? 🎈