Tencent / MimicMotion

High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance
https://tencent.github.io/MimicMotion/
Other
1.95k stars 166 forks source link

Replicate API Added Part 2!: New checkpoint added, fp16 input param removed for simplicity #49

Closed zsxkib closed 4 months ago

zsxkib commented 4 months ago

Hey @Tencent AI Lab team and @gujiaxi! πŸ‘‹

Exciting update! This PR builds on our previous collaboration (https://github.com/Tencent/MimicMotion/pull/23) to integrate the latest MimicMotion improvements into the Replicate demo.

What's new:

  1. Added the new MimicMotion checkpoint supporting 72 frames of video generation - major quality boost! πŸš€
  2. Implemented lazy loading to swap between original and new checkpoints (new one's the default).
  3. Simplified things by removing the use_fp16 input param (it was causing some hiccups).
  4. New checkpoint_version input lets users choose between "v1" and "v1-1" (default).

These updates make the MimicMotion API on Replicate even more powerful and user-friendly. The lazy loading is pretty neat - it only updates the pipeline when needed, keeping things efficient.

I've put it through its paces to make sure everything's running smoothly with both checkpoints. Would love your thoughts on this! Let me know if you want to see any tweaks or have any questions.

Keep the innovation coming! πŸ’‘

Best, Sakib

P.S. If you're up for showcasing these awesome MimicMotion updates or any other @@Tencent models on Replicate's homepage or blog, just give me a shout. We'd be thrilled to highlight your latest breakthroughs!