Tencent / MimicMotion

High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance
https://tencent.github.io/MimicMotion/
Other
733 stars 56 forks source link

Replicate API Added! #23

Closed zsxkib closed 4 days ago

zsxkib commented 5 days ago

Hey @Tencent AI Lab team! 👋

I've created a Replicate demo for your amazing MimicMotion model. This allows users to easily run and experiment with MimicMotion through Replicate's platform.

Key features:

  1. Replicate Demo:

  2. Replicate API: Enables users to run the model directly from their code. Example usage:

    import replicate
    
    output = replicate.run(
       "zsxkib/mimic-motion:2e7f79edf416dd7edd32dce85b7835be98eeb1d8eca2bebb2b8db8c996e5efad",
       input={
           "use_fp16": True,
           "chunk_size": 16,
           "resolution": 576,
           "motion_video": "https://replicate.delivery/pbxt/LD5c2cJou7MsS6J7KMBDfywggKAFCfsc2GUAlo67w4Z8aN30/pose1_trimmed_fixed.mp4",
           "sample_stride": 2,
           "frames_overlap": 6,
           "guidance_scale": 2,
           "noise_strength": 0,
           "denoising_steps": 25,
           "appearance_image": "https://replicate.delivery/pbxt/LD5c2GQlXTIlL1i3ZbVcCybtLlmF4XoPoTnbpCmt38MqMQiS/demo1.jpg",
           "output_frames_per_second": 15
       }
    )
    print(output)

I'm Sakib from Replicate, where we're working to make machine learning more accessible and reproducible. We were really impressed by MimicMotion and wanted to help make it easier for people to use and experiment with.

Adding the Replicate badge to your README would be great - it'll direct users to https://replicate.com/zsxkib/mimic-motion where they can try out the model instantly. This approach allows users to pay for their own compute, reducing the burden on your team.

To add the badge, you can use this markdown:

[![Replicate](https://replicate.com/zsxkib/mimic-motion/badge)](https://replicate.com/zsxkib/mimic-motion)

Let me know what you think! I'm excited to see how this can help more people experience the amazing capabilities of MimicMotion.

Keep up the fantastic work!

-Sakib

P.S. If you're interested in featuring MimicMotion on Replicate's homepage or blog, let me know. We'd love to showcase your innovation!

gujiaxi commented 1 day ago

@zsxkib Hi, a new MimicMotion model checkpoint supporting up to 72 frames of video generation has been released, greatly improving the generation quality. Could you please update the Replicate API with this new checkpoint? Thanks!

zsxkib commented 1 day ago

Hey @gujiaxi !

Thanks for the update. I’ll get on integrating the new MimicMotion checkpoint supporting 72 frames as soon as possible. Excited to see the improved generation quality!

Best, Sakib