search

SamsungLabs / rome

Realistic mesh-based avatars. ECCV 2022
Other
428 stars 41 forks source link

Hugging Face Space Demo #21

Closed aandyw closed 9 months ago

aandyw commented 1 year ago

Hi there, thank you for creating such a cool project/paper.

I have implemented your work as a Hugging Face Space Demo.

https://huggingface.co/spaces/Pie31415/rome

I have not had the chance to implement the video inference using ROME but will do so asap.

yuripourre commented 1 year ago

This is great @Pie31415! Any chance to add way for users to download the generated 3d mesh?

aandyw commented 1 year ago

That's a good idea I didn't think about that. I'll look on adding that as well. Do you have suggestions for how to retrieve the mesh?

yuripourre commented 1 year ago

@Pie31415 I am not very familiar with the code but if you can access the vertices (position and texels) shouldn't be hard to generate an .obj

Ha0Tang commented 1 year ago

@Pie31415 Thanks. When can the video inference be done?

aandyw commented 1 year ago

@Ha0Tang I'll try to get both the 3d mesh downloading and video inference done by the end of this week.

yuripourre commented 1 year ago

@Pie31415 Please let me know if you need some assistant in getting the 3d mesh I have a particular interest on that.

aandyw commented 1 year ago

@yuripourre For sure. Feel free to open a PR to the space demo if you have any suggestions.

aandyw commented 1 year ago

I've gotten the video inference to work now. @Ha0Tang

You can try the video inference on the demo space.

Ha0Tang commented 1 year ago

@Pie31415 Thanks a lot, but we can't upload the driver videos.

aandyw commented 1 year ago

@Ha0Tang I separated the inference into video and webcam inference tabs. You should be able to upload driver videos now to the 'Video Inference.'

anwoflow commented 1 year ago

Is there a way of downloading mp4 files instead of GIFs? Bit difficult to assess the quality of the output

aandyw commented 1 year ago

@anwoflow For sure, GIF was mainly just so I could get something up and running quickly. I'll try to get a download video format ready as soon as possible.

@yuripourre Also, I've been having some issues with loading up the 3d downloadable mesh. If it's something you're still interested in I would love some help on that since I'm not too familiar with the graphics side of things.