search

Danial-Kord / DigiHuman

Automatic 3D Character animation using Pose Estimation and Landmark Generation techniques
GNU General Public License v3.0
443 stars 72 forks source link

Hi, does is possible to mgirate this project to UE based? #7

Closed lucasjinreal closed 1 year ago

lucasjinreal commented 1 year ago

Hi, does is possible to mgirate this project to UE based?

Danial-Kord commented 1 year ago

Hey there. Yes, it is possible. The main architecture of the program is client-server. The AI computations are calculated in the server. Regarding your question, we need to handle outputs of the server in Unreal Engine instead of Unity3D, which is possible but needs some work. I am considering to expand the features of the application as well as creating the UE version of it and then we would be able to get the benefits of "meta-human" in UE as well :D

lucasjinreal commented 1 year ago

@Danial-Kord thank u. It's promising. I would hoping for a UE5 version expecially if it can work on metahuman. It would be awesome. Nice work.

lucasjinreal commented 1 year ago

BTW, I am consider make a model based face mocap (without iPhone) using blendshapes, it would be more natural than using mesh or 3d poses. I might PR to u when I finished, so that a more vivid metahuman version could came out.

Danial-Kord commented 1 year ago

@Danial-Kord thank u. It's promising. I would hoping for a UE5 version expecially if it can work on metahuman. It would be awesome. Nice work.

Thank you for your comment ^_^

Danial-Kord commented 1 year ago

BTW, I am consider make a model based face mocap (without iPhone) using blendshapes, it would be more natural than using mesh or 3d poses. I might PR to u when I finished, so that a more vivid metahuman version could came out.

Wow, that is great. Exactly one of the ways to expand this project is to use a deep neural network model to detect every blend shape weight. That would be awsome good luck :D

lucasjinreal commented 1 year ago

@Danial-Kord do u have any estimated timeline on come up with a ue version? I like to test it with mediapipe, not very familliar with unity

Danial-Kord commented 1 year ago

@Danial-Kord do u have any estimated timeline on come up with a ue version? I like to test it with mediapipe, not very familliar with unity

Well currently I am focusing on adding more functional features to DigiHuman. But I think in the next 6 months we can have a UE version of the application available.

lucasjinreal commented 1 year ago

@Danial-Kord do u have a discord or telegram? we can further close discuss on detailed topic.

Danial-Kord commented 1 year ago

Yeah sure, Here is my telegram ID: https://t.me/Danial_km

ujjawalcse commented 1 year ago

Hey @Danial-Kord @jinfagang , May i join too, to achieve our common goal towards Metahuman.

lucasjinreal commented 1 year ago

@ujjawalcse sure, add my telegram, let's talk in a group: lucasjinreal

ujjawalcse commented 1 year ago

Found @Danial-Kord on telegram but couldn't find you @jinfagang . you can connect me with @ujjawal_ks.