SizheAn / PanoHead

Code Repository for CVPR 2023 Paper "PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360 degree"
Creative Commons Zero v1.0 Universal
1.91k stars 236 forks source link

Dataset.json generation #7

Closed carlosedubarreto closed 1 year ago

carlosedubarreto commented 1 year ago

Im trying to use it with other images, but I'm having a hard time on how to generate the dataset.json file.

Can you point a direction on how to make it?

Thanks This is a great solution that youve made.

SizheAn commented 1 year ago

Working on it! I think in here https://github.com/SizheAn/PanoHead/issues/13#issuecomment-1607769030 people are also closed to reproduce it.

carlosedubarreto commented 1 year ago

Thanks a lot @SizheAn this data was drinving me crazy this last weekend 😀

SizheAn commented 1 year ago

Thanks a lot @SizheAn this data was drinving me crazy this last weekend 😀

We update the scripts and example data for obtaining camera poses and cropping the images for PTI. See https://github.com/SizheAn/PanoHead/blob/main/3DDFA_V2_cropping/cropping_guide.md

carlosedubarreto commented 1 year ago

Seems like the shape predictor needs to be downloaded from here

https://github.com/italojs/facial-landmarks-recognition/blob/master/shape_predictor_68_face_landmarks.dat

I'm testin it right now. Thanks a lot @SizheAn

carlosedubarreto commented 1 year ago

Got a great result at the front part. Just an odd result at the back of the face. But great results overall thanks a lot for that. I'll make a lot more tests 🎉

https://github.com/SizheAn/PanoHead/assets/4061130/5fc1f00d-d0e1-48cf-bab1-2c3cbe5d9ecb

kashishnaqvi101 commented 1 year ago

Got a great result at the front part. Just an odd result at the back of the face. But great results overall thanks a lot for that. I'll make a lot more tests 🎉

Post1.mp4

Hey, I got an error called no module Faceboxes, did you get any such error?

carlosedubarreto commented 1 year ago

@kashishnaqvi101 yep, me too. You have to get most of the things from the 3DDFA repository. you will also have to compile a couple of things.

Nothing impossible, it will just give you a few more work, but totally worth it.

kashishnaqvi101 commented 1 year ago

@kashishnaqvi101 yep, me too. You have to get most of the things from the 3DDFA repository. you will also have to compile a couple of things.

Nothing impossible, it will just give you a few more work, but totally worth it.

Yeah, it finally ran! and the results are good, i just need them in some mesh format so that an animator can actually use it

carlosedubarreto commented 1 year ago

@kashishnaqvi101 I suggest you to take a look on Hackman repository, he made some changes that can enable the mesh output

https://github.com/hack-mans/PanoHead

kashishnaqvi101 commented 1 year ago

@kashishnaqvi101 I suggest you to take a look on Hackman repository, he made some changes that can enable the mesh output

https://github.com/hack-mans/PanoHead

Thanks for the help, I will out hack-man's version!

kashishnaqvi101 commented 1 year ago

Okay, thank you. I got the output in no colour, I hope they someone introduces colours also.

On Fri, 30 Jun 2023 at 4:05 PM, Carlos Barreto @.***> wrote:

@kashishnaqvi101 https://github.com/kashishnaqvi101 I suggest you to take a look on Hackman repository, he made some changes that can enable the mesh output

https://github.com/hack-mans/PanoHead

— Reply to this email directly, view it on GitHub https://github.com/SizheAn/PanoHead/issues/7#issuecomment-1614624756, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANKJF5HEJ6AB2ZGPDWXAMRTXN3FK3ANCNFSM6AAAAAAZTCSE3Y . You are receiving this because you were mentioned.Message ID: @.***>