anandpawara / Real_Time_Image_Animation

The Project is real time application in opencv using first order model
GNU General Public License v3.0
3.23k stars 521 forks source link

Output is really weird and unexpected #11

Closed filipe-monteiro closed 4 years ago

filipe-monteiro commented 4 years ago

Lovely project but when trying to run it the output was unexpected.

I got some user warnings but similar to the ones in the jupyter notebook shared in the repo.

All the outputs look like this:

image

Any idea of what I did wrong?

ZZZColin commented 4 years ago

Congret, you just made another TO-BE-WORLD-FAMOUS painting

anandpawara commented 4 years ago

Lovely project but when trying to run it the output was unexpected.

I got some user warnings but similar to the ones in the jupyter notebook shared in the repo.

All the outputs look like this:

image

Any idea of what I did wrong?

You did nothing wrong the output of the image depends on first frame frame opencv, If the user is not correctly oriented or not present, then the because of first frame , the application outputs bizzare results need to work on taking best frame of refrence before generating output

Otter-man commented 4 years ago

@anandpawara solution for this problem might be easier. Maybe add the "reset" button, that will make the reference frame the current one. So if the user is not correctly oriented or not present he can reset the reference frame on the fly.

Will be like this: User seeing distorted image will position himself correctly, will press there "reset button" and the generation will restart using current frame (at the time of the button push) as a ref.frame.

This solution is used in other real-time deepfake generator project: https://github.com/alew3/faceit_live3

I'm trying to implement this myself but i'm not that familiar with opencv and can't yet figure how to recreate it in your code. Maybe you'll be able to implement it yourself faster.

anandpawara commented 4 years ago

@anandpawara solution for this problem might be easier. Maybe add the "reset" button, that will make the reference frame the current one. So if the user is not correctly oriented or not present he can reset the reference frame on the fly.

Will be like this: User seeing distorted image will position himself correctly, will press there "reset button" and the generation will restart using current frame (at the time of the button push) as a ref.frame.

This solution is used in other real-time deepfake generator project: https://github.com/alew3/faceit_live3

I'm trying to implement this myself but i'm not that familiar with opencv and can't yet figure how to recreate it in your code. Maybe you'll be able to implement it yourself faster.

This is exactly I was planning to make in future , thanks for the lead may I'll try to integrate with current project

filipe-monteiro commented 4 years ago

Thanks everyone, I see what I need to do now!

Will close this issue.