Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Head angle rotation question #48

Open
oo92 opened this issue Feb 16, 2022 · 8 comments
Open

Head angle rotation question #48

oo92 opened this issue Feb 16, 2022 · 8 comments

Comments

@oo92
Copy link

oo92 commented Feb 16, 2022

Hi.

If I feed in selfie_1.png of a person looking in direction_A and selfie_2.png of a person looking in direction_b, how can I use your model to have selfie_1.png look in direction_B while preserving identity (facial hair, hair style, piercings, etc)?

@zhanglonghao1992
Copy link
Owner

For an image rather than a video, especially the face orientation or posture is very different, it is recommended to use the face swapping algorithm. :)

@oo92
Copy link
Author

oo92 commented Feb 17, 2022

@zhanglonghao1992 Faceswapping algorithm does not work for beards, especially prominent ones.

@zhanglonghao1992
Copy link
Owner

@oo92 It can't preserve selfie_1's beard or selfie_2's beard?

@zhanglonghao1992
Copy link
Owner

@oo92 If it can't keep 1's beard, it means that your supervision of the identity is not good enough (probably because your identity encoder is not robust?)

@oo92
Copy link
Author

oo92 commented Feb 17, 2022

Say that selfie_1 (with beard) is looking straight and selfie_2 is looking to the left. I don't want to do a face swap. I want to move selfie_1's head to the same direction as selfie_2, thereby making them look at the exact same angle. When doing this, I want to make sure I keep everything about selfie_1 intact, including the beard.

@oo92
Copy link
Author

oo92 commented Feb 17, 2022

Not a face swap but think of a headswap

@zhanglonghao1992
Copy link
Owner

@oo92 Then take selfie_1 as the source and selfie_2 as the driving, and slightly modify the code of the demo.py.

@oo92
Copy link
Author

oo92 commented Feb 17, 2022

@zhanglonghao1992 Modify which part of the file?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants