Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

驱动视频如果比较糊,会导致生成视频也比较糊吗?尤其是牙齿细节上 #479

Open
sixone-Jiang opened this issue Jan 24, 2025 · 5 comments
Labels

Comments

@sixone-Jiang
Copy link

No description provided.

@cleardusk cleardusk added the qa label Feb 2, 2025
@huangxin168
Copy link

实测过,应该是有影响的

@cleardusk
Copy link
Member

Thanks for your report. @sixone-Jiang @huangxin168
Could you please provide an example, e.g., provide side-by-side comparisons ?

@sixone-Jiang
Copy link
Author

很抱歉我不能提供一个视频,但我可以给你提供我实验时的核心设置,
'flag_normalize_lip': False,
'flag_relative_motion': False,
'flag_do_crop': True,
'flag_pasteback': True,
'flag_stitching': True,
'animation_region': "lip",
'driving_option': "expression-friendly",
对于driving vedio,可以先对人脸下采样两倍,采取kernel=5的高斯模糊,再上采样到原分辨率用以获取低分辨率

@sixone-Jiang
Copy link
Author

更进一步的,我发现对于厚嘴唇的样例(source video),会较难让嘴唇有足够的张合大小

@cleardusk
Copy link
Member

很抱歉我不能提供一个视频,但我可以给你提供我实验时的核心设置, 'flag_normalize_lip': False, 'flag_relative_motion': False, 'flag_do_crop': True, 'flag_pasteback': True, 'flag_stitching': True, 'animation_region': "lip", 'driving_option': "expression-friendly", 对于driving vedio,可以先对人脸下采样两倍,采取kernel=5的高斯模糊,再上采样到原分辨率用以获取低分辨率

It seems that the motion extractor is sensitive to the disturb of driving images/video.
It's a good point. A future solution is to perform augmentation (e.g., blur) on driving images when training the motion extractor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants