mouth movement unnatural, dark batches/shadows appear around lips about sd-wav2lip-uhq HOT 5 OPEN

Try to set face erode to something like 40 ,mask blur to 30 and use gfpgan, Let me know

from sd-wav2lip-uhq.

Try to set face erode to something like 40 ,mask blur to 30 and use gfpgan, Let me know

just applied your suggested parameters, and the result is kind of off, here is the result video:
where the teeth seem crooked and over-crowded. not sure if it is because the mask isnt covering the teeth in the original video
https://github.com/numz/sd-wav2lip-uhq/assets/76946041/0a87d151-20e6-4ace-a68d-1bb20b7da032

from sd-wav2lip-uhq.

active debug and look into debug folder to check mask composition and see if it missed something or if erode or mask blur is not good enough

from sd-wav2lip-uhq.

active debug and look into debug folder to check mask composition and see if it missed something or if erode or mask blur is not good enough

the upper one is the "restored face video" and the bottom one is the "generated video". the "restored face video" has overall better looking eyes but only problem is the rectangular shape which appears around the mouth and it cuts off the tip of the chin a bit; however, the "generated video" looks closer to the original video, but the dark batches and shadows around the mouth makes it unpleasant and unnatural. i would prefer the "restored face video" without the rectangular shape.

here are the "restored face video" and the "generated video" for a clearer view of what I meant:

here is the setting im using now:

from sd-wav2lip-uhq.

You can try "only mouth" option, mouton mask dilate something like 30 and "mask blur" between 30 and 60.
Let me know

from sd-wav2lip-uhq.