Suggestion: Ability to set background colour about audio2photoreal HOT 5 CLOSED

Hi Chris! Thanks for the suggestion!

In case this helps to unblock you, this is possible to do by passing in a reference image (e.g. if it's green or some image background) into this function:

for instance, if you wanted to add an image background, it would be something like this:

tmp = cv2.imread(f"<path/to/image>")
image_bg = th.zeros_like(tex_rec)
image_bg[:, :3, ...] = (
      th.from_numpy(tmp.transpose(2, 0, 1)).float().cuda().unsqueeze(0)
)

or if you wanted to make it a solid color, just fill image_bg with some RGB color. There will be some color calibration steps you will have to do to get it to match green (like inverting this white balancing function:

from audio2photoreal.

tmp = cv2.imread(f"<path/to/image>")
image_bg = th.zeros_like(tex_rec)
image_bg[:, :3, ...] = (
th.from_numpy(tmp.transpose(2, 0, 1)).float().cuda().unsqueeze(0)
)

hi, @evonneng thanks for the explain.

I'd like to know what the tex_rec variable in your hint code means? How should I pass the parameters?

I actually want to replace the animated characters in the demo with images of myself, is it possible?

from audio2photoreal.

You unfortunately can not change identity of the avatars. Only the four pre-trained models are available.

from audio2photoreal.

You unfortunately can not change identity of the avatars. Only the four pre-trained models are available.

thanks a lot, and If I want change identity of the avatars, what should I can do ?

from audio2photoreal.

Closed as the guys above probably want to create new github issues to track

from audio2photoreal.