what makes such lightweight backbone works so well? about 3ddfa_v2 HOT 11 OPEN

If it's not for the data, it can even be done more finely, and this method is the best solution so far.

from 3ddfa_v2.

If it's not for the data, it can even be done more finely, and this method is the best solution so far.

so,how we can generate high quality data for better result?fix the landmarks error in 300w data(like eyes) or rebuild a 3dmm model to replace bfm model?

from 3ddfa_v2.

If it's not for the data, it can even be done more finely, and this method is the best solution so far.

so,how we can generate high quality data for better result?fix the landmarks error in 300w data(like eyes) or rebuild a 3dmm model to replace bfm model?

You can improve from the following directions:

1. Use better face shape models and expression models, such as BFM2019, but you need to find the keypoints of the face from many vertices. I use the BFM2009 model.
2. Use better 2D keypoint models.
3. Use a better 3DMM model, I use the 3DDFA model.
4. Consider the face data balance of various Euler angles when making the face profile.
5. To solve the problem of poor performance with eyes open and closed, you can consider using StyleGAN2 and InterFacegan to synthesize face data with eyes closed.

from 3ddfa_v2.

I used resnet50 instead of mobilenet_V1, but strangely, the results were worse. Why is such a simple model better?

from 3ddfa_v2.

@chengfeng0113 what is BFM model? I am newly attached to this field. And How should I do to systhesis short video like 3ddfa_v2 paper?

from 3ddfa_v2.

@chengfeng0113 what is BFM model? I am newly attached to this field. And How should I do to systhesis short video like 3ddfa_v2 paper?
Regarding the BFM model, you can refer to BFM. Oh ha, I also want to know how to synthesize short videos online, I can only use FaceProfiling to synthesize faces with continuous changes in Euler angles offline.

from 3ddfa_v2.

@chengfeng0113 so after face profiling, the image boundary appears "zero" pixel ? I notice that in 3ddfaV1, face profiling will make "zero" pixel at image boundary. But in 3ddfav2, as author shows, there is no "zero" pixel.

from 3ddfa_v2.

@chengfeng0113 and do you know what is "tri"? I am not familiar with this field. thank you.

from 3ddfa_v2.

do you know how to generate the 3D render picture with color?
thanks.
@chengfeng0113

from 3ddfa_v2.

i have try resnet-22 for reconstruction, but it's worse than your gif which put on the github? especially the mouth always open. can you tell me why? if you did something different from you public data?

from 3ddfa_v2.

i have try resnet-22 for reconstruction, but it's worse than your gif which put on the github? especially the mouth always open. can you tell me why? if you did something different from you public data?

@cleardusk

from 3ddfa_v2.