Code Monkey home page Code Monkey logo

Comments (1)

YuanxunLu avatar YuanxunLu commented on July 21, 2024

At first, all three models: Audio2Feature, Audio2Headpose, and Feature2Face should be re-trained for any new data.
Other Questions:
1 2d landmarks: 73 points landmarks detector is not open-source, it is a closed-source tool developed by the company. Common used landmarks detectors like face_alignment (68 points) is also work but you need to change the landmarks' semantic settings.
2.1 Yes.
2.2 Actually I didn't do any normalized on tracked 3d points. Sry for that the name of the file 'tracked3D_normalized_pts_tracked3D_normalized_pts_fix_contour.npy' may mislead your way (if you checked the data carefully). The only difference is that I fix the face contour points in the latter file. Contour here means that I fix the contour indices for the reconstruction results. This is about another area about 3D face model tracking. In a word, I fixed the contour indices instead of using sliding contour indices found during the tracking. (If you are familiar with this area, you will understand it quickly).
2.3 3d landmarks are the object coordinates of the face model, i.e., facewarehouse in this project. There is no relationship to the image or something else, it is just the tracked face coordinates of the face model. As illustrated in the paper, I tracked the face on the original resolution. However, our desired results need to cut&crop&resize the image, therefore, 'scale, xc, yc' and other parameters denote the cut&crop&resize parameters. I need these parameters to transform the tracking results& camera parameters to fit the desired results (that is about resolution, face location, etc.)
2.4 'tracked2D_normalized_pts_fix_contour.npy' contains the transformed tracked 2d facial landmarks of the training data. Also sorry for the 'normalized' may mislead your way. Here, using 'transformed' is a better choice. It lies on the image coordinates (512x512).

About the training, please check issue #19. Here I don't illustrate it again. Hope for your understanding.

from livespeechportraits.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.