Code Monkey home page Code Monkey logo

double_talker's Introduction

Langzizhixin Wanderer's Heart Technology

Double_Talker

This code is only used to demonstrate the loop driven dual digital human on the same screen, coupled with a framework for post processing ultra division. The code uses a WAv2lip loop to drive a dual digital human on the same screen, train a high-definition model, perform streaming processing, strengthen hardware, and do not perform post processing. It can be used for real-time live streaming of dual digital humans. It is also possible to replace WAv2lip with other digital human driven projects based on this framework. Among them, videos 1-6 are pre recorded silent videos for two people, and audio 1-6 is pre prepared speaking audio.

  1. Upload the recorded dual video materials and audio separately to the temp in advance_ Video and input_ Audio.
  2. The recording of this dual digital human material is crucial, as is the audio and video cutting.
  3. The video processing speed is directly related to the GPU performance. If live streaming is required, it is necessary to perform streaming processing and use high-performance GPUs.
  4. CodeFormer has a slow speed in supergrading, and those who do not have high requirements for digital human videos can skip supergrading or switch to GFPGAN for supergrading.
  5. Variables are not used in the code, you need to write them yourself.

Inference

Please click on the Colab link below to inference.

Open In Colab


Useful links:

https://github.com/sczhou/CodeFormer

https://github.com/Rudrabha/Wav2Lip


Project made by Lu Rui from Langzizhixin Technology company in Chengdu, China.

Code 2023

double_talker's People

Contributors

langzizhixin avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.