Code Monkey home page Code Monkey logo

live_lipsync_examples's Introduction

LIVE Runtime Lipsync in Unity

uLipSync is the most underrated lipsync plugin EVER. I'm trying to change that right now! In this tutorial video, I'm going to show you how to use uLipSync plugin by hecomi.

This project contains both 3D and URP project already installed with UniVRM and URP Shader. This project is made with Unity version 2022.2.17f1. Earlier version of Unity might not work.

Huge credit to these guys who made this possible!

Tutorial Video

Here are some explanations how to use or create this project in a video form:

FREE Lipsync plugin that EVERYONE should use!

Instructions

Once you download and extract the zip file or clone the project to your Git application, open it in Unity Hub. This project uses Unity version 2022.2.17f1, earlier versions of Unity might not work, and later versions might break some of the scripts. To download a specific version of Unity, go to this website https://unity3d.com/get-unity/download/archive.

After you download and install the Unity version, you can add this version of Unity back to Unity Hub and open it. Once the project is opened, don't forget to double click the Scene file in the Project Window.

Adding Mouth Blendshapes

In the tutorial video, I mentioned adding in extra mouth blendshapes. You can either do this manually with NEBPro or NEBLite. You're looking to copy these three mouth blendshapes from Extra Mouth Blendshapes.vrm file:

You can get either of them on my Ko-Fi page:

I've made a separate tutorial for NEBLite and NEBPro here:

FREE HanaTool Alternative!

Switching Between Models

Once you have set up the Profile like in the video, you don't need to set it up again for a new character model. You can just drag the profile into your uLipSync component.

Of course, you still have to follow the initial steps in the new character model as well, like adding Lipsync child gameobject, Audio Source component, uLipSync component, and uLipSyncBlendshape component. But you can keep reusing the Profile for every character.

Support me on Ko-Fi or Patreon

If this tutorial helps you, consider supporting me on these platforms. I would like to do more tutorials in the future!

Got any questions?

Encounter any weird bugs or problems? Let's talk about it on our Discord server forums:

live_lipsync_examples's People

Contributors

reforge-mode avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.