Code Monkey home page Code Monkey logo

human's Introduction

Unity 数字人

这个版本数字人是我从 https://kz88.us 主要的剥离出来 开发一个开源版本(windows)

效果

动力支持

介绍

数字人采用URP渲染管线开发,支持所有平台发布
采用Unity2022.3.31版本开发
开箱即用,任何人可以再此项目扩展开发
参考视频:https://www.bilibili.com/video/BV1YJ4m1T7Rj?t=2.7

软件架构

用户麦克风输入->语音识别->拿到语音识别结果->LLM大语言模型->拿到回答内容->提交TTS合成->拿到语音->音字同步
语音识别:采用流式语音识别
语音合成:采用一键式合成,LLM大语言模型内容分段提交
LLM:支持网上任何一款大模型API接口,如豆包、智谱、Kimi等等...
LipSync:采用uLipSync 嘴唇同步,支持多平台

安装教程

建议使用2022版本及以上进行开发,否则URP管线的包体需要自行处理报错问题

使用说明

LLM大模型需要开发者自行配置
Resources/LLMConfig
LLM配置
Url : 对接大语言模型的http地址
Model:对接大语言模型应用那个模型(如chatgpt3.5)
Key:大语言模型的授权密钥
RoleSetting:(非必填)进行LLM System预设,让它站在某一个人或者某一些信息上回答问题

与Fay结合使用

Fay数字人开源框架地址:https://github.com/xszyou/fay

img

url:http://127.0.0.1:5000/v1/chat/completions

model:fay-streaming

运行包:https://pan.baidu.com/s/1qHq5KdZ8QujO2TL9sWl-QA?pwd=kjit

加入知识交流群

作者微信
加作者微信邀请入群

动力支持

动力支持
如果觉得项目有用,或者能帮到你,给作者一杯奶茶钱吧,你的支持是我更新的动力!

human's People

Contributors

lkzmuzili avatar xszyou avatar yidofx avatar

Stargazers

 avatar  avatar  avatar Kanosss avatar zyxucp avatar Biny avatar Antasann avatar vx58867 avatar Lobands avatar  avatar  avatar  avatar  avatar 芯芒 avatar Fan Zhang avatar You avatar  avatar  avatar  avatar  avatar cuckoo2016 avatar  avatar Cirmaster avatar  avatar Jack Ling avatar  avatar systemime avatar  avatar  avatar  avatar  avatar  avatar  avatar wangtianlang0912 avatar 小马 avatar Li avatar  avatar Allen Juns  avatar ghgao avatar  avatar RiverRouter avatar  avatar  avatar 汪浩 avatar TFun avatar luoxiyang avatar xiao avatar hyDONG avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar lobtao avatar  avatar HuFeiHu avatar linyuan avatar  avatar ZouXianyin avatar andyxq avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar tangmuahu avatar 郑一诺她爸 avatar  avatar  avatar Tismagic avatar dont-sleep-so-late avatar LonLab avatar stone avatar  avatar Agueda Cassin avatar Winlone囧v avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.