srcnalt / rpm-godot-sdk Goto Github PK

This is more of a future design discussion animation import pipeline
https://github.com/readyplayerme/animation-library

This existing RPM-Godot-SDK implementation has yet to integrate Godot4 Humanoid Retargeting template.

https://github.com/Malcolmnixon/GodotReadyPlayerMeAvatar/blob/e1b118c30a4cd13f882b95759c026a271ba16900/addons/godot_rpm_avatar/rpm_body.gd#L70
static func retarget(src_skeleton : Skeleton3D) -> void:

@Malcolmnixon

• What do you think in your view a preferred way to bring animation using codes to RPM avatar in Godot4.?
• How best we can repurpose the retarget code you have implemented to incoming animation: ?
  • RPM Animation Libray,
  • Blender (e.g. bvh)
  • Unity, and
  • Mixamo

We need a working demo using RPM-Godot-SDK to drive body motion and facial animation procedurally

Remi123/MotionMatching#31 (comment)

• rpm-unity-sdk-core

Once there is a growth in the usage of RPM in Godot4, there may be a need for the avatar creator and customization in Godot4.

• RPM-Smart-NPC

Right now, we have OpenAI (TTS, STT) addons in Godot4, demonstrating it with more advanced features are feasible

• How to sync a Ready Player Me avatar over the network, with coherence
• metapress-plugin-rpm

We now have Godot4 RPM addon

• ReadyPlayerMe_BodyTracking
  https://youtu.be/puLAC1DB_nQ
  

• RPM TalkingHead

This is high in priority (in my view), next after having Godot4 RPM addon
We have Godot4 Mediapipe with c# wrapper with complete FacialLandmark captures which could be used to drive facial animation
However, what is demonstrated here is still missing in Godot4. A more complex text to lipsync that is worth evaluating.
Alignment with Text2Speech with lipsync and facial expression

• Multiple-Full-Body-Tracking-With-Fully-customizable-Avatar-Using-ZED-2i-Camera

Now it is possible to stream multiple different animation providers to RPM in Godo4