rhubarb-crumble's Introduction

rhubarb crumble

This is just a wrapper around other smart tools. rhubarb-lip-sync is a tool for generating a sequence of mouth shapes for a given audio file (and transcript). This tool takes rhubarb's output, converts it into ffconcat instructions, and sends this to ffmpeg to output a video made up of still mouth shape images, accompanied by the original audio track.

Dependencies

ffmpeg installed globally
A local copy of rhubarb (https://github.com/DanielSWolf/rhubarb-lip-sync)
A .wav audio file of speech
A plain text transcript of this speech

Configuration

Place the rhubarb executable for your system inside the /rhubarb directory and ensure the path to it in app.js is correct
(optional) add image sets to data/img/<shape-name>/<shape>.jpg – or use the built in ones (taken from rhubarb)

Usage

Generate an animation video from the default images:

node app.js -t speech.txt -s speech.wav -o out.mp4

Specify a custom set of shape images:

node app.js -t speech.txt -s speech.wav -o out.mp4 -i shape-name

Skip the extended shapes (see rhubarb docs):

node app.js -t speech.txt -s speech.wav -o out.mp4 --skipExtended

rhubarb-crumble's People

Contributors

Stargazers

Watchers

rhubarb-crumble's Issues

getting Error: spawn ./rhubarb/rhubarb ENOENT

clone project
make clone https://github.com/DanielSWolf/rhubarb-lip-sync/ and rename rhubarb-lip-sync to rhubarb
add speech.txt and speech.wav file into cloned project
run npm i
then run node app.js -t speech.txt -s speech.wav -o out.mp4

but getting error like that:

0. About to begin... brace yourself
node:events:491
      throw er; // Unhandled 'error' event
      ^

Error: spawn ./rhubarb/rhubarb ENOENT
    at Process.ChildProcess._handle.onexit (node:internal/child_process:285:19)
    at onErrorNT (node:internal/child_process:485:16)
    at processTicksAndRejections (node:internal/process/task_queues:83:21)
Emitted 'error' event on ChildProcess instance at:
    at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12)
    at onErrorNT (node:internal/child_process:485:16)
    at processTicksAndRejections (node:internal/process/task_queues:83:21) {
  errno: -4058,
  code: 'ENOENT',
  syscall: 'spawn ./rhubarb/rhubarb',
  path: './rhubarb/rhubarb',
  spawnargs: [
    'speech.wav',
    '--dialogFile speech.txt',
    '--exportFormat json',
    '--quiet',
    '--extendedShapes',
    'GHX'
  ]
}

Recommend Projects