Code Monkey home page Code Monkey logo

dough's Introduction

Welcome to Dough v. 0.8.3 (beta)

⬇️ Scroll down for Setup Instructions - Currently available on Linux & Windows, hosted version coming soon.

Dough is a tool for crafting videos with AI. Our goal is to give you enough control over video generations that you can make beautiful creations of anything you imagine that feel uniquely your own.

To achieve this, we allow you to guide video generations with precision using a combination of images (via Steerable Motion) examples videos (via Motion Director).

Below is brief overview and some examples of outputs:

With Dough, you can makes guidance frames using Stable Diffusion XL, IP-Adapter, Fooocus Inpainting, and more:

You can then assemble these frames into shots that you can granularly edit:

And then animate these shots by defining parameters for each frame and selecting guidance videos via Motion LoRAs:

As an example, here's a video that's guided with just images on high strength:

While here's a more complex one, with low strength images driving it alongside a guidance video:

And here's a more complex example combining high strength guidance with a guidance video strongly influencing the motion:

We're obviously very biased think that it'll be possible to create extraordinarily beautiful things with this and we're excited to see what you make! Please share stuff you made in our Discord.

Setup Instructions

Setting up on Runpod (click to expand)
  1. We recommend setting up persistent storage for a quick setup and for your projects to persist. To get it going, click into “Storage”, select “New Network Volume”. 50GB should be more than enough to start.

  2. Select a machine - any should work, but we recommend a 4090.

  3. During setup, open the relevant ports for Dough like below:

  1. When you’ve launched the pod, click into Jupyter Notebook:
  1. Follow the “Setup for Linux” below and come back here when you’ve gone through them.

  2. Once you’re done that, grab the IP Address for your instance:

Then form put these into this form with a : between them like this:

{Public ID}:{External Pair Value}

In the above example, that would make it:

213.173.108.4:14810

Then go to this URL, and it should be running!

Important: remember to terminate the instance once you’re done - you can restart it by following the instructions from step 3 above.

Instructions for Linux:

Install the app

This commands sets up the app. Run this only the first time, after that you can simply start the app using the next command.

curl -sSL https://raw.githubusercontent.com/banodoco/Dough/green-head/scripts/linux_setup.sh | bash

Enter the folder

In terminal, run:

cd Dough

Run the app

you can run the app using

source ./dough-env/bin/activate && ./scripts/entrypoint.sh

Instructions for Windows:

Open Powershell in Administrator mode

Open the Start menu, type Windows PowerShell, right-click on Windows PowerShell, and then select Run as administrator.

Install the app

Enter the folder

In Powershell, run:

cd Dough

Run the setup script

iwr -useb "https://raw.githubusercontent.com/banodoco/Dough/green-head/scripts/windows_setup.bat" -OutFile "script.bat"
Start-Process "cmd.exe" -ArgumentList "/c script.bat"

Run the app

. .\dough-env\Scripts\activate ; .\scripts\entrypoint.bat

If you're having any issues, please share them in our Discord.

dough's People

Contributors

piyushk52 avatar peteromallet avatar b34stw4rs avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.