Code Monkey home page Code Monkey logo

inpainter's Introduction

๐ŸŽจ Inpainter

A web GUI for inpainting with Stable Diffusion using the Replicate API.

Try it out at inpainter.vercel.app

cherries-oranges-bananas.mp4

How it works

๐Ÿข๐Ÿš€ This is a Node.js app! It's powered by:

Development

Prerequisites:

  1. Recent version of Node.js
  2. Replicate API token

Set your Replicate API token in your environment:

REPLICATE_API_TOKEN=<your-token-here>

Then install dependencies and run the server:

npm install
npm run dev

Open http://localhost:3000

inpainter's People

Contributors

bfirsh avatar parentzap avatar zeke avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

inpainter's Issues

Compression artifacts after each generation

Each time you inpaint the quality of the whole image drops
this is an example, before and after inpainting 4 times (to make the effect clear)

edit: i was only masking a small area on the right where the frame changed

out-0
out-0

make sure masks are working as expected

As of last night, the Replicate API no longer returns data URLs from prediction input. This makes it a bit challenging to see the mask that was supplied with the request.

One alternative would be to upload the data URL to GCS/S3/something and then use that HTTPS url in the prediction request.

Quick question about model used

Hi,

I was just trying to see what model you use - it looks like you have a link that points to stable diffusion, but I was a bit confused since stable diffusion generally does text-to-image without a mask. Is it a specific variant of sd/sdxl that does inpainting like this one?

Regards,
Surya

allow user to upload init image

you can currently start the design process with a prompt, but it would be cool if you could also supply a starting image by dragging and dropping it onto the page.

We might want to do something fancy with the supplied image to make the user-supplied image fit the 512x512 constraint. ๐Ÿค”

gracefully handle failures and NSFW responses

The UI should make it clear to the user when a result fails due to a NSFW response, or maybe even run the same query again until a successful response is returned.

The Stability AI team is slowing working on improving NSFW detection, but the current version still flags a bunch of false positives.

How to add my API?

Sorry to ask this, but can someone tell me exactly where to place my API token?

Thanks

Errors bringing up inpainter to use against the Replicate API

Error related to *.replicate.delivery image host pattern - the images are not returned to the user from the API, when a simple following of the instructions is undertaken. Upgrading to the next minor release of next solves it.

I also noticed an error in the log output that mentions an unknown property clasName - I'll submit a PR to fix all these!

Invalid token.

I get an "Invalid token." error when I try and use the app after I deploy it online?

run API on my own code

Hi,

Thank you for your good work, is it possible for me to use painting API on my own code, not on the web page?

Best regards

improve mask UI

The current "eraser" draws a black blob on the prediction image:

Screen Shot 2022-08-31 at 2 03 18 PM

It would be nice to make the erasing reveal the classic grey-and-white checkboard, ร  la Photoshop and DallE 2.

add download button

The current implementation embeds the prediction output image as a CSS background, making it difficult to download the image.

Let's add a download button.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.