cbh123 / charl-e Goto Github PK

View Code? Open in Web Editor NEW

527.0 527.0 19.0 4.96 MB

Run Stable Diffusion on your M1 Mac

License: MIT License

JavaScript 8.19% TypeScript 89.19% Shell 1.54% CSS 0.74% EJS 0.34%

charl-e's People

Contributors

Stargazers

Watchers

Forkers

5gapp uakbr alexiscreuzot hbcbh1999 jeffslofish matteliot sethforsgren aranibatta ojasuno king-sid shaun95 soneymathew matthiasg 2refocus jpjohnson chhaviilli willforcoding davidajohnston studiovc

charl-e's Issues

Error during sampling

Hi, I installed the app from https://www.charl-e.com/ on my macbook pro with the M1 chip, and downloaded the weights. When trying to generate an image for the first time, I got the following error during sampling. Seems like there are some unrecognized arguments to txt2img. There are also other warnings whcih look harmless. Any suggestions as to how this could be resolved?

usage: txt2img [-h] [--prompt [PROMPT]] [--outdir [OUTDIR]] [--skip_grid] [--skip_save] [--ddim_steps DDIM_STEPS] [--plms] [--laion400m] [--fixed_code] [--ddim_eta DDIM_ETA] [--n_iter N_ITER] [--H H] [--W W] [--C C] [--f F] [--n_samples N_SAMPLES] [--n_rows N_ROWS] [--scale SCALE] [--from-file FROM_FILE] [--config CONFIG] [--ckpt CKPT] [--seed SEED] [--precision {full,autocast}] txt2img: error: unrecognized arguments: -B -S -E -s -c from multiprocessing.resource_tracker import main;main(8)
transformers/models/clip/feature_extraction_clip.py:204: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
transformers/image_utils.py:188: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead. transformers/models/clip/feature_extraction_clip.py:67: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x17fb6f6d0>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.")
torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x17fb6f520>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.")
torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
[6726] WARNING: file already exists but should not: /var/folders/7w/0kc1g1ls7433kzx857kfhzfw0000gn/T/_MEISbBy9u/torch/_dl.cpython-310-darwin.so
[6726] WARNING: file already exists but should not: /var/folders/7w/0kc1g1ls7433kzx857kfhzfw0000gn/T/_MEISbBy9u/torch/_C_flatbuffer.cpython-310-darwin.so
[6726] WARNING: file already exists but should not: /var/folders/7w/0kc1g1ls7433kzx857kfhzfw0000gn/T/_MEISbBy9u/torch/_C.cpython-310-darwin.so
[6726] WARNING: file already exists but should not: /var/folders/7w/0kc1g1ls7433kzx857kfhzfw0000gn/T/_MEISbBy9u/pyarrow/lib.cpython-310-darwin.so
Sampling: 0%| | 0/1 [00:00<?, ?it/s] data: 0%| | 0/1 [00:00<?, ?it/s]�[A

Feature reqest: Adding img2img feature

First, thank you for maintaining this project, this project is really interesting. I spent a whole day trying out various stable diffusion prompts with this app.

One thing that bothers me is small imperfection from the output images. I believe running the txt2img output result through few img2img cycles can improve the result significantly. Do you have any plans to add img2img feature to this app, or maybe including a img2img binary inside the app without GUI to allow power users to tinker with the original program without setting up the painful development environment?

Seems like the seed number is ignored

Expected Behavior

Having the same parameters configured and the same prompt, the image should be the same all the time. Using the seed number should make this image generation deterministic.

Current Behavior

With the same parameters configured and the same prompt, every time the "generate" button is clicked a totally different image is generated.

Context

It's impossible to tinker an image if the image changes completely every time the image is generated.

PD: Thanks for this project, it's amazing!

NPM Install fails

Prerequisites

[O] Using npm
[O] Using an up-to-date main branch
[O] Using latest version of devtools. Check the docs for how to update
[O] Tried solutions mentioned in #400
[O] For issue in production release, add devtools output of DEBUG_PROD=true npm run build && npm start

Expected Behavior

When running npm install right after git clone, the install should not fail.

Current Behavior

npm install fails when it reaches the postinstall script.

Steps to Reproduce

There are two problems I have encountered:

First, when I run npm install, it installs dependencies and runs the postinstall script, at which point the script fails, complaining about the lack of "type": "module" declaration:

> [email protected] postinstall
> ts-node .erb/scripts/check-native-dep.js && electron-builder install-app-deps && cross-env NODE_ENV=development TS_NODE_TRANSPILE_ONLY=true webpack --config ./.erb/configs/webpack.config.renderer.dev.dll.ts

(node:37969) Warning: To load an ES module, set "type": "module" in the package.json or use the .mjs extension.
(Use `node --trace-warnings ...` to show where the warning was created)
/Users/XXX/Projects/charl-e/.erb/scripts/check-native-dep.js:1
import fs from 'fs';
^^^^^^

SyntaxError: Cannot use import statement outside a module
    at Object.compileFunction (node:vm:360:18)
    at wrapSafe (node:internal/modules/cjs/loader:1048:15)
    at Module._compile (node:internal/modules/cjs/loader:1083:27)
    at Module._extensions..js (node:internal/modules/cjs/loader:1173:10)
    at Object.require.extensions.<computed> [as .js] (/Users/XXX/Projects/charl-e/node_modules/ts-node/src/index.ts:1608:43)

I don't know how this is working on your machine but I assume you have to put "type": "module" in package.json so I added it and tried running npm install again.

But now I have a second issue:

> ts-node .erb/scripts/check-native-dep.js && electron-builder install-app-deps && cross-env NODE_ENV=development TS_NODE_TRANSPILE_ONLY=true webpack --config ./.erb/configs/webpack.config.renderer.dev.dll.ts

TypeError [ERR_IMPORT_ASSERTION_TYPE_MISSING]: Module "file:///Users/XXX/Projects/charl-e/package.json" needs an import assertion of type "json"

In this case I thought this was because you're using some edge node.js version that supports features not supported by stable version, so I even tried updating my node.js version to the latest 18.9.0 and ran the command again, but it still fails with the same error.

My questions are:

How are you able to use the import syntax without specifying the "type": "module" inside package.json? And do we need to add that line in the package.json file?
Even after adding the module declaration I can't get it to work, how can I just run npm install without failing?
Are there any other things I need to keep in mind when building locally?

Context

How has this issue affected you?: I wanted to build the project locally and potentially contribute
Did you make any changes? No

Your Environment

Node version : tried both 16.17.0 and 18.9.0
electron-react-boilerplate version or branch: I just cloned the exact same code here and ran
Operating System and version : Mac OS Monterey 12.5.1

Picture bounce due to shining stars

Prerequisites

Using npm
Using an up-to-date main branch
Using latest version of devtools. Check the docs for how to update
Tried solutions mentioned in #400
For issue in production release, add devtools output of DEBUG_PROD=true npm run build && npm start

Expected Behavior

Picture should not bounce.

Current Behavior

Picture bounce if window is too small, typically at macBook's internal display.

Screen.Recording.2022-09-19.at.08.29.46.mov

Steps to Reproduce

Generate picture
Wait for that grand finale effect
Scroll down

Possible Solution (Not obligatory)

Remove shining stars
Add some padding to the bottom

Context

Your Environment

Node version :
electron-react-boilerplate version or branch :
Operating System and version :
Link to your project :

Ultra slow first launch?

Summary

I downloaded from https://www.charl-e.com/ moved to applications and tried to launch, and the app icon just bounced for a few minutes and then stopped. No window opened or anything.

Macbook Pro, M1 Pro, 8C 14G 16GB, v0.0.6

UPDATE: It's been 12 minutes since I posted this issue. I'm going to call it and say it doesn't open.

Changing default path doesn't update gallery images

I've changes the default path from the Desktop too my Pictures folder but although the existing prompts are shows in the gallery the images are not.

When I create a new image from a prompt it's correctly saved in the samples directory so I know the path is correct.

Adding extra commands, or running txt2img in command line

Hello,
Awesome to be able to install txt2img on Mac this easy! Great job!

mid ut possible to add other txt2img commands directly in the prompt field?

or running txt2img through terminal?

Running latest macos on a m1 pro max 64gb MacBook

negative prompts?

is there a way to pass negative prompts into the text input?

Doesn't generate image

Prerequisites

Using the release 0.0.5 (which still shows as v0.0.3 in the logs btw)

Expected Behavior

Should generate an Image

Current Behavior

Displays Error Detected! Please check the logs.

Logs:

0
Logs
\
Options
?
CHARL-E v0.0.3

19:57:34

usage: txt2img [-h] [--prompt [PROMPT]] [--outdir [OUTDIR]] [--skip_grid] [--skip_save] [--ddim_steps DDIM_STEPS] [--plms] [--laion400m] [--fixed_code] [--ddim_eta DDIM_ETA] [--n_iter N_ITER] [--H H] [--W W] [--C C] [--f F] [--n_samples N_SAMPLES] [--n_rows N_ROWS] [--scale SCALE] [--from-file FROM_FILE] [--config CONFIG] [--ckpt CKPT] [--seed SEED] [--precision {full,autocast}] txt2img: error: unrecognized arguments: -B -S -E -s -c from multiprocessing.resource_tracker import main;main(11)
transformers/models/clip/feature_extraction_clip.py:67: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead. transformers/models/clip/feature_extraction_clip.py:204: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
transformers/image_utils.py:188: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x29386b6d0>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.")
torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x29386b520>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.")
torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
Failed to execute script 'txt2img' due to unhandled exception!
[83539]
Traceback (most recent call last): File "PIL/Image.py", line 2298, in save KeyError: '' The above exception was the direct cause of the following exception: Traceback (most recent call last):
data: 100%|██████████| 1/1 [00:04<00:00, 4.96s/it]�[A data: 100%|██████████| 1/1 [00:04<00:00, 4.96s/it] Sampling: 100%|██████████| 1/1 [00:04<00:00, 4.96s/it] Sampling: 100%|██████████| 1/1 [00:04<00:00, 4.96s/it]
PLMS Sampler: 100%|██████████| 5/5 [00:04<00:00, 1.41it/s]�[A�[A PLMS Sampler: 100%|██████████| 5/5 [00:04<00:00, 1.17it/s]
PLMS Sampler: 80%|████████ | 4/5 [00:03<00:00, 1.26it/s]�[A�[A
PLMS Sampler: 60%|██████ | 3/5 [00:03<00:01, 1.15it/s]�[A�[A
[83580] WARNING: file already exists but should not: /var/folders/d9/yx7f4q2j4wj3z6ld97kpssnc0000gn/T/_MEIHLbnro/torch/_dl.cpython-310-darwin.so
[83580] WARNING: file already exists but should not: /var/folders/d9/yx7f4q2j4wj3z6ld97kpssnc0000gn/T/_MEIHLbnro/torch/_C_flatbuffer.cpython-310-darwin.so
[83580] WARNING: file already exists but should not: /var/folders/d9/yx7f4q2j4wj3z6ld97kpssnc0000gn/T/_MEIHLbnro/torch/_C.cpython-310-darwin.so
PLMS Sampler: 40%|████ | 2/5 [00:02<00:03, 1.12s/it]�[A�[A
PLMS Sampler: 20%|██ | 1/5 [00:01<00:07, 1.86s/it]�[A�[A
[83580] WARNING: file already exists but should not: /var/folders/d9/yx7f4q2j4wj3z6ld97kpssnc0000gn/T/_MEIHLbnro/pyarrow/lib.cpython-310-darwin.so
PLMS Sampler: 0%| | 0/5 [00:00<?, ?it/s]�[A�[A
transformers/models/clip/modeling_clip.py:657: UserWarning: The operator 'aten::index.Tensor' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/work/pytorch/pytorch/pytorch/aten/src/ATen/mps/MPSFallback.mm:11.)
data: 0%| | 0/1 [00:00<?, ?it/s]�[A
Sampling: 0%| | 0/1 [00:00<?, ?it/s]
``m
## Steps to Reproduce

<!-- Add relevant code and/or a live example -->
<!-- Add stack traces -->

1. Download v0.0.5

2. click Generate

## Your Environment

- M1 Max MacBook Pro 16" 64GB Ram.
- MacOS Montery v12.5.1

Can I clear my gallery?

Summary

Is it possible to clear my gallery?
After removing the generated images from disk, my gallery shows the prompt strings still. I believe these entries are stored locally and I'm unsure how to remove orphaned prompts.

Thanks!

Crash if the description exceeds 251 characters

Prerequisites

Using npm
Using an up-to-date main branch
Using latest version of devtools. Check the docs for how to update
Tried solutions mentioned in #400
For issue in production release, add devtools output of DEBUG_PROD=true npm run build && npm start

Expected Behavior

You should be able to enter a lengthy prompt, for example:

powerful dark matter mancer, dark soul 3, Extra-Wide Angle, 3d zbrush, trend on ArtStation, Realistic Lighting, Volumetric Lighting, dramatic, 8k, cinematic, super detailed, vfx, symmetrical face and body, full body portrait, cinematic lighting, hyperdetailed, detailed realistic symmetrical eyes, cinematic lighting, hyperdetailed, cgsociety, 8k, high resolution, noah bradley, Billelis, masamune shirow, katsuhiro Otomo, insanely detailed and intricate, dark, dramatic, powerful, poster, cinematic Lighting through volume, Style=render, highly detail render with octane, octane render, color black and gold, photorealistic

and have the image generate.

Current Behavior

Currently, the filename is saved as the description, with spaces replaced with dashes, and .png added to the suffix. If this filename exceeds 255 characters, the following error is thrown and the program halts:

OSError: [Errno 63] File name too long: '<filename here>[25502] Failed to execute script 'txt2img' due to unhandled exception!

Steps to Reproduce

Enter a description greater than 251 characters
Generate

Queue up several prompts

It might be nice to type in multiple prompts and have the ui generate them one after another. That way, I could try a bunch of things, go to lunch, come back and see them all. :)

Downloading weights...0%

Downloaded the Mac-App from the Website. Hanging at "Downloading weights...0%" on first run.

job queue

Hello,

Would it be possible that we add a job queue that lets you add queued generations, this way I can set it up with a days worth of prompts.

Thanks, this tech is incredible.

how do we rebuild txt2img?

Summary

(Pardon my ignorance, python isn't my main environment)
It looks like txt2img is a binary blob- I can't seem to find any build info or script (maybe I missed it?) for building it.

How can I rebuild it?

Thanks

Lot's of errors in the console — never goes past "Initializing"

system

macOS 12.5.1
M1 MAX (64GB)
charl-e 0.0.6

errors

errors like [84341] WARNING: file already exists but should not: /var/folders/s3/nryq86dj67154k8lx9k5v2ph0000gp/T/_MEIzzRWoc/torch/_dl.cpython-310-darwin.so

or transformers/models/clip/modeling_clip.py:657: UserWarning: The operator 'aten::index.Tensor' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/work/pytorch/pytorch/pytorch/aten/src/ATen/mps/MPSFallback.mm:11.)

full log: charle.log

experience

I never finished a render. Installed charl-e today and restarted charl-e a couple of times already. Only changed DDIM sampling to 36 before the first render.

Error detected! Won't run

Attempting to run charl-e on my M1 macbook pro and it fails to move past initialization.

Logs show:

usage: txt2img [-h] [--prompt [PROMPT]] [--outdir [OUTDIR]] [--skip_grid] [--skip_save] [--ddim_steps DDIM_STEPS] [--plms] [--laion400m] [--fixed_code] [--ddim_eta DDIM_ETA] [--n_iter N_ITER] [--H H] [--W W] [--C C] [--f F] [--n_samples N_SAMPLES] [--n_rows N_ROWS] [--scale SCALE] [--from-file FROM_FILE] [--config CONFIG] [--ckpt CKPT] [--seed SEED] [--precision {full,autocast}] txt2img: error: unrecognized arguments: -B -S -E -s -c from multiprocessing.resource_tracker import main;main(9)
transformers/models/clip/feature_extraction_clip.py:67: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead. transformers/models/clip/feature_extraction_clip.py:204: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
transformers/image_utils.py:188: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x168f6b520>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.") torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x168f6b6d0>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.")
torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
[2111] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEItcVSBe/torch/_dl.cpython-310-darwin.so
[2111] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEItcVSBe/torch/_C_flatbuffer.cpython-310-darwin.so
[2111] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEItcVSBe/torch/_C.cpython-310-darwin.so
[2111] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEItcVSBe/pyarrow/lib.cpython-310-darwin.so
multiprocessing/resource_tracker.py:104: UserWarning: resource_tracker: process died unexpectedly, relaunching. Some resources might leak.
RuntimeError: expected scalar type BFloat16 but found Float [2092] Failed to execute script 'txt2img' due to unhandled exception!
DDIM Sampler: 0%| | 0/5 [00:04<?, ?it/s] data: 0%| | 0/1 [01:19<?, ?it/s] Sampling: 0%| | 0/1 [01:19<?, ?it/s]
DDIM Sampler: 0%| | 0/5 [00:00<?, ?it/s]�[A�[A
usage: txt2img [-h] [--prompt [PROMPT]] [--outdir [OUTDIR]] [--skip_grid] [--skip_save] [--ddim_steps DDIM_STEPS] [--plms] [--laion400m] [--fixed_code] [--ddim_eta DDIM_ETA] [--n_iter N_ITER] [--H H] [--W W] [--C C] [--f F] [--n_samples N_SAMPLES] [--n_rows N_ROWS] [--scale SCALE] [--from-file FROM_FILE] [--config CONFIG] [--ckpt CKPT] [--seed SEED] [--precision {full,autocast}] txt2img: error: unrecognized arguments: -B -S -E -s -c from multiprocessing.resource_tracker import main;main(9)
transformers/models/clip/feature_extraction_clip.py:67: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead. transformers/models/clip/feature_extraction_clip.py:204: DeprecationWarning: BICUBIC is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BICUBIC instead.
transformers/image_utils.py:188: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x16b5fb520>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.") torch/_jit_internal.py:751: UserWarning: Unable to retrieve source for @torch.jit._overload function: <function _DenseLayer.forward at 0x16b5fb6d0>. warnings.warn(f"Unable to retrieve source for @torch.jit._overload function: {func}.")
torchvision/io/image.py:13: UserWarning: Failed to load image Python extension:
[2094] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEIBcxlVe/torch/_dl.cpython-310-darwin.so
[2094] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEIBcxlVe/torch/_C_flatbuffer.cpython-310-darwin.so
[2094] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEIBcxlVe/torch/_C.cpython-310-darwin.so
[2094] WARNING: file already exists but should not: /var/folders/nc/n0_cfz7n01bbqqj17x5g39xr0000gn/T/_MEIBcxlVe/pyarrow/lib.cpython-310-darwin.so

Not sure how to troubleshoot. Any help would be appreciated.

This is a dead project, right?

It's ok, you can tell us, we'll move on.

Thanks for the effort.

cbh123 / charl-e Goto Github PK

charl-e's People

Contributors

Stargazers

Watchers

Forkers

charl-e's Issues

Expected Behavior

Current Behavior

Context

Prerequisites

Expected Behavior

Current Behavior

Steps to Reproduce

Context

Your Environment

Prerequisites

Expected Behavior

Current Behavior

Steps to Reproduce

Possible Solution (Not obligatory)

Context

Your Environment

Summary

Prerequisites

Expected Behavior

Current Behavior

Summary

Prerequisites

Expected Behavior

Current Behavior

Steps to Reproduce

Summary

system

errors

experience

Recommend Projects

Recommend Topics

Recommend Org