mikeknapp / candy-machine Goto Github PK

"one-piece swimsuit" seems to trigger a KeyError.

On a side note, it would be nice to have WD auto tagging as optional as it doesn't suit every dataset.

[2024-06-12 15:16:28,877] ERROR in app: Exception on /project/test/get [POST]
Traceback (most recent call last):
File "I:\Tools\candy-machine\candy-machine-main\venv\lib\site-packages\flask\app.py", line 1473, in wsgi_app
response = self.full_dispatch_request()
File "I:\Tools\candy-machine\candy-machine-main\venv\lib\site-packages\flask\app.py", line 882, in full_dispatch_request
rv = self.handle_user_exception(e)
File "I:\Tools\candy-machine\candy-machine-main\venv\lib\site-packages\flask_cors\extension.py", line 178, in wrapped_function
return cors_after_request(app.make_response(f(*args, **kwargs)))
File "I:\Tools\candy-machine\candy-machine-main\venv\lib\site-packages\flask\app.py", line 880, in full_dispatch_request
rv = self.dispatch_request()
File "I:\Tools\candy-machine\candy-machine-main\venv\lib\site-packages\flask\app.py", line 865, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return]
File "I:\Tools\candy-machine\candy-machine-main\server\main.py", line 85, in get_project
project = Project(project_name)
File "I:\Tools\candy-machine\candy-machine-main\server\project.py", line 68, in init
self._load()
File "I:\Tools\candy-machine\candy-machine-main\server\project.py", line 132, in _load
self.auto_tags = self._get_filtered_auto_tags(self.project_layout)
File "I:\Tools\candy-machine\candy-machine-main\server\project.py", line 450, in _get_filtered_auto_tags
tag_info.to_dict() for tag_info in self._analyze_auto_tags()
File "I:\Tools\candy-machine\candy-machine-main\server\project.py", line 500, in _analyze_auto_tags
del tags[tag]
KeyError: 'one-piece swimsuit'

I have used cogvlm v7 (through a guy on patreon) to caption 120,000 images and itndies a very good job, it does it even on some uncensored photos (in detail) if I use a special prompt with English and Chinese characters. I also found internlm-xcomposer2-vl-7b to be pretty good but seemed a bit more censored.

Would love to see these two models added.l as options to this repo. Also not sure if this is just sci-fi yet. But an ability fir a clip vision to follow directions such as in certain scenarios if the image will not crop to 1024x1024 without cutting out the subject to put black bars on the left and right side (poor man's masking) and always worked well for me as long as most if the dataset wasn't like this.

In scenarios when it's a full body shot and the subject is next to someone to "crop the image so that the entire person is in view and any other person is not, move then to the side of the image"

Maybe you could have a ling context for certain scenarios and have the ai/clipvision follow your preset rules for cropping.

Ps. Sd3 dataset was captioned using 50 percent cogvlm. I had no issues running on my 4090 but I forgot how many parameters this one was. I believe it may have been thudm--cogvlm-chat-hf

Over at /r/Open_Diffusion (Thread here ) a group of people are trying to build an open source dataset with the eventual goal of training a high quality model with an open source license. Since Candy Machine is gradio based, I thought it might be used for a web based tagger. So I have some questions for you:

• Is this something you'd be OK with someone else doing?
• Would you be open to making modifications to Candy Machine?
• Can Candy Machine support multiple users, possibly working on the same image?
• In what formats can Candy Machine read existing tags?

I don't want to put a pile of work on you. We have several coders who have experience with webdev who might be able to send pr's your way. Does this sound like something you'd be willing to help with?