Comments (4)
What am i doing wrong here !!! ? Why i can't i get image to prompt, i also tried with other models i can only get txt2image work
You're using the wrong assistant. IF_PromptMKR is an assistant for text to image. IF_PromptMKR_IMG should be used for image to text. You can look here to see what each assistant does:
https://github.com/if-ai/ComfyUI-IF_AI_tools/blob/main/presets/assistants.json
from comfyui-if_ai_tools.
What am i doing wrong here !!! ? Why i can't i get image to prompt, i also tried with other models i can only get txt2image work
As @ThomasRoyer24 said but besides that it looks like you have the image still muted I muted it by default and there is a note over it saying you need to select the node and press CTRL+M to unmute also for working with images you need a multimodal model like llava, moondream or use the anthropic APIs I like haiku a lot and gpt4-o is also very strong. but in ollama and textgen you need a moondream or llava-llama3 or llava base models
from comfyui-if_ai_tools.
Thank you very much for your comments and instructions, it's highly appreciated really, i also downloaded LLaVA 3 and the result are really impressive i will try the other models you mentioned, but i'm surprised you can also use gpt4-o already i thought it's not accessible at the moment, i will also check that out
from comfyui-if_ai_tools.
@if-ai May i ask why moondream doesn't get me any results do i need to change some parameters? other models (such as llava-llama3) using the same parameters worked very well, thank you in advance.
from comfyui-if_ai_tools.
Related Issues (20)
- 作者这里的路径是不是写错了,导致IFChatPromptNode无法加载,改了以后就正常了 HOT 2
- missing files? HOT 1
- IFChatPromptNode not found HOT 1
- it's not working HOT 1
- Omost tool doesn't work HOT 4
- An error occurred while retrieving information for the 'IF_ChatPrompt' node. Traceback (most recent call last): HOT 2
- No attribute "Keys" HOT 1
- is it a bug?
- why the result so different? HOT 1
- [ERROR] An error occurred while retrieving information for the 'IF_ChatPrompt' node. HOT 1
- system's content is blank HOT 1
- running error after update. HOT 3
- IF Chat Node error HOT 2
- question: how to generate new prompt every time
- Max tokens doesn't work
- Error: Unexpected response format - {"error": "option \"temperature\" must be of type float32"} HOT 6
- Even if the seed changes, i got always same prompt output ?
- OpenAi/Claude: where to save api to call model? HOT 1
- openai api call does not work
- RAG system for Winders version
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from comfyui-if_ai_tools.