heshengtao / comfyui_llm_party Goto Github PK

Dify in comfyui is compatible with Omost,ChatTTS,FLUX prompt generator,access to Feishu,discord,and adapts to all models with similar openai interfaces, such as ollama, qwen, GLM, deepseek, moonshot,doubao. Adapted to local models such as llama/ Peach-9B/qwen/GLM,Linkage neo4j KG，Implemented the function of graphRAG.Supports a variety of RAG.

License: GNU Affero General Public License v3.0

Python 99.66% Batchfile 0.03% JavaScript 0.31%

comfyui comfyui-nodes llm openai workflow stable-diffusion agent dify flowise macos

comfyui_llm_party's People

Contributors

Stargazers

Watchers

Forkers

ripperts bkjyyy yetokami asdlei99 samqin123 visionatrix nirviaje jtong haohaocreates jeyamir foxyear-kyumin thefenixfx linecode comfynodeprs evanssec denfrost yeyuxx comfynodeprs guobalove qabot-zh mars-wei linhong00316 worksync shengyu-meng charlessong darktamine ymg2007 buaalearn deepeye bobbyztz agougougoua sdwebui-extensions wf0x liweidiy cjcrazycool huangyuchuh shaneholloman stawils niko2020

comfyui_llm_party's Issues

请问API大语言模型节点，每次都要自动生成一次吗？能不能设置固定或者随机？

请问API大语言模型节点，每次都要自动生成一次吗？能不能设置固定或者随机？不然有时候我觉得生成的词不用改，只是想多跑几张图，他每次都要问一次AI，速度变慢还增加字数

ModuleNotFoundError: No module named 'server'

ComfyUI-Manager: EXECUTE => ['/home/Anaconda/anaconda3/envs/comfyui/bin/python', 'install.py']

[!] /home/ComfyUI/custom_nodes/comfyui_LLM_party/install.py:11: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
[!] import pkg_resources
[!] Traceback (most recent call last):
[!] File "/home/ComfyUI/custom_nodes/comfyui_LLM_party/install.py", line 14, in
[!] from server import PromptServer
[!] ModuleNotFoundError: No module named 'server'
install script failed: https://github.com/heshengtao/comfyui_LLM_party

安装报错，提示没有server模块，请问这个server模块是什么呢，通过pip server直接装，还是有特定的模块。

fastapi文件名与所导包的包名重名

问题：
按照文档 pip install -r requirements.txt 执行后，在comfyui也安装成功了

但是执行 fastapi.py 时提示 ImportError: cannot import name 'FastAPI' from partially initialized module 'fastapi'

解决方法：
修改自己的 fastapi.py 名称，不要与 from fastapi import FastAPI, HTTPException,Request, Depends 导包的 fastapi 就可以了,
估计是自定义的文件名与所导包的包名重名导致

requirements.txt is wrong?

Requestsxlrd maybe requests pypi and xlrd pypi?

failed to import dpkg

if you are using a arch based system and got this error:
/ComfyUI/custom_nodes/comfyui_LLM_party module for custom nodes: [Errno 2] No such file or directory: 'dpkg'

you can replace the function on line 329 in install.py in the comfyui_LLM_party folder with this function as a fix

def install_portaudio():
    try:
        if os.name == "posix":
            if sys.platform == "linux" or sys.platform == "linux2":
                result = subprocess.run(["cat", "/etc/os-release"], stdout=subprocess.PIPE, stderr=subprocess.PIPE, text=True)
                if "EndeavourOS" in result.stdout or "Arch" in result.stdout:
                    result = subprocess.run(["pacman", "-Q", "portaudio"], stdout=subprocess.PIPE, stderr=subprocess.PIPE)
                    if result.returncode != 0:
                        os.system("sudo pacman -Sy")
                        os.system("sudo pacman -S --noconfirm portaudio")
                    else:
                        print("portaudio is already installed.")
                else:
                    result = subprocess.run(["dpkg", "-s", "libportaudio2"], stdout=subprocess.PIPE, stderr=subprocess.PIPE)
                    if result.returncode != 0:
                        os.system("sudo apt-get update")
                        os.system("sudo apt-get install -y libportaudio2 libasound-dev")
                    else:
                        print("libportaudio2 is already installed.")
            elif sys.platform == "darwin":
                # macOS
                result = subprocess.run(["brew", "list", "portaudio"], stdout=subprocess.PIPE, stderr=subprocess.PIPE)
                if result.returncode != 0:
                    subprocess.check_call(["brew", "install", "portaudio"])
                else:
                    print("portaudio is already installed.")
        elif os.name == "nt":
            pass
        else:
            print("Unsupported operating system")
    except subprocess.CalledProcessError as e:
        print(f"Error installing PortAudio library: {e}")

something went wrong: Response does not contain codes!

got prompt
Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:44<00:00, 22.17s/it]
Some weights of the model checkpoint at /Users/alex/ComfyUI/models/omost were not used when initializing LlamaForCausalLM: ['model.layers.13.mlp.up_proj.weight.quant_map', 'model.layers.26.self_attn.q_proj.weight.nested_absmax', 'model.layers.10.self_attn.o_proj.weight.nested_quant_map',

- This IS expected if you are initializing LlamaForCausalLM from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing LlamaForCausalLM from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).

You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
'PreTrainedTokenizerFast' object has no attribute 'apply_chat_template'
!!! Exception during processing!!! Response does not contain codes!
Traceback (most recent call last):
  File "/Users/alex/ComfyUI/execution.py", line 151, in recursive_execute
    output_data, output_ui = get_output_data(obj, input_data_all)
  File "/Users/alex/ComfyUI/execution.py", line 81, in get_output_data
    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
  File "/Users/alex/ComfyUI/execution.py", line 65, in map_node_over_list
    results.append(getattr(obj, func)(**input_data_all))
  File "/Users/alex/ComfyUI/custom_nodes/comfyui_LLM_party/tools/omost.py", line 46, in notify
    canvas = omost_canvas.from_bot_response(text[0])
  File "/Users/alex/ComfyUI/custom_nodes/comfyui_LLM_party/lib_omost/canvas.py", line 134, in from_bot_response
    assert matched, 'Response does not contain codes!'
AssertionError: Response does not contain codes!

是否可以调用本地ollama接口

如果可以的话就太棒了，ollama管理模型，这应该是可以做到的，像comfyui ollama插件就是调用ollama的接口在comfyui中使用llm

非常不错的项目。能不能在此基础上，建立工作流库，实现通agent方式可以智能选择工作流执行？

TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

Using deterministic algorithms for pytorch
Total VRAM 11264 MB, total RAM 32509 MB
pytorch version: 2.3.1+cu121
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 2080 Ti : native
VAE dtype: torch.float32
Using pytorch cross attention
Adding extra search path checkpoints E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/Stable-diffusion
Adding extra search path configs E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/Stable-diffusion
Adding extra search path vae E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/VAE
Adding extra search path loras E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/Lora
Adding extra search path loras E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/LyCORIS
Adding extra search path upscale_models E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/ESRGAN
Adding extra search path upscale_models E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/RealESRGAN
Adding extra search path upscale_models E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/SwinIR
Adding extra search path embeddings E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/embeddings
Adding extra search path hypernetworks E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/hypernetworks
Adding extra search path controlnet E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/ControlNet
Adding extra search path controlnet E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/extensions/sd-webui-controlnet/models
Adding extra search path mmdets E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/mmdets/bbox
Adding extra search path ultralytics E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/ultralytics/bbox
Adding extra search path ultralytics E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/ultralytics/segm
Adding extra search path sams E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/sams
Adding extra search path seecoders E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/seecoders
Adding extra search path deepbump E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/deepbump
Adding extra search path insightface E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/insightface
Adding extra search path face_restore E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/face_restore
Adding extra search path FILM E:/AI/SD/webui/QiuYe/sd-webui-aki-v4.3/models/FILM

Import times for custom nodes:
0.0 seconds: E:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py
6.2 seconds: E:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_LLM_party

Starting server

To see the GUI go to: http://127.0.0.1:8188
got prompt
!!! Exception during processing!!! stat: path should be string, bytes, os.PathLike or integer, not NoneType
Traceback (most recent call last):
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_LLM_party\llm.py", line 831, in chatbot
self.tokenizer = AutoTokenizer.from_pretrained(tokenizer_path, trust_remote_code=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\transformers\models\auto\tokenization_auto.py", line 865, in from_pretrained
return tokenizer_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\transformers\tokenization_utils_base.py", line 2110, in from_pretrained
return cls._from_pretrained(
^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\transformers\tokenization_utils_base.py", line 2336, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator.cache\huggingface\modules\transformers_modules\tokenization_chatglm.py", line 109, in init
self.tokenizer = SPTokenizer(vocab_file)
^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator.cache\huggingface\modules\transformers_modules\tokenization_chatglm.py", line 17, in init
assert os.path.isfile(model_path), model_path
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 30, in isfile
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType
提示：Python 运行时抛出了一个异常。请检查疑难解答页面。

Prompt executed in 0.13 seconds

ollama的调用为什么不能成功？

ollama调用不能成功，为什么？

AttributeError: 'Llava15ChatHandler' object has no attribute 'clip_ctx'

Import times for custom nodes:
0.0 seconds: E:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py
6.1 seconds: E:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_LLM_party

Starting server

To see the GUI go to: http://127.0.0.1:8188
got prompt
!!! Exception during processing!!! [WinError -529697949] Windows Error 0xe06d7363
Traceback (most recent call last):
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_LLM_party\llm.py", line 1412, in load_llava_checkpoint
clip = Llava15ChatHandler(clip_model_path = clip_path, verbose=False)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\llama_chat_format.py", line 1072, in init
self.clip_ctx = self._llava_cpp.clip_model_load(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\llava_cpp.py", line 174, in clip_model_load
return _libllava.clip_model_load(fname, verbosity)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: [WinError -529697949] Windows Error 0xe06d7363
提示：Python 运行时抛出了一个异常。请检查疑难解答页面。

Prompt executed in 0.14 seconds
got prompt
!!! Exception during processing!!! [WinError -529697949] Windows Error 0xe06d7363
Traceback (most recent call last):
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_LLM_party\llm.py", line 1412, in load_llava_checkpoint
clip = Llava15ChatHandler(clip_model_path = clip_path, verbose=False)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\llama_chat_format.py", line 1072, in init
self.clip_ctx = self._llava_cpp.clip_model_load(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\llava_cpp.py", line 174, in clip_model_load
return _libllava.clip_model_load(fname, verbosity)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: [WinError -529697949] Windows Error 0xe06d7363
提示：Python 运行时抛出了一个异常。请检查疑难解答页面。

Prompt executed in 0.01 seconds
Exception ignored in: <function Llava15ChatHandler.del at 0x000002202AA14040>
提示：Python 运行时抛出了一个异常。请检查疑难解答页面。
Traceback (most recent call last):
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python311\Lib\site-packages\llama_cpp\llama_chat_format.py", line 1078, in del
if self.clip_ctx is not None and self._clip_free is not None:
^^^^^^^^^^^^^
AttributeError: 'Llava15ChatHandler' object has no attribute 'clip_ctx'
提示：Python 运行时抛出了一个异常。请检查疑难解答页面。

使用本地模型生成提示词后，继续文生图显存不足

将本地模型文生图工作流，接入stable diffusion中，显存不能释放，后面文生图显存不足，或者使用共享显存，速度特别慢，能否在提示词生成完成后，将显存释放，以便文生图顺利进行

load video

freecompress-.mp4

请问人格面具可以自己自定义吗？

您好，请问人格面具可以自己自定义吗？还是说目前只能用内置的那几个呢

UnicodeEncodeError: 'locale' codec can't encode character '\u5e74' in position 2: encoding error

After Updating Comfy and all of my nodes yesterday I got this error:

!!! Exception during processing!!! 'locale' codec can't encode character '\u5e74' in position 2: encoding error
Traceback (most recent call last):
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 148, in recursive_execute
obj = class_def()
^^^^^^^^^^^
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_LLM_party\llm.py", line 448, in init
self.id = current_time.strftime("%Y年%m月%d日%H时%M分%S秒")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeEncodeError: 'locale' codec can't encode character '\u5e74' in position 2: encoding error

Traceback (most recent call last):
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 148, in recursive_execute
obj = class_def()
^^^^^^^^^^^
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_LLM_party\llm.py", line 448, in init
self.id = current_time.strftime("%Y年%m月%d日%H时%M分%S秒")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeEncodeError: 'locale' codec can't encode character '\u5e74' in position 2: encoding error

ModuleNotFoundError: No module named 'jax.numpy'; 'jax' is not a package

When started the latest version,it shows this error message,and my jax of ComfyUI venv is 0.4.30. I have reinstall jax & jaxlib,but still have the same error................

Traceback (most recent call last):
File "C:\ComfyUI\nodes.py", line 1931, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "C:\ComfyUI\custom_nodes\comfyui_LLM_party_init.py", line 8, in
from .llm import NODE_CLASS_MAPPINGS, NODE_DISPLAY_NAME_MAPPINGS
File "C:\ComfyUI\custom_nodes\comfyui_LLM_party\llm.py", line 1873, in
load_custom_tools()
File "C:\ComfyUI\custom_nodes\comfyui_LLM_party\llm.py", line 1851, in load_custom_tools
spec.loader.exec_module(module)
File "C:\ComfyUI\custom_nodes\comfyui_LLM_party\custom_tool\chatTTS_node.py", line 4, in
import ChatTTS
File "C:\ComfyUI\python\lib\site-packages\ChatTTS_init_.py", line 1, in
from .core import Chat
File "C:\ComfyUI\python\lib\site-packages\ChatTTS\core.py", line 18, in
from .model import DVAE, GPT, gen_logits
File "C:\ComfyUI\python\lib\site-packages\ChatTTS\model_init_.py", line 1, in
from .dvae import DVAE
File "C:\ComfyUI\python\lib\site-packages\ChatTTS\model\dvae.py", line 9, in
from vector_quantize_pytorch import GroupedResidualFSQ
File "C:\ComfyUI\python\lib\site-packages\vector_quantize_pytorch_init_.py", line 2, in
from vector_quantize_pytorch.residual_vq import ResidualVQ, GroupedResidualVQ
File "C:\ComfyUI\python\lib\site-packages\vector_quantize_pytorch\residual_vq.py", line 18, in
from einx import get_at
File "C:\ComfyUI\python\lib\site-packages\einx_init_.py", line 5, in
from . import backend
File "C:\ComfyUI\python\lib\site-packages\einx\backend_init_.py", line 1, in
from .register import register_for_module, register, get, backends, numpy
File "C:\ComfyUI\python\lib\site-packages\einx\backend\register.py", line 53, in
register_for_module("jax", _jax.create)
File "C:\ComfyUI\python\lib\site-packages\einx\backend\register.py", line 19, in register_for_module
register(backend_factory())
File "C:\ComfyUI\python\lib\site-packages\einx\backend_jax.py", line 11, in create
import jax.numpy as jnp
ModuleNotFoundError: No module named 'jax.numpy'; 'jax' is not a package

Solved

I've installed comfyui_LLM_party via Comfyui Manager, and there is nothing in Install Missing Custom Nodes but the installed comfyui_LLM_party with update button -

centos平台报错：ComfyUI/custom_nodes/comfyui_LLM_party module for custom nodes: [Errno 2] No such file or di rectory: 'dpkg'

请问如何解决该报错，很着急

找不到llama_cpp模块
Traceback (most recent call last):
File "/aigc-nas01/renwenyi/ComfyUI/nodes.py", line 1941, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/aigc-nas01/renwenyi/ComfyUI/custom_nodes/comfyui_LLM_party/init.py", line 1, in
from .install import (
File "/aigc-nas01/renwenyi/ComfyUI/custom_nodes/comfyui_LLM_party/install.py", line 391, in
install_portaudio()
File "/aigc-nas01/renwenyi/ComfyUI/custom_nodes/comfyui_LLM_party/install.py", line 337, in install_portaudio
result = subprocess.run(["dpkg", "-s", "libportaudio2"], stdout=subprocess.PIPE, stderr=subprocess.PIPE)
File "/home/work/anaconda3/envs/animate_anyone/lib/python3.10/subprocess.py", line 503, in run
with Popen(*popenargs, **kwargs) as process:
File "/home/work/anaconda3/envs/animate_anyone/lib/python3.10/subprocess.py", line 971, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "/home/work/anaconda3/envs/animate_anyone/lib/python3.10/subprocess.py", line 1847, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'dpkg'

Feature Request: LangChainDeprecationWarning and Requirements

1、LangChainDeprecationWarning: tools/(wikipedia.py & load_ebd.py & check_web.py)

LangChainDeprecationWarning: Importing HuggingFaceBgeEmbeddings from langchain.embeddings is deprecated. Please replace deprecated imports:

>> from langchain.embeddings import HuggingFaceBgeEmbeddings

with new imports of:

>> from langchain_community.embeddings import HuggingFaceBgeEmbeddings

a: from langchain.embeddings import HuggingFaceBgeEmbeddings
b: from langchain_community.embeddings import HuggingFaceBgeEmbeddings

If with b will make the results different or bad results.

2、Maybe we should not check and install python module when starting comfyui:

We can install maually by using requirements.txt with cmd or terminal.

macOS support

A quick search did not find where it is used.

If you remove it, then this project can at least be installed on MacOS (auto-gptq does not yet support macOS, since it very interestingly depends on specific versions of Pytorch).

Or I missed something and auto-gptq is used somewhere here?

提示出错，麻烦大佬看看怎么回事？

用的本地模型，提示词应该是生成好了，因为显示文本节点有显示，但是后面的 omost解码器出错了，卡住了，希望大佬看到，帮忙解决一下吧

ModuleNotFoundError: No module named 'arxiv'

我已经安装了，pip list里也有 python路径也正确，但一直这个报错········
I have installed it and the Python path in the pip list is also correct, but this error persists········

即使外部参数不变，大模型节点总是会运行，因为大模型对同一个问题也总是有着不同的回答。

这个有办法调整一下吗

或者像随机种子那样

我外部参数不变，只运行一次就可以了

加载本地模型总是报错，能否详细说一下这一块怎么设置？先谢谢啦~

TypeError: install_package() got an unexpected keyword argument 'custom_command'

Traceback (most recent call last):
File "C:\ai\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\nodes.py", line 1941, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "C:\ai\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\custom_nodes\comfyui_LLM_party_init.py", line 1, in
from .install import (
File "C:\ai\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\custom_nodes\comfyui_LLM_party\install.py", line 364, in
install_llama(system_info)
File "C:\ai\ComfyUI-aki-v1.3\ComfyUI-aki-v1.3\custom_nodes\comfyui_LLM_party\install.py", line 181, in install_llama
install_package("llama-cpp-python", custom_command=custom_command)
TypeError: install_package() got an unexpected keyword argument 'custom_command'

节点安装后，打开comfyui的时候出错

取消requirements.txt中包的版本限制。

bitsandbytes==0.43.1
accelerate==0.30.1
playsound<=1.2.2
tenacity>=8.1.0,<8.4.0

建议取消这类包的版本限制，直接写成
bitsandbytes
accelerate等。
如果功能有影响的话建议寻找替代方案。

这样能让更多的小伙伴无痛安装，并且以后安装其他插件时，没有后顾之忧。

十分喜欢你的插件，加油~

ModuleNotFoundError: No module named 'tenacity.asyncio'

测试1：
使用安装管理器安装方式报错
测试2：
使用git方式安装
并且运行了pip install -r requerements.txt

Can't Install Requirements

pip install -r requirements.txt
Requirement already satisfied: beautifulsoup4 in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 1)) (4.12.3)
Collecting docx2txt (from -r requirements.txt (line 2))
Downloading docx2txt-0.8.tar.gz (2.8 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting langchain (from -r requirements.txt (line 3))
Downloading langchain-0.2.6-py3-none-any.whl.metadata (7.0 kB)
Collecting langchain_community (from -r requirements.txt (line 4))
Downloading langchain_community-0.2.6-py3-none-any.whl.metadata (2.5 kB)
Collecting langchain_text_splitters (from -r requirements.txt (line 5))
Downloading langchain_text_splitters-0.2.2-py3-none-any.whl.metadata (2.1 kB)
Requirement already satisfied: openai in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 6)) (1.30.5)
Collecting openpyxl (from -r requirements.txt (line 7))
Downloading openpyxl-3.1.5-py2.py3-none-any.whl.metadata (2.5 kB)
Requirement already satisfied: pandas in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 8)) (2.2.2)
Requirement already satisfied: pytz in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 9)) (2024.1)
Requirement already satisfied: Requests in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 10)) (2.32.2)
Collecting xlrd (from -r requirements.txt (line 11))
Downloading xlrd-2.0.1-py2.py3-none-any.whl.metadata (3.4 kB)
Collecting faiss-cpu (from -r requirements.txt (line 12))
Downloading faiss_cpu-1.8.0.post1-cp310-cp310-win_amd64.whl.metadata (3.8 kB)
Requirement already satisfied: websocket-client in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 13)) (1.8.0)
Collecting streamlit (from -r requirements.txt (line 14))
Downloading streamlit-1.36.0-py2.py3-none-any.whl.metadata (8.5 kB)
Collecting virtualenv (from -r requirements.txt (line 15))
Downloading virtualenv-20.26.3-py3-none-any.whl.metadata (4.5 kB)
Collecting tiktoken (from -r requirements.txt (line 16))
Downloading tiktoken-0.7.0-cp310-cp310-win_amd64.whl.metadata (6.8 kB)
Requirement already satisfied: transformers in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 17)) (4.41.1)
Collecting transformers_stream_generator (from -r requirements.txt (line 18))
Downloading transformers-stream-generator-0.0.5.tar.gz (13 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting optimum (from -r requirements.txt (line 19))
Downloading optimum-1.20.0-py3-none-any.whl.metadata (19 kB)
Collecting pdfplumber (from -r requirements.txt (line 20))
Downloading pdfplumber-0.11.1-py3-none-any.whl.metadata (39 kB)
Collecting wikipedia (from -r requirements.txt (line 21))
Downloading wikipedia-1.4.0.tar.gz (27 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting arxiv (from -r requirements.txt (line 22))
Downloading arxiv-2.1.3-py3-none-any.whl.metadata (6.1 kB)
Requirement already satisfied: bitsandbytes in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 23)) (0.43.1)
Requirement already satisfied: accelerate in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 24)) (0.30.1)
Requirement already satisfied: fastapi in c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages (from -r requirements.txt (line 25)) (0.111.0)
Collecting py-cpuinfo (from -r requirements.txt (line 26))
Downloading py_cpuinfo-9.0.0-py3-none-any.whl.metadata (794 bytes)
Collecting diskcache (from -r requirements.txt (line 27))
Downloading diskcache-5.6.3-py3-none-any.whl.metadata (20 kB)
Collecting requests_toolbelt (from -r requirements.txt (line 28))
Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl.metadata (14 kB)
Collecting playsound (from -r requirements.txt (line 29))
Downloading playsound-1.3.0.tar.gz (7.7 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [23 lines of output]
Traceback (most recent call last):
File "c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 353, in
main()
File "c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "c:\users\tanzi\appdata\local\programs\python\python310\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
File "C:\Users\tanzi\AppData\Local\Temp\pip-build-env-u_hkwway\overlay\Lib\site-packages\setuptools\build_meta.py", line 327, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=[])
File "C:\Users\tanzi\AppData\Local\Temp\pip-build-env-u_hkwway\overlay\Lib\site-packages\setuptools\build_meta.py", line 297, in _get_build_requires
self.run_setup()
File "C:\Users\tanzi\AppData\Local\Temp\pip-build-env-u_hkwway\overlay\Lib\site-packages\setuptools\build_meta.py", line 497, in run_setup
super().run_setup(setup_script=setup_script)
File "C:\Users\tanzi\AppData\Local\Temp\pip-build-env-u_hkwway\overlay\Lib\site-packages\setuptools\build_meta.py", line 313, in run_setup
exec(code, locals())
File "", line 6, in
File "c:\users\tanzi\appdata\local\programs\python\python310\lib\inspect.py", line 1139, in getsource
lines, lnum = getsourcelines(object)
File "c:\users\tanzi\appdata\local\programs\python\python310\lib\inspect.py", line 1121, in getsourcelines
lines, lnum = findsource(object)
File "c:\users\tanzi\appdata\local\programs\python\python310\lib\inspect.py", line 958, in findsource
raise OSError('could not get source code')
OSError: could not get source code
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

LLM_local: Separate `device` and `dtype` in the node

elif device == "cuda-fp16":
    qwen_device = "cuda"
    qwen_model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True).half().cuda()

Can we also separate device and tensor type(dtype)?

This is screen from the SUPIR node:

Otherwise you will have to make a huge list like:

cuda-fp32
cuda-bf16
cuda-fp16
cuda-fp8

mps-fp32
mps-bf16
mps-fp16

and so on probably for other Hardware Accelerators(like xpu) too.

Selecting separatly device and DType will be the best option, imho.

Also usually Node should use that device that is used by ComfyUI - maybe we can add an "auto" option for device and set it as default one.

It is recommended to consider accessing deepseek’s API

有没有豆包平台工作流的例子，配完config.ini不知道怎么连工作流

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

大佬你好，除了分类器，还有什么办法可以把推出来的提示词进行分类，然后分别接入到CLIP的正负提示词里面吗

我现在使用了2次API来调用

第一次是提示词润色

第二次是把润色的提示词使用分类器分类

出了这个办法还有其他的吗，整个流程只使用1次API这样

能不能让llama 3.1也可以使用工具？

Error code: 400 - {'error': {'message': 'llama3.1:8b-instruct-q6_K does not support tools', 'type': 'api_error', 'param': None, 'code': None}}

ollama的新版本已经支持工具调用了。

Add new tool: duckduckgo/ searXNG websearch, no API key required

Is your feature request related to a problem? Please describe.
no, but It would be a good addition for people who do not have an API key for web search (Google, Bing)

Describe the solution you'd like
similar to Google or Bing Search, but no API key required (none with duckduckgo, or a URL with SearXNG

Describe alternatives you've considered

Additional context

remove the pycache dir

That should not be included into repo.

ComfyUI启动时，能否进一步提速？

您好。观察到，在启动ComfyUI相关节点时，party节点的耗时是比较长的，不知道你们的启动是否也是这样？

failed to add config settings(like api keys) after the first time running the app

错误描述
在第一次运行应用程序之后, 于config.ini文件中添加的设置（如api key等）将不会在ComfyUI_LLM_party节点上起作用

Describe the bug
Adding settings in config.ini will not work on nodes for model and etc. after the first time running the app.

重现步骤

按照readme，添加设置（API密钥等）在config.ini中，运行ComfyUI。
在comfyui_LLM_party文件夹下将生成一个新的文件“config”，类型为“configuration settings”。
设置生效。
停止comfyui，修改config.ini，再次运行应用程序。
新设置不起作用，出现错误“'Incorrect API key provided: sk-XXXXX”等。

To Reproduce

Follow readme, add settings(api keys and etc.) in config.ini, run ComfyUI.
a new file "config" with type "configuration settings" will be generated under comfyui_LLM_party folder.
the setting works.
stop the comfyui, modify the config.ini, run app again.
new setting doesn't work, error like "'Incorrect API key provided: sk-XXXXX"

截图Screenshots

解决方案

第一次运行应用程序时会生成type为“configuration settings”的config文件，ComfyUI从该文件中读取设置。
在第一次运行应用程序后，修改该文件中的设置，而不是修改config.ini文件。
或者可以删除它，修改config.ini并运行应用程序。一个新的“configuration settings”文件将会生成。
然后节点可以在不需要填充额外信息（如api key）的情况下工作。

Solutions

the first time running of app will generate the "configuration settings" file, ComfyUI read settings from it
modify settings in this file instead of config.ini file after the first time app's running.
or you can delete it, modify config.ini and run the app. A new "configuration settings" file will be generate.
Nodes work without information filling needed.

Please, add local LVM model support and example [feature request]

Any model will do, even a simple one for start.

Most people in ComfyUI will be interested in a model that can determine the GENDER of an object: boy or girl/man or woman

This is very useful for InstantID and IP-Adapter workflows, where you want regenerate a picture.

Also VLM nodes will be very useful for upscaler workflows and for transfer styles ones.

As I am very interested in LVM Nodes, I can try create one and open a PR for this, I will have some time at evenings during week, so at next weekend probably can open a PR.