heshengtao / comfyui_llm_party Goto Github PK

Any model will do, even a simple one for start.

Most people in ComfyUI will be interested in a model that can determine the GENDER of an object: boy or girl/man or woman

This is very useful for InstantID and IP-Adapter workflows, where you want regenerate a picture.

Also VLM nodes will be very useful for upscaler workflows and for transfer styles ones.

As I am very interested in LVM Nodes, I can try create one and open a PR for this, I will have some time at evenings during week, so at next weekend probably can open a PR.

Requestsxlrd maybe requests pypi and xlrd pypi?

I've installed comfyui_LLM_party via Comfyui Manager, and there is nothing in Install Missing Custom Nodes but the installed comfyui_LLM_party with update button -

A quick search did not find where it is used.

If you remove it, then this project can at least be installed on MacOS (auto-gptq does not yet support macOS, since it very interestingly depends on specific versions of Pytorch).

Or I missed something and auto-gptq is used somewhere here?

如果可以的话就太棒了，ollama管理模型，这应该是可以做到的，像comfyui ollama插件就是调用ollama的接口在comfyui中使用llm

That should not be included into repo.

elif device == "cuda-fp16":
    qwen_device = "cuda"
    qwen_model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True).half().cuda()

Can we also separate device and tensor type(dtype)?

This is screen from the SUPIR node:

Otherwise you will have to make a huge list like:

cuda-fp32
cuda-bf16
cuda-fp16
cuda-fp8

mps-fp32
mps-bf16
mps-fp16

and so on probably for other Hardware Accelerators(like xpu) too.

Selecting separatly device and DType will be the best option, imho.

Also usually Node should use that device that is used by ComfyUI - maybe we can add an "auto" option for device and set it as default one.