v3ucn / causallm14b_llama_webui_adult_version Goto Github PK

View Code? Open in Web Editor NEW

118.0 5.0 11.0 62 KB

Causallm14b大模型量化版本,基于DPO算法改进,无内容审查,无**钢印,百无禁忌Webui

Python 97.15% Batchfile 2.85%

causallm14b_llama_webui_adult_version's Issues

这个可以用于35b的model吗

还是说只有14b可以用啊

生成报错 ValueError: Need to enable queue to use generators.

使用 conda 部署，点击生成后报错

Traceback (most recent call last):
  File "C:\software\miniconda3\envs\causallm14b\lib\site-packages\gradio\routes.py", line 534, in predict
    output = await route_utils.call_process_api(
  File "C:\software\miniconda3\envs\causallm14b\lib\site-packages\gradio\route_utils.py", line 226, in call_process_api
    output = await app.get_blocks().process_api(
  File "C:\software\miniconda3\envs\causallm14b\lib\site-packages\gradio\blocks.py", line 1550, in process_api
    result = await self.call_function(
  File "C:\software\miniconda3\envs\causallm14b\lib\site-packages\gradio\blocks.py", line 1193, in call_function
    raise ValueError("Need to enable queue to use generators.")
ValueError: Need to enable queue to use generators.

求大佬解决一下。

启动报错

启动时显示Traceback (most recent call last): File "app.py", line 11, in <module> llm = Llama( TypeError: __init__() got an unexpected keyword argument 'chat_format'
有大佬知道怎么回事吗