Comments (8)
315930399
commented on June 22, 2024
试了一下之前的脚本还能用，对于agent、function call应该要加额外的逻辑。数学方面的推理能力还是不太行
from chatglm3.
appleatiger
commented on June 22, 2024
之前的脚本不能多轮对话
from chatglm3.
huyuan-cn
commented on June 22, 2024
关闭了多轮的history后可以跑api，等大佬出新
from chatglm3.
bonuschild
commented on June 22, 2024
试了一下之前的脚本还能用，对于agent、function call应该要加额外的逻辑。数学方面的推理能力还是不太行
直接使用chatglm2-6b的代码在tokenization_chatglm.py的189行build_chat_input处报错：
content = item["content"]
TypeError: list indices must be integers or slices, not str
看来是返回内容的形式也变了，请指点如何修改，谢谢！
from chatglm3.
bonuschild
commented on June 22, 2024
关闭了多轮的history后可以跑api，等大佬出新
在哪里关闭多轮history？请指点，谢谢！
from chatglm3.
jonsen
commented on June 22, 2024
我修改了提交到这里了：
from chatglm3.
bonuschild
commented on June 22, 2024
强啊老铁，顶一个！Message ID: ***@***.***>
from chatglm3.
zhangch9
commented on June 22, 2024
请参考README中的API 部署。
from chatglm3.
Related Issues (20)
- GLM大模型是Causal Language Model类型的模型么？ HOT 1
- 官方的所有openai_api实现的函数调用全部失效了 HOT 8
- 关于微调多轮对话生成的loss_mask格式问题 HOT 1
- ptuning_v2 微调后使用inference_hf.py推理 出现Both `max_new_tokens` (=512) and `max_length`(=8192) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation) HOT 4
- openai_api.py 支持并发调用，或者怎么实现并发调用 HOT 1
- 量化加载chatglm3，报错：round_vml_cpu not implemented for Half HOT 5
- 导入huggingface_hub不知道那个版本导入库没有后面的 TextGenerationStreamResponse, Token HOT 9
- [lora finetune] RuntimeError: CUDA error: device-side assert triggered
- AttributeError: 'NoneType' object has no attribute 'peft_type' HOT 3
- api调用出错 HOT 1
- 运行抛异常：CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions HOT 5
- requirements.txt的问题 HOT 1
- problems when finetuning with lora HOT 3
- 【求助】关于算法备案的问题
- 进行p-tuning-v2微调时，报如下错误 HOT 4
- 拼接格式与 chat 接口处理逻辑是否冲突 HOT 2
- lora微调报错 HOT 1
- RMSNorm的不同实现方式
- LORA 微调报错 HOT 1
- bug when running inference_hf.py after finetuning with lora.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatglm3.