Comments (3)
@li-plus Hi, do you have any comment on this issue? I'll be glad to implement it if you don't mind :)
from chatglm.cpp.
@UranusSeven Hi, sorry for the late reply. Integration into popular frontends is indeed one of the TODOs. I just read the code of llama-cpp-python: https://github.com/abetlen/llama-cpp-python/blob/6d8892fe64ca7eadd503ae01f93fbcd9ff3806dd/llama_cpp/llama.py#L1229-L1251. How about we call it create_completion
instead of generate
to align with them. It'll be awesome if you would help implement it. If you don't have time, I'll handle it. Anyway, thanks for you advice!
from chatglm.cpp.
@li-plus Totally agree! Having similar interface with llama-cpp-python is awesome!
I'll try to resolve this issue this weekend :)
from chatglm.cpp.
Related Issues (20)
- CMake 编译时出现错误 HOT 1
- 支持minicpm-2b HOT 1
- 多卡推理
- cmake --build build -j --config Release 命令报错
- 请求编译好的程序 HOT 1
- Illegal instruction
- Docker build failed【Parse error. Expected a command name, got bad character with text "".】
- 官方docker无法使用 HOT 1
- 如何保存会话,比如,我之前,已经告诉他,让他记住一个电话号码,以后重新启动这个程序,能让他告诉我这个电话号码吗? HOT 1
- 使用chatglm_cpp/openai_api.py 提供接口服务,oneapi一测试链接就崩溃 HOT 1
- 在量化模型的时候出现segmentation fault HOT 1
- 什么时候支持amd的gpu HOT 3
- 在启用 cuBLAS 之后,等权重数据加载到显存后,最好能释放内存里的权重数据 HOT 1
- docker运行镜像cpu模式下,cpu的利用率最大只有1600%,如何提升? HOT 4
- Windows系统 安装 chatGLM 分享 HOT 2
- 关于单次最大回复值的tokens值
- 关于convert.py转换出来的文件
- _C.pyi 的三個類成員變量是什麼意思?要怎麼填? 以及 ChatMessage裡的 tool_calls 要怎麼填
- error: wheels for chatglm.cpp on windows HOT 1
- 如何编译一个某类gpu兼容的 程序?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatglm.cpp.