Comments (5)
li-plus
commented on July 2, 2024
2
我可以尝试往 llama.cpp 迁移，但他们现在应该没办法支持 tool call / code interpreter 之类的功能
from chatglm.cpp.
catmeowjiao
commented on July 2, 2024
这个得看llama.cpp作者同不同意
from chatglm.cpp.
miku1958
commented on July 2, 2024
顺便问一下, code interpreter目前只支持chatglm吗?
from chatglm.cpp.
miku1958
commented on July 2, 2024
目前llama.cpp已经支持Baichuan2了, 试了一下用convert-hf-to-gguf.py直接能创建, 但为什么chatglm.cpp需要的内存比llama.cpp少那么多
from chatglm.cpp.
miku1958
commented on July 2, 2024
用llama.cpp转换Baichuan2的gguf版本后试了一天, 愣是没有办法解决死循环的问题, 我还是继续用chatglm.cpp吧, 如果有解决方法可以告诉我一下谢谢
from chatglm.cpp.
Related Issues (20)
- CMake 编译时出现错误 HOT 1
- 支持minicpm-2b HOT 1
- 多卡推理
- cmake --build build -j --config Release 命令报错
- 请求编译好的程序 HOT 1
- Illegal instruction
- Docker build failed【Parse error. Expected a command name, got bad character with text "".】
- 官方docker无法使用 HOT 1
- 如何保存会话，比如，我之前，已经告诉他，让他记住一个电话号码，以后重新启动这个程序，能让他告诉我这个电话号码吗？ HOT 1
- 使用chatglm_cpp/openai_api.py 提供接口服务，oneapi一测试链接就崩溃 HOT 1
- 在量化模型的时候出现segmentation fault HOT 1
- 什么时候支持amd的gpu HOT 4
- 在启用 cuBLAS 之后，等权重数据加载到显存后，最好能释放内存里的权重数据 HOT 1
- docker运行镜像cpu模式下，cpu的利用率最大只有1600%，如何提升？ HOT 4
- Windows系统 安装 chatGLM 分享 HOT 2
- 关于单次最大回复值的tokens值
- 关于convert.py转换出来的文件
- _C.pyi 的三個類成員變量是什麼意思?要怎麼填? 以及 ChatMessage裡的 tool_calls 要怎麼填
- error: wheels for chatglm.cpp on windows HOT 1
- 如何编译一个某类gpu兼容的 程序？
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatglm.cpp.