Comments (1)
看起来是您的机器不支持bitsandbytes. 你试试 qwen-7b-chat-int4. 使用的是auto_gptq量化.
from swift.
Related Issues (20)
- 何时能支持原生pytorch batch推理 HOT 2
- 用改框架微调GLM-4V-9B模型,存在重复输出和任务无法拟合的问题。 HOT 3
- swift 量化多模态大模型internvl2-26B,报错 HOT 4
- failed (exitcode: -11) local_rank: 5 (pid: 11514) of binary: /home/jovyan/data-ws-enr/zconda/envs/swift_ft/bin/python HOT 1
- failed (exitcode: -11) local_rank: 5 (pid: 11514) of binary: /home/jovyan/data-ws-enr/zconda/envs/swift_ft/bin/python HOT 8
- AttributeError: 'Qwen2TokenizerFast' object has no attribute 'im_end_id'
- KTO训练数据集报错 HOT 2
- 请问可以利用微调后的多模态大模型与类似LlamaIndex的RAG结合吗?
- 多机多卡训练的时候报错 HOT 2
- 微调llama3_1系列模型出现报错 HOT 3
- 在cogvlm2模型上支持多模态大模型的强化学习训练,例如DPO训练 HOT 1
- Florence-2: How to add custom tokens during fine-tuning training? HOT 1
- 部署报错(500 Internal Server Error/ERROR: Exception in ASGI application/fastapi.exceptions.ResponseValidationError: 1 validation errors:) HOT 3
- 关于推理时获得logits结果
- InternVL2的grounding任务自定义数据集如何一个prompt里融合多个<box>或<ref-object> HOT 1
- 微调后模型进行量化出现错误
- 微调deepseekcoderv2后推理明显变慢,如何只activate moe的参数?
- No module named 'swift.cli.main'问题 HOT 3
- [BUG] response里需要生成空格's时,text会错误的输出 HOT 1
- device_map error for internVL2.0, trained on multi-node
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from swift.