Comments (4)
Egber1t
commented on June 15, 2024
佬，请问这个图是llama factory自带框架出来的图吗？
from llama-factory.
xielinzhen
commented on June 15, 2024
您好！请问zero3通信成本高吗，我sft llama3-8B 20个steps zero2只要17秒， zero3要20分钟，是不是有点不正常
from llama-factory.
wsdmanonymous
commented on June 15, 2024
佬，请问这个图是llama factory自带框架出来的图吗？
佬，不是哈
from llama-factory.
wsdmanonymous
commented on June 15, 2024
您好！请问zero3通信成本高吗，我sft llama3-8B 20个steps zero2只要17秒， zero3要20分钟，是不是有点不正常
是高不少，特别是多机器时候，性能瓶颈基本就在通信上。但是具体差异多少应该跟机型关系挺大的，我在2块A800上开IB网络时没有差异那么大，大概4-5倍差异
from llama-factory.
Related Issues (20)
- What's the difference between "quantization bit in advanced configuration" and "export quantization bit in export tab"? HOT 1
- NPU glm-4-9b-chat API推理报错 HOT 2
- 運行webui時報錯 OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like meta-llama/Meta-Llama-3-8B-Instruct is not the path to a directory containing a file named config.json. HOT 3
- qlora vs lora adapter sizes HOT 1
- Pypi/Conda Package HOT 1
- Evaluation with ceval cmmlu get 0 as result HOT 1
- Do you have plans to add fine-tuning scripts for other multimodal large models? For example, Qwen_VL, LLaVA1.6, MiniGPT4, etc. HOT 1
- Export 4bit quantization model got error: Please merge adapters before quantizing the model. HOT 4
- KTO examples does not work HOT 2
- glm-4-9b-chat-1m do_predict得到的generated_predictions.jsonl中的label出现了\n和一些非数据集中的结果。
- glm-4-9b-chat-1m do_predict得到的generated_predictions.jsonl中的label出现了\n和一些非数据集中的结果。 HOT 2
- 你好，我是用的mac m2 pro，在开始准备微调的时候，报错“warn_no_cuda” HOT 1
- 如何在lora微调中的eval部分计算自定义的指标如acc（现在只有loss）？ HOT 1
- 情感分类微调：测试输出出现大量positive和negative。 HOT 2
- 合并模型与适配器报错 HOT 1
- 请问预训练lora微调没有使用template参数，合并lora权重时需要指定template吗 HOT 1
- 数据集搜索不到，访问不了好像 ConnectionError: Couldn't reach 'llamafactory/alpaca_gpt4_zh' on the Hub (ConnectTimeout) HOT 1
- Tools section not added in custom dataset
- Pretrain的时候报错 “RuntimeError: Cannot find sufficient samples, consider increasing dataset size.”
- CUDA_VISIBLE_DEVICES=0,1,2,3 无效，不能4卡推理 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-factory.