Comments (7)
在cli.py的第80行,改成
if (not disable_torchrun) and (get_device_count() > 1):
然后到根目录下重新运行
pip install -e '.[torch,metrics]'
默认就是用本地单卡了
from llama-factory.
修复了
from llama-factory.
我用llamafactory-cli train examples/qlora_single_gpu/llama3_lora_sft_bitsandbytes.yaml 8bit量化微调qwen2出现
{'loss': 0.0, 'grad_norm': nan, 'learning_rate': 0.0, 'epoch': 0.51}
{'loss': 0.0, 'grad_norm': nan, 'learning_rate': 0.0, 'epoch': 1.02}
{'loss': 0.0, 'grad_norm': nan, 'learning_rate': 0.0, 'epoch': 1.53}
from llama-factory.
用 bf16
from llama-factory.
在哪添加啊
model
model_name_or_path: E:\LLaMA-Factory\qwen\Qwen2-7B-Instruct
quantization_bit: 8
method
stage: sft
do_train: true
finetuning_type: lora
lora_target: all
dataset
dataset: xunlian
template: qwen
cutoff_len: 1024
max_samples: 1000
overwrite_cache: true
preprocessing_num_workers: 16
output
output_dir: saves/qwen2-7b/lora/sft
logging_steps: 10
save_steps: 500
plot_loss: true
overwrite_output_dir: true
train
per_device_train_batch_size: 1
gradient_accumulation_steps: 8
learning_rate: 1.0e-4
num_train_epochs: 100.0
lr_scheduler_type: cosine
warmup_ratio: 0.1
fp16: true
eval
val_size: 0.1
per_device_eval_batch_size: 1
eval_strategy: steps
eval_steps: 500
from llama-factory.
fp16 换成 bf16
from llama-factory.
好的谢谢
from llama-factory.
Related Issues (20)
- Qwen-1.5-14b-chat多卡推理时加载权重速度很慢 HOT 1
- 使用 qwen2 7b int8 在 webui 中 chat 时所有的回答都是乱码 HOT 7
- Lora方式对Qwen1.5-7B进行增量预训练,loss值下降幅度很小 HOT 1
- 使用llamafactory-cli api启动Qwen/Qwen2-7B-Instruct回答乱码 HOT 2
- [NPU] inference ZhipuAI/glm-4-9b-chat POST /v1/chat/completions ERROR: Exception in ASGI application HOT 1
- qwen2 awq 微调一直报错 auto-awq kernels没有安装 HOT 1
- 加载数据时,如果存在cache,debug用参数max_samples将失效 HOT 1
- How to get logit during prediction HOT 1
- Dockerfile is missing unsloth HOT 1
- webui界面导出的时候需要选择适配器,这个去哪选择呀 HOT 5
- Why can not set eval dataset in examples/lora_single_gpu/llama3_lora_sft.yaml ?? HOT 2
- RuntimeError: Cannot find valid samples, check `data/README.md` for the data format. HOT 3
- training is broken with vllm==0.5.0
- 执行llamafactory-cli webui报错 Exception in thread Thread-3 (_do_normal_analytics_request) HOT 3
- auto-awq kernels is needed to be installed to use .backward() #19 HOT 1
- Error in launch using a docker image HOT 1
- 支持glm-4-v-9b微调吗 HOT 1
- why not cast dtype in deepspeed zero3 ? HOT 6
- HelloGitHub Badge
- 如何在原有pre-training的100轮基础上再进行100轮呢? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-factory.