Comments (3)
We cannot directly install unsloth via pip, you can enter the docker environment and install unsloth mannually
from llama-factory.
We cannot directly install unsloth via pip, you can enter the docker environment and install unsloth mannually
Sorry to comment on an old issue, but how? It's very not straight forward to get LLaMA-Factory installed in a base image then get unsloth installed and still have a working LF, transformers, unsloth, pytorch. Dependency hell. If anyone has a recipe that works, please reply here.
from llama-factory.
@sammcj Try this: https://github.com/coljac/llamafactory-unsloth
from llama-factory.
Related Issues (20)
- 微调后的lora模型用vllm加载报错 HOT 2
- Código descuento Dogfy Diet
- qwen2vl 7b , how to call api HOT 3
- Meet c10::DistBackendError when finetuning Qwen2-VL with video dataset HOT 1
- 昇腾链接打不开 HOT 1
- QWEN1.5系列模型在训练时进入eval阶段就报OOM HOT 1
- glm-4-9b-chat llamafactory-cli lora_pretrain后 回答特别长 HOT 1
- 求助:请问使用llama-factory 的教程里的Batch Predicting and Computing BLEU and ROUGE Scores 对下的脚本llamafactory-cli train examples/train_lora/llama3_lora_predict.yaml 来进行预测时,默认的参数是多少,如topk,temperature,max_len等参数是多少,或者有什么命令可以查看吗 HOT 1
- npu全量微调qwen2结束时报错 'Qwen2ForCausalLM' object has no attribute 'create_or_update_model_card' HOT 2
- [Question]support for quantization algorithms that are not performed on-the-fly HOT 3
- 310P 微调报错 RuntimeError: call aclnnCast failed, detail:EZ9999: Inner Error HOT 1
- 使用neat_packing进行sft训练,模型性能指标下降明显 HOT 4
- [QUESTION] 数据的preprocess的过程是否存在问题 HOT 3
- gptq模型加载很慢
- 模型eval时只输出loss等info,却没有acc?求助(是环境问题吗) HOT 2
- Latest LLaMA-Factory repo force to use Troch 2.4 hence is clashing with Unsloth/XFormers HOT 3
- webui Chat hugging face 总是乱码
- 如何使用自己的reward函数而不是使用reward model呢? HOT 1
- 请问,llamafactory现在支持在昇腾910上进行模型评估嘛? HOT 1
- Gemma 2 + unsloth + fa2 full SFT RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-factory.