Comments (2)
catqaq
commented on May 29, 2024
算力原因，更大的模型目前暂未测试，您可以试试看。
from openrlhf.
hijkzzz
commented on May 29, 2024
我们正在开发ray的版本，会支持到 30B 的全量高性能训练，后续会通过推理引擎逐步支持到 70B
目前如果打算训练13B的请启用ZeRO3模式（只会对 Critic RM 等模型生效）
然后QLora版本也正在开发，完成后会以量化的方式支持更大的模型
from openrlhf.
Related Issues (20)
- AssertionError: backward pass is invalid for module in evaluation mode HOT 9
- Support hybird-model in Ray PPO
- Version0.0.1: Release the first development version HOT 1
- fixing Typo HOT 1
- Error occurred when loading datasets from disk HOT 5
- Local dataset: Please perform appropriate preprocessing on your local data set.
- Scale rlhf to 100B models HOT 1
- DeepSpeed Training and Inference HOT 2
- Implement Re-max
- Inquiry regarding the feasibility of fine-tuning LLaMA2-7B with a single A100 HOT 4
- [Severity] High similarity with Colossal-AI HOT 4
- Discussion on our 1st release. HOT 1
- feature: add api support for hosting a reward model HOT 5
- Add pipeline module to support more scientific comparative experiments and research
- 问一下，huggingface提供的checkpoint为pt文件，如何转成大模型常见的.bin HOT 4
- Loading RM ckpt bug: AttributeError: 'NoneType' object has no attribute 'load' HOT 3
- 为什么速度回比deepspeed chat快4倍这么多 HOT 3
- baichuan2-13b-base作为actor RuntimeError: CUDA error: device-side assert triggered HOT 5
- Support KTO HOT 1
- High Memory Usage HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openrlhf.