lumosity4tpj / llama-deepspeed Goto Github PK
View Code? Open in Web Editor NEWThis project forked from huanglk/transpeeder
train llama-30B on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
License: Apache License 2.0