zshcuanni / hetu-galvatron Goto Github PK
View Code? Open in Web Editor NEWThis project forked from afdwang/hetu-galvatron
Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you have any interests, please visit/star/fork https://github.com/PKU-DAIR/Hetu-Galvatron