szhengac Goto Github PK

apex

apex-1

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

atari

Persistent advantage learning dueling double DQN for the Arcade Learning Environment

baselines

OpenAI Baselines: high-quality implementations of reinforcement learning algorithms

byteps

A high performance and generic framework for distributed DNN training

deeplearningexamples-1

Deep Learning Examples

deepops

Tools for building GPU clusters

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

deepspeedexamples

Example models using DeepSpeed

dist-ef-sgdm

epoi

Benchmark PyTorch Custom Operators

fb.resnet.torch

Torch implementation of ResNet from http://arxiv.org/abs/1512.03385 and training scripts

gluon-cv

Gluon CV Toolkit

gluon-nlp-1

NLP made easy

gluon-ts

Probabilistic time series modeling in Python

gluon-tutorials-zh

通过 MXNet / Gluon 来动手学习深度学习

grad_accumulation

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

keras

Deep Learning library for Python. Runs on TensorFlow, Theano or CNTK.

keras-contrib

Keras community contributions

lstm

megatron-lm

Ongoing research training transformer models at scale

mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

nemo-megatron-launcher

NeMo Megatron launcher and tools

optim

A numeric optimization package for Torch.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

rllab

rllab is a framework for developing and evaluating reinforcement learning algorithms, fully compatible with OpenAI Gym.

slapo

A schedule language for progressive optimization of large deep learning model training

szhengac.github.io