habvt Goto Github PK

alpa

Training and serving large-scale neural networks

awesome-dl-scheduling-papers

client

🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

clusterdata

cluster data collected from production clusters in Alibaba for cluster management research

comscribe

ComScribe is a tool to identify communication among all GPU-GPU and CPU-GPU pairs in a single-node multi-GPU system.

dawn-bench-entries

DAWNBench: An End-to-End Deep Learning Benchmark and Competition

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

deepspeed-mii

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

deepspeedexamples

Example models using DeepSpeed

easyparallellibrary

Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.

epl_examples

FastNN provides distributed training examples that use EPL.

faas-profiler

A tool for testing and profiling FaaS platforms

gavel

Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020

gpipe-core

Core library of new GPipe, encapsulating OpenGl and providing a type safe minimal library

gres_config_gen

heliosdata

Helios Traces from SenseTime

image-resize

Image resizing benchmark for serverless platforms.

images

infaas

Model-less Inference Serving

infless

The source code of INFless，a native serverless platform for AI inference.

lbann

Livermore Big Artificial Neural Network Toolkit

pipedream

sc22-ae

temp

tiresias

A GPU Cluster Manager for Distributed Deep Learning Training

torchgpipe

A GPipe implementation in PyTorch

volcano

A Kubernetes Native Batch System (Project under CNCF)