machinelearningsystem Goto Github PK

optimizing-sgemv-on-nvidia-gpus

An implementation of SGEMV with performance comparable to cuBLAS.

optimus-cc

[ASPLOS'23] Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression

osdi21_ae

Artifact for OSDI'21 GNNAdvisor

pagraph

SoCC'20 and TPDS'21: Scaling GNN Training on Large Graphs via Computation-aware Caching and Partitioning.

parallel-sgd

一个用于联邦学习或分布式机器学习，对不同网络拓扑进行实验的简易框架。

parity-models

Learning-Based Coded Computation

patrickstar

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP. Democratize AI for everyone.

pilotfish

PilotFish harvests the free GPU cycles of cloud gaming with deep learning training

pipedream

piper

pipeswitch

PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications

pipetransformer

PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021

pop

Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021

powersgd

Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727

ps-lite

A lightweight parameter server interface

ps-lite-muli

pytorch-cpp

C++ Implementation of PyTorch Tutorials for Everyone

rabit

Reliable Allreduce and Broadcast Interface for distributed machine learning

ragdoll

ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

reef-artifacts

A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.

rethinking-sparsification

Rethinking gradient sparsification as total error minimization

reverb

Reverb is an efficient and easy-to-use data storage and transport system designed for machine learning research

rfaas

rFaaS: a high-performance FaaS platform with RDMA acceleration for low-latency invocations.

roc

Distributed Multi-GPU GNN Framework

rostam

sc21_ribbon

sc22-ae

sc22-ae-big_model

sccl

Synthesizer for optimal collective communication algorithms