machinelearningsystem Goto Github PK

.github

21sigmod-lambdaml

Machine learning on serverless platform

21socc-morphling

Automatic tuning for ML model deployment on Kubernetes

22arxiv-st-moe-pytorch

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

22arxiv-xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

22atc-glet

22atc-kubernetes-scheduler-simulator

Kubernetes Scheduler Simulator

22atcglet

22icml-tspipe

Official Repository for the paper "TSPipe: Learn from Teacher Faster with Pipelines"

22nips-flash-attention

Fast and memory-efficient exact attention

22nsdi-clusterdata

cluster data collected from production clusters in Alibaba for cluster management research

22sc-ice

22sc2-stronghold

22socc-hidup

23acl-adaptive-retrieval

23arxiv-flex_model

23arxiv-memgpt

Teaching LLMs memory management for unbounded context 📚🦙

23arxiv-pipeoptim

23arxiv-saturn

Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.

23arxiv-sparsegpt

Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

23atc-envpipe

23atc-smartmoe-ae

ATC23 AE

23eurosys-espresso

Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '23)

23fast-shade

SHADE: Enable Fundamental Cacheability for Distributed Deep Learning Training

23generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

23iccv-dit

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

23icdcs-acpsgd

[ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning

23icml-dejavu

23icml-lomo

LOMO: LOw-Memory Optimization

23ipdps-mpipemoe