wyhmhs Goto Github PK

a100_workshop

abacus

awesome-dl-scheduling-papers

chronusartifact

clipper

A low-latency prediction-serving system

cocktail

Cocktail: A Multidimensional Optimization for Model Serving in Cloud (NSDI'22)

cognn_info_for_sc22

deeprecsys

http://vlsiarch.eecs.harvard.edu/research/recommendation/

dvabatch

early-bird-tickets

[ICLR 2020] Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks

earlyrobust

freetickets

[ICLR 2022] "Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity" by Shiwei Liu, Tianlong Chen, Zahra Atashgahi, Xiaohan Chen, Ghada Sokar, Elena Mocanu, Mykola Pechenizkiy, Zhangyang Wang, Decebal Constantin Mocanu

gavel

Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020

gpu_programming_intro

gputaskscheduler

GPU Task Scheduler (Python library)

gslice

gSlice Slicing GPUs to Serve Heterogeneous Inference Requests

hack-sysml

The road to hack SysML and become an system expert

holmes

HOLMES: Health OnLine Model Ensemble Serving for Deep Learning Models in Intensive Care Units (KDD 2020)

igniter

iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.

infmoe

Inference framework for MoE layers based on TensorRT with Python binding

llmperf-for-tiledarch

Analytical Performance Model for Tiled Accelerators/Dies in Spatial Architecture Running Large Language Models (LLMs)

mark-project

Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving

megablocks

mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

ml-accelerators

Topics in Machine Learning Accelerator Design

muri

Artifacts for our SIGCOMM'22 paper Muri

nexus

nnif_adv_defense

Detection of adversarial examples using influence functions and nearest neighbors

open-gpu-kernel-modules

NVIDIA Linux open GPU kernel module source

openvino_notebooks

📚 A collection of Jupyter notebooks for learning and experimenting with OpenVINO 👓