knagrecha's Projects
Resource-adaptive cluster scheduler for deep learning training.
Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray
An awesome README template to jumpstart your projects!
Data System for Optimized Deep Learning Model Selection
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
A distributed deep learning framework that supports flexible parallelization strategies.
OpenAIGym Simple Grid Env
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear speedups for multi-gpu multi-task execution.
My personal blog/website.
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
Research Exam for Kabir Nagrecha at UCSD.
quick test of gumbel softmax sampling
Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow
Mesh TensorFlow: Model Parallelism Made Easier
Tensorflow Fork to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines". See https://github.com/mkuchnik/PlumberApp for directions.
A very simple progress bar for c++ loops
Estimates the size of a PyTorch model in memory
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.
Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
stb single-file public domain libraries for C/C++
A Data Streaming Library for Efficient Neural Network Training
TF_Data_Service_Nightly
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch