jasonkrone / applied-ai Goto Github PK

For experiments and research on Applied AI.

Housing a variety of Triton and CUDA kernels for training and inference.

Inference kernels = no backward pass support.

Fused RMSNorm Kernel

1. CUDA Mode - Reading group for learning CUDA programming - (Discord, Lecture Materials, Lecture recordings)
2. llama-recipes - Recipes for fine-tuning and inference for Llama model series
3. NeurIPS'23 LLM Efficiency Challenge - 1LLM + 1GPU + 1Day competition - (website, code, NeurIPS Workshop recordings)

1. PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph Compilation paper
2. Accelerating a Triton Fused Kernel for W4A16 Quantized Inference with SplitK Work Decomposition paper
3. PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel paper
4. Sustainable AI: Environmental Implications, Challenges and Opportunities paper

The applied-ai repo is released under the BSD 3 license.