karpathy Goto Github PK

arxiv-sanity-lite

arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors based on paper abstracts.

arxiv-sanity-preserver

Web interface for browsing, search and filtering recent arxiv submissions

char-rnn

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch

convnetjs

Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

covid-sanity

Aspires to help the influx of bioRxiv / medRxiv papers on COVID-19

cryptos

Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes

deep-vector-quantization

VQVAEs, GumbelSoftmaxes and friends

eigenlibsvm

A wrapper for LibSVM that lets you train SVM's directly on Eigen library matrices in C++

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

find-birds

Find people you should follow on Twitter based on who the people you follow follow

forestjs

Random Forest implementation for JavaScript. Supports arbitrary weak learners. Includes interactive demo.

gitstats

A lightweight/pretty visualizer for recent work on a git code base in multiple branches. Helps stay up to date with teams working on one git repo in many branches.

karpathy

root repo

karpathy.github.io

my blog

lecun1989-repro

Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation.

lifejs

Artificial Life simulator using canvas. Based on https://github.com/karpathy/scriptsbots

llama2.c

Inference Llama 2 in one file of pure C

llm.c

LLM training in simple, raw C/CUDA

makemore

An autoregressive character-level language model for making more things

matlabwrapper

C++ convenience class to communicate with a Matlab instance. Send matrices back and forth, execute arbitrary Matlab commands, or drop into interactive Matlab session right in the middle of your C++ code.

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

mingpt

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

nanogpt

The simplest, fastest repository for training/finetuning medium-sized GPTs.

neuraltalk

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

neuraltalk2

Efficient Image Captioning code in Torch, runs on GPU

ng-video-lecture

nipspreview

Scripts that generate .html to more easily see NIPS papers

nn

nn-zero-to-hero

Neural Networks: Zero to Hero