lucidrains Goto Github PK

keops

KErnel OPerationS, on CPUs and GPUs, with autodiff and without memory overflows

kronecker-attention-pytorch

Implementation of Kronecker Attention in Pytorch

lambda-networks

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

lb_pool

HTTP client load balancer with retries

learning-to-expire-pytorch

An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain

lie-transformer-pytorch

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

lightweight-gan

Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two

linear-attention-transformer

Transformer based on a variant of attention that is linear complexity in respect to sequence length

linformer

Implementation of Linformer for Pytorch

lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

liquid-conway

Liquid simulator based on Conway's Game of Life

llama-qrlhf

Implementation of the Llama architecture with RLHF + Q-learning

llama2.nim

Implementation of Llama2 inference in Nim

local-attention

An implementation of local windowed attention for language modeling

local-attention-flax

Local Attention - Flax module for Jax

logavgexp-torch

Implementation of LogAvgExp for Pytorch

long-short-transformer

Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch

lucidrains

Config files for my GitHub profile.

lucidrains.github.io

lumiere-pytorch

Implementation of Lumiere, SOTA text-to-video generation from Google Deepmind, in Pytorch

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

mammut-pytorch

Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch

marge-pytorch

Implementation of Marge, Pre-training via Paraphrasing, in Pytorch

med-seg-diff-pytorch

Implementation of MedSegDiff in Pytorch - SOTA medical segmentation using DDPM and filtering of features in fourier space

medical-ai-experiments

A repository to house some personal attempts to beat some state-of-the-art for medical datasets

medical-chatgpt

Implementation of ChatGPT, but tailored towards primary care medicine, with the reward being able to collect patient histories in a thorough and efficient manner and come up with a reasonable differential diagnosis

mega-pytorch

Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena

megabyte-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

memcnn

PyTorch Framework for Developing Memory Efficient Deep Invertible Networks