Lily Erickson's Projects
Experimental beginner level code for manipulating data
The code associated with my cross-axis transformer research project.
Space filling curve for preserving spatial locality with a focus on the center of the image, inspired by Hilbert Curves
A negotiating and deal-marking card game & strategy game.
A webui for hand cleaning important data. More visually appealing than raw json.
A basic transformer architecture in flax. XLA compiler go brrrrr
An image processor for a modular vision pipeline
Help scripts for navigating the low level jax libraries
A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
A backup for various code demos. Not intended for deployment or even functionality.
Pytorch implementation of 2D Discrete Wavelet (DWT) and Dual Tree Complex Wavelet Transforms (DTCWT) and a DTCWT based ScatterNet
RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Scenic: A Jax Library for Computer Vision Research and Beyond
Nice basic local sql database class
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, OPT, and GALACTICA.
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.