Code Monkey home page Code Monkey logo

Hi there 👋

I used to study consistently from 3:30 AM to 3:30 PM. And then go to sleep from 5:20 PM to 2:45 AM (schedule optimized for studying, around 45m to fall asleep) for more than a year (I studied many other things before ML). AND REPEATED.

I stream daily on Twitch: twitch.tv/xrsrke

Currently, I'm building a library that enables training any 🤗 transformers models in 3D parallelism and ZeRO-1 out of the box, and learning about mechanistic interpretability.

DMs open

Best way to reach me is discord: neuralink, twitter/@xariusrke

XλRI-U5's Projects

gpt2 icon gpt2

Implementation of GPT-2

instructgoose icon instructgoose

Implementation of Reinforcement Learning from Human Feedback (RLHF)

lexios icon lexios

Symbolic framework for scientific calculation

memit icon memit

Implementation of Mass Editing Memory in a Transformer

mingpt icon mingpt

Just a repo i reimplement minGPT

minitron icon minitron

A mini Megatron 3D parallelism library for FSDL blog

morbius icon morbius

For my science project in the next few months (after the lexios finished)

mousai icon mousai

PyTorch Implementation of Moûsai: Text-to-Music Generation with Long-Context Latent Diffusion

muzero icon muzero

Implement MuZero from scratch [WORK IN PROGRESS]

nanogpt icon nanogpt

The simplest, fastest repository for training/finetuning medium-sized GPTs.

neograd icon neograd

A deep learning framework created from scratch with Python and NumPy

nmmo-baselines icon nmmo-baselines

Baselines for Neural MMO -- new users should treat this repo as a starter project

nmmo-environment icon nmmo-environment

Neural MMO - A Massively Multiagent Environment for Artificial Intelligence Research

paulinet icon paulinet

Model the wave function ansatz using a neural network

perceiver icon perceiver

Implementation of Perceiver: General Perception with Iterative Attention from DeepMind

pipegoose icon pipegoose

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.