haileyschoelkopf Goto Github PK

adapter-transformers

Huggingface Transformers + Adapters = ❤️

amazon-sagemaker-examples

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

awesome-multilingualsumm

bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

composable-sft

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

emergent_in_context_learning

flan

Provides a minimal implementation to extract FLAN datasets for further processing

goat

GOAT dataset without ChatGPT-written templates

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

haileyschoelkopf.github.io

Personal Blog. Under construction for now.

human-eval-infilling

Code for the paper "Efficient Training of Language Models to Fill in the Middle"

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

mamba

megablocks

megatron-deepspeed-mt0

Ongoing research training transformer language models at scale, including: BERT & GPT-2

minimal-mistakes

Personal Website for interim use. Under Construction

multilingual-generalization-papers

multilingual-modeling

promptsource

Toolkit for creating, sharing and using natural language prompts.

qdsyntheticdata

reinforce-lms

Project for NERH RLHF hackathon

roots-search-tool

Scripts supporting the development and serving the Roots Search Tool - https://hf.co/spaces/bigscience-data/roots-search

summertime

An open-source text summarization toolkit for non-experts.

text-to-text-transfer-transformer

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

to-read-list

Collecting links to NLP / CV papers so that I don't forget to read them. As of 6/7/22

toy-scaling-laws

transformerlens

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs