drxd1000 Goto Github PK

atlassian-python-api

Atlassian Python REST API wrapper

autoawq

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

bitnet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

conversational-agent-langchain

FastAPI Backend for a Conversational Agent using Aleph Alpha, (Azure) OpenAI, GPT4ALL, Langchain and a VectorDB

fast_robust_early_exit

Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)

fasteval

Fast evaluation of chat language models. Includes leaderboard.

galore

kdt_chatbot

kraken

laserrmt

This is our own implementation of 'Layer Selective Rank Reduction'

llama.cpp

LLM inference in C/C++

llm-awq

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

lm-evaluation-harness-de

A framework for few-shot evaluation of autoregressive language models.

lomo

LOMO: LOw-Memory Optimization

lookaheaddecoding

makemoe

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

mergekit

Tools for merging pretrained large language models.

nanogpt

The simplest, fastest repository for training/finetuning medium-sized GPTs.

ng-video-lecture

slimtrainer

Full finetuning of large language models without large memory requirements

transformer_tds

Transformer seq2seq model, program that can build a language translator from parallel corpus

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs