oldstree Goto Github PK

100-gdb-tips

A collection of gdb tips. 100 maybe just mean many here.

bytepiece

更纯粹、更高压缩率的Tokenizer

channel-lm-prompting

An original implementation of "Noisy Channel Language Model Prompting for Few-Shot Text Classification"

char-rnn-tensorflow

Multi-language Char RNN for TensorFlow >= 1.2.

colossalai

Making large AI models cheaper, faster and more accessible

consert

Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer

firefly

Firefly: 大模型训练工具，支持训练Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

geometry-of-truth

grip

Preview GitHub README.md files locally before committing them.

libmtl

A PyTorch Library for Multi-Task Learning

lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

llama

Inference code for LLaMA models

llama2.c

Inference Llama 2 in one file of pure C

metaicl

An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi

mistral-src

Reference implementation of Mistral AI 7B v0.1 model.

moss-rlhf

MOSS-RLHF

nanogpt

The simplest, fastest repository for training/finetuning medium-sized GPTs.

nlp_model

some models of NLP

nlper-interview

该仓库主要记录 NLP 算法工程师相关的面试题

numpy-ml

Machine learning, in numpy

prompt-engineering-guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

pytorchgradientcheckpointing

This repository contains code for gradient checkpoining for Google's BERT and a CNN

seq2seq-couplet

Play couplet with seq2seq model. 用深度学习对对联。

sparse_attention

Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.

transformers_tasks

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.

trl

Train transformer language models with reinforcement learning.

weak-to-strong