Topic: language-model Goto Github

👇 Here are 1833 public repositories matching this topic...

ai-forever / ru-gpts
language-model,Russian GPT3 models.
Organization: ai-forever
deep-learning gpt3 language-model russian russian-language transformers

aiwaves-cn / agents
language-model,An Open-source Framework for Autonomous Language Agents
Organization: aiwaves-cn
Home Page: http://www.aiwaves-agents.com/
autonomous-agents language-model llm

blinkdl / chatrwkv
language-model,ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
User: blinkdl
chatbot chatgpt language-model pytorch rnn rwkv

blinkdl / rwkv-lm
language-model,RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
User: blinkdl
attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn

brightmart / nlp_chinese_corpus
language-model,大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
User: brightmart
chinese-dataset chinese-corpus pretrain word2vec nlp bert language-model wiki news question-answering

chiphuyen / lazynlp
language-model,Library to scrape and clean web pages to create massive datasets.
User: chiphuyen
artificial-intelligence natural-language-processing nlp text-mining language-model python open data-science

cluebenchmark / clue
language-model,中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
Organization: cluebenchmark
Home Page: http://www.CLUEbenchmarks.com
nlu benchmark chinese corpus dataset bert albert chineseglue glue roberta

codertimo / bert-pytorch
language-model,Google AI 2018 BERT pytorch implementation
User: codertimo
bert language-model nlp pytorch transformer

cvi-szu / linly
language-model,Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
Organization: cvi-szu
bert gpt-3 language-model llama nlp zero-shot-learning chatbot chatgpt chinese chinese-nlp

cyberzhg / keras-bert
language-model,Implementation of BERT that could load official pre-trained models for feature extraction and prediction
User: cyberzhg
bert keras language-model

dair-ai / prompt-engineering-guide
language-model,🐙 Guides, papers, lecture, notebooks and resources for prompt engineering
Organization: dair-ai
Home Page: https://www.promptingguide.ai/
deep-learning prompt-engineering openai chatgpt language-model

deepset-ai / haystack
language-model,:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
Organization: deepset-ai
Home Page: https://haystack.deepset.ai
nlp question-answering bert language-model pytorch semantic-search squad information-retrieval summarization transformers

docta-ai / docta
language-model,A Doctor for your data
Organization: docta-ai
data data-centric-ai data-centric-machine-learning data-curation data-diagnosis language-model rlhf

dvmazur / mixtral-offloading
language-model,Run Mixtral-8x7B models in Colab or consumer desktops
User: dvmazur
colab-notebook deep-learning google-colab language-model llm mixture-of-experts offloading pytorch quantization

eleutherai / gpt-neo
language-model,An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
Organization: eleutherai
Home Page: https://www.eleuther.ai
language-model transformers gpt gpt-2 gpt-3

eleutherai / gpt-neox
language-model,An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Organization: eleutherai
deepspeed-library gpt-3 transformers language-model

eleutherai / lm-evaluation-harness
language-model,A framework for few-shot evaluation of language models.
Organization: eleutherai
Home Page: https://www.eleuther.ai
evaluation-framework language-model transformer

eth-sri / lmql
language-model,A language for constraint-guided and efficient LLM programming.
Organization: eth-sri
Home Page: https://lmql.ai
chatgpt huggingface language-model programming-language

hiyouga / chatglm-efficient-tuning
language-model,Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
User: hiyouga
chatglm chatgpt fine-tuning lora alpaca peft huggingface language-model transformers pytorch

hiyouga / llama-factory
language-model,Unify Efficient Fine-Tuning of 100+ LLMs
User: hiyouga
fine-tuning language-model llama llm peft transformers rlhf qlora quantization chatglm

huggingface / tokenizers
language-model,💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Organization: huggingface
Home Page: https://huggingface.co/docs/tokenizers
nlp natural-language-processing natural-language-understanding language-model transformers bert gpt

huggingface / transformers
language-model,🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Organization: huggingface
Home Page: https://huggingface.co/transformers
bert deep-learning flax hacktoberfest jax language-model language-models machine-learning model-hub natural-language-processing nlp nlp-library pretrained-models python pytorch pytorch-transformers seq2seq speech-recognition tensorflow transformer

johnsnowlabs / spark-nlp
language-model,State of the Art Natural Language Processing
Organization: johnsnowlabs
Home Page: https://sparknlp.org/
nlp natural-language-processing spark pyspark named-entity-recognition sentiment-analysis lemmatizer spell-checker entity-extraction part-of-speech-tagger

laion-ai / open-assistant
language-model,OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
Organization: laion-ai
Home Page: https://open-assistant.io
chatgpt language-model rlhf ai assistant discord-bot machine-learning nextjs python

microsoft / generative-ai-for-beginners
language-model,18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
Organization: microsoft
Home Page: https://microsoft.github.io/generative-ai-for-beginners/
ai chatgpt dall-e generativeai gpt azure generative-ai llms openai prompt-engineering

microsoft / lmops
language-model,General technology for enabling AI capabilities w/ LLMs and MLLMs
Organization: microsoft
Home Page: https://aka.ms/GeneralAI
nlp agi gpt llm lm pretraining prompt lmops promptist x-prompt

microsoft / lora
language-model,Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
Organization: microsoft
Home Page: https://arxiv.org/abs/2106.09685
gpt-2 adaptation language-model gpt-3 low-rank pytorch deep-learning roberta deberta lora

mlc-ai / mlc-llm
language-model,Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
Organization: mlc-ai
Home Page: https://llm.mlc.ai/docs
llm machine-learning-compilation language-model tvm

mlc-ai / web-llm
language-model,Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.
Organization: mlc-ai
Home Page: https://mlc.ai/web-llm
deep-learning llm tvm webgpu webml chatgpt language-model

mlfoundations / open_clip
language-model,An open source implementation of CLIP.
Organization: mlfoundations
deep-learning pytorch computer-vision language-model multi-modal-learning contrastive-loss zero-shot-classification pretrained-models

mlfoundations / open_flamingo
language-model,An open-source framework for training large multimodal models.
Organization: mlfoundations
computer-vision deep-learning in-context-learning language-model multimodal-learning pytorch flamingo

neuml / txtai
language-model,💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
Organization: neuml
Home Page: https://neuml.github.io/txtai
python search machine-learning nlp semantic-search neural-search vector-search txtai llm vector-database

opennmt / opennmt-py
language-model,Open Source Neural Machine Translation and (Large) Language Models in PyTorch
Organization: opennmt
Home Page: https://opennmt.net/
deep-learning pytorch machine-translation neural-machine-translation language-model llms

optimalscale / lmflow
language-model,An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
Organization: optimalscale
Home Page: https://optimalscale.github.io/LMFlow/
chatgpt deep-learning instruction-following language-model pretrained-models pytorch transformer

ramonvc / freegpt-webui
language-model,GPT 3.5/4 with a Chat Web UI. No API key required.
User: ramonvc
Home Page: https://freegpt-webui-chimera.ramonvc.repl.co
apifree chatgpt chatgpt-api chatgpt-clone gpt-4-api gpt-interface gpt3 gpt3-api gpt3-turbo gpt4

ravenscroftj / turbopilot
language-model,Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
User: ravenscroftj
code-completion cpp language-model machine-learning

salesforce / codet5
language-model,Home of CodeT5: Open Code LLMs for Code Understanding and Generation
Organization: salesforce
Home Page: https://arxiv.org/abs/2305.07922
code-intelligence code-generation code-understanding large-language-models language-model

separius / awesome-sentence-embedding
language-model, A curated list of pretrained sentence and word embedding models
User: separius
awesome awesome-list bert contextualized-representation cross-lingual embedding-models language-model natural-language nlp pretrained-embedding pretrained-language-model pretrained-models sentence-embeddings sentence-representations subword-models unsupervised-learning word-embeddings wordembedding

speechbrain / speechbrain
language-model,A PyTorch-based Speech Toolkit
Organization: speechbrain
Home Page: http://speechbrain.github.io
speech-recognition speech-toolkit speaker-recognition speech-to-text speech-enhancement speech-separation audio audio-processing speech-processing speechrecognition

stochasticai / xturing
language-model,Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
Organization: stochasticai
Home Page: https://xturing.stochastic.ai
deep-learning fine-tuning gpt-2 gpt-j llama llm lora language-model alpaca finetuning

tatsu-lab / stanford_alpaca
language-model,Code and documentation to train Stanford's Alpaca models, and generate the data.
Organization: tatsu-lab
Home Page: https://crfm.stanford.edu/2023/03/13/alpaca.html
deep-learning instruction-following language-model

tensorflow / lingvo
language-model,Lingvo
Organization: tensorflow
speech-recognition translation speech-to-text machine-translation mnist seq2seq language-model tts asr lm nlp tensorflow speech research distributed gpu-computing speech-synthesis

thudm / cogvlm
language-model,a state-of-the-art-level open visual language model | 多模态预训练模型
Organization: thudm
cross-modality language-model multi-modal pretrained-models visual-language-models

vercel / ai
language-model,Build AI-powered applications with React, Svelte, Vue, and Solid
Organization: vercel
Home Page: https://sdk.vercel.ai/docs
artificial-intelligence huggingface javascript language-model llm openai react svelte typescript vercel

xlang-ai / openagents
language-model,OpenAgents: An Open Platform for Language Agents in the Wild
Organization: xlang-ai
Home Page: https://arxiv.org/abs/2310.10634
llm code-generation executable-langauge-grounding language-model semantic-parsing language-model-agent hacktoberfest agent assistant-chat-bots gpt

xtekky / chatgpt-clone
language-model,ChatGPT interface with better UI
User: xtekky
Home Page: https://g4f.ai
chatgpt chatgpt-api chatgpt-app chatgpt-clone gpt-4 gpt-4-api gpt3 gpt4 gpt4-api gpt4all

xtekky / gpt4free
language-model,The official gpt4free repository | various collection of powerful language models
User: xtekky
Home Page: https://g4f.ai
chatgpt chatgpt-4 chatgpt4 gpt gpt-3 gpt-4 gpt3 gpt4 gpt4-api openai

yizhongw / self-instruct
language-model,Aligning pretrained language models with instruction data generated by themselves.
User: yizhongw
general-purpose-model language-model instruction-tuning

young-geng / easylm
language-model,Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
User: young-geng
deep-learning flax jax language-model natural-language-processing transformer large-language-models chatbot llama

zzw922cn / awesome-speech-recognition-speech-synthesis-papers
language-model,Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
User: zzw922cn
acoustic-model attention-mechanism automatic-speech-recognition cnn diffusion-models dnn language-model neural-network papers recognition-synthesis rnn roadmap seq2seq singing-voice-synthesis speaker-verification speech-recognition speech-synthesis timit-dataset tts voice-conversion