yangjianxin1 Goto Github PK

followers: 514.0 following: 29.0 repos: 24.0 gists: 0.0

Name: Yang JianXin

Type: User

Company: Sun Yat-Sen University

Bio: Firefly大模型 | 公众号：YeungNLP | 知乎：红雨瓢泼

Location: ShenZhen, China

Blog: https://www.zhihu.com/people/jian-xin-15-96

Hi there 👋, I'm Yang Jianxin

I'm a NLPer interested in Large Language Model and graduated from SYSU with a master's degree.

In my free time, I like to write technical blogs on [Wechat Official Accounts: YeungNLP] and [Zhihu: 红雨瓢泼]

🔭 Experiences:

Shopee, responsible for building NLP algorithm ability about Customer Service. (from 2022-04 to now)
Tencent, responsible for building NLP algorithm ability about Product Understanding. (from 2021-06 to 2022-04)
Alibaba, Internship at Alibaba (from 2020-06 to 2020-09).

⚙ Here are some my public projects:

Project	Description	Code
Firefly	One-stop training for LLMs. Some achievements: 1. firefly-llama2-13b ranked 3rd among all 13B models on Open LLM Leaderboard, only 0.5 points less than 1st. 2. firefly-llama-30b ranked 10th among all 30B models on Open LLM Leaderboard trained with single V100. 3. firefly-baichuan-13b achieves over 1.63 million downloads. 4. firefly-qwen1.5-en-7b-dpo improves 7.21 points compared with the official chat model. 5. firefly-gemma-7b improves 9.37 points compared with the official chat model.
GPT2-chitchat	Chinese GPT2 for chitchat
Firefly-LLaMA2-Chinese	Chinese Llama2 with efficient and effective training method.
LongQLoRA	Efficient and Effective method for extending context length of Llama2 to 8192 with single V100. Technical Report
CPM	Chinese composition model based on CPM
CLIP-Chinese	Chinese CLIP model trained with 1.4 million image-text pairs
ClipCap-Chinese	Chinese image caption model based on clip and mengzi
OFA-Chinese	Chinese multi-modal unified pre-training model
LLMPruner	Prune vocabulary of LLMs to save memory in training.

📁 Here are some my technical blogs:

Yang JianXin's Projects

balanced-dataparallel

这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量

bert-ner-pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

chatglm3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

chinese-llama-alpaca

中文LLaMA&Alpaca大语言模型+本地CPU部署 (Chinese LLaMA & Alpaca LLMs)

chinese2digits

最好的汉字数字(中文数字)-阿拉伯数字转换工具。包含"点二八"，"负百分之四十"等众多汉语表达方法。NLP，机器人工程必备！ The Best Tool of Chinese Number to Digits

clip-chinese

中文CLIP预训练模型

clipcap-chinese

基于ClipCap的看图说话Image Caption模型

controlnet

Let us control diffusion models

cpm

Easy-to-use CPM for Chinese text generation（基于CPM的中文文本生成）

firefly

Firefly: 大模型训练工具，支持训练Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型