jianzhnie / open-chatgpt Goto Github PK

View Code? Open in Web Editor NEW

164.0 11.0 29.0 762 KB

The open source implementation of ChatGPT, Alpaca, Vicuna and RLHF Pipeline. 从0开始实现一个ChatGPT.

Home Page: https://jianzhnie.github.io/machine-learning-wiki/#/deep-rl/papers/RLHF

License: Apache License 2.0

Python 100.00%

chatgpt gpt llm rlhf ppo llama stanford-alpaca lora peft

open-chatgpt's Introduction

Hi there, I'm Robin 👋

Hi there 👋

Hey, I am jianzhnie, Thanks for stopping by!

I work as a full-time Machine Learning engineer and write tutorials on basic and advanced topics (NLP, Computer vision and code - lots of it).

I read and think a lot. And sometimes I put them in a form of a painting or a piece of music. And when I need to catch a breath I go for a run.

I’m currently working on 🔭

Developing the open source ChatGPT, Alpaca, Vicuna and RLHF Pipeline. open-chatgpt
Developing nlp-toolkit nlp-toolkit
Developing MultiModalTransformers MultiModalTransformers
Developing AutoML tools for DeepLearning Project and MacheLearning Project AutoTimm | AutoTabular
Trying hard to reduce the Learning Machine Learning(LML) loss 😂
Coding everyday for better research engineering skill

I’m currently learning 🌱

Theoretical Machine Learning from the basic
Pytorch and Pytorch-lightning
Transformer models (BERT,GPT, T5, VIT, SwinTransformer)
Reinformnet Learning (DQN, A2C, PPO, SAC, TD3 ...)

How to reach me 📫

📫 Email: [email protected]
📫 Homepage: https://jianzhnie.github.io
📫 Wiki: https://jianzhnie.github.io/llmtech/
📖 Blog: https://www.zhihu.com/column/fengnie
🤗 Huggingface Org: https://huggingface.co/GaussianTech
📫 Linkdin: https://www.linkedin.com/in/jianzheng-nie-2749b7156/
💬 Ask me about: Statistics and Machine Learning.
❤️ Sponsor me on GitHub

Have an awesome day!

open-chatgpt's People

Contributors

Stargazers

Watchers

open-chatgpt's Issues

请问支持chatglm的RLHF吗

谢谢

python train_reward_model.py module 'tensorflow' has no attribute 'data'

When I run "python train_reward_model.py", I get the following error. How can I solve it?
Python version 3.10.8

Traceback (most recent call last):
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py", line 1110, in get_module
return importlib.import_module("." + module_name, self.name)
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\importlib_init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in load_unlocked
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\trainer.py", line 67, in
from .data.data_collator import DataCollator, DataCollatorWithPadding, default_data_collator
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\data_init.py", line 31, in
from .processors import (
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\data\processors_init.py", line 19, in
from .glue import glue_convert_examples_to_features, glue_output_modes, glue_processors, glue_tasks_num_labels
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\data\processors\glue.py", line 79, in
examples: tf.data.Dataset,
AttributeError: module 'tensorflow' has no attribute 'data'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Windows\System32\open-chatgpt\examples\summarization\train_reward_model.py", line 4, in
from transformers import (AutoTokenizer, EarlyStoppingCallback, EvalPrediction,
File "", line 1075, in _handle_fromlist
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py", line 1100, in getattr
module = self._get_module(self._class_to_module[name])
File "C:\Users\charley\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\utils\import_utils.py", line 1112, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):
module 'tensorflow' has no attribute 'data'