This is code + flask app for finetuning RedPajama 3B model on a Kaggle dataset of 200000 dadjokes from Reddit. The app runs inference on a checkpoint to generate a joke and then renders it in Joe Biden's voice.

Download the dataset here Then run create_dataset.py in redpajama_lora_finetune/data/ folder to create train.jsonl and eval.jsonl

pip install -r requirements.txt

To run finetuning CUDA_SET_VISIBLE_DEVICES=0 python train.py

Access the app here

This was built at Any Thing But Wrappers Hackathon.