Comments (2)
bstadt
commented on June 6, 2024
I wonder if this exists in the training data:
https://atlas.nomic.ai/map/gpt4all_data_clean_without_p3
if you can identify a query or subset that has this property, we will exclude it from the next train
from gpt4all.
michael-quinlan
commented on June 6, 2024
I think this is happening in lora training. I saw a similar issue tloen/alpaca-lora#110 and I did some fine-tuning myself with some custom data (on the alpaca-lora code) and I saw the exact behavior you see here of generating formated instructions. I know i'm bringing issues from cross repo but the fact this exsits in multiple implementations must mean something.
from gpt4all.
Related Issues (20)
- Getting unauthorized trying to use API HOT 3
- Aun no he conseguido descagar GPT4all y menos instalarla me podeis ayudar por favor HOT 2
- API accepting invalid model without producing error HOT 3
- [Feature] model folder reload
- [Feature] Favorite chats, pinned chats, or colorful emoji in chat titles
- Getting gibberish responses from 2.7.5 build. HOT 3
- typescript: Could not find any implementations for build variant: default HOT 3
- [Feature] add a button to duplicate a chat and use it as a starting context for new chats
- [Feature] Support old MPT GGUF conversions with duplicated output tensor HOT 1
- C# Bindings need updating HOT 1
- Can't install HOT 2
- [Feature] Please Add Option for Llama 3 70B Parameters HOT 3
- [Feature] Support for GPT 4 Turbo
- UI: If you have too many installed models, the list gets cut off and can't be scrolled
- [Feature] Ctrl+F to search text inside a discussion
- bug
- v2.7.5 Windows Local and Server Model both use Llama 3 Instruct, program crash HOT 1
- [Feature] indicate the max context size of each model in the download list ?
- [Feature] check the compatibility of a hugging face model before fully downloading it ? HOT 1
- Idk what this is honestly HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt4all.