Comments (6)
Refer to the source code, it's NOT supported yet.
Lines 15 to 33 in 429559f
yes that's why i made one
https://www.npmjs.com/package/vicuna-ts
from gpt4all-ts.
originally thats what i wanted but gpt4all-ts s code would have become mess if i stuffed vicuna
from gpt4all-ts.
So i installed VICUNA with this repo
https://github.com/mps256/autovicuna
They put everything in C:/VICUNA
(only 13B Vicuna CPU )
they use
llama.zip
and
ggml-vicuna-13b-4bit.bin
you can get these from
https://huggingface.co/eachadea/ggml-vicuna-13b-4bit/blob/main/ggml-vicuna-13b-4bit-rev1.bin
" ...rev1.bin" have some fixes but its not included in mps256/autovicuna ig
you can get 7B from and it can run on same llama files
https://huggingface.co/eachadea/ggml-vicuna-7b-4bit/tree/main
Heres Some SS running 13B VICUNA
and here 7B (its faster and gives answers better than LLAMA/ alpaca in my pov)
output sometimes end with
maybe because of these
Reverse prompt: '### Human:'
Reverse prompt: '### Instruction:
from gpt4all-ts.
C:\VICUNA\main.exe -i --interactive-first -r "### Human:" -t 8 --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m C:\VICUNA\ggml-vicuna-7b-4bit-rev1.bin
sample command
from gpt4all-ts.
Refer to the source code, it's NOT supported yet.
Lines 15 to 33 in 429559f
from gpt4all-ts.
Refer to the source code, it's NOT supported yet.
Lines 15 to 33 in 429559f
yes that's why i made one
Nice 👍 Do you think that's good for community if your package is part of gpt4all-ts? Have you considered to send PR to gpt4all-ts? Thanks.
from gpt4all-ts.
Related Issues (20)
- Unable to open the connection with the model HOT 3
- Discord invite
- gpt4all.open() doesnt work HOT 5
- Printing gibrish on terminal when running
- Support for multiple requests simultaneously
- ENOENT when starting the app while having the model and everything downloaded HOT 1
- [1m[32m[0m with response every time. HOT 1
- Can't provide stop tokens/patterns HOT 1
- Other installation steps?
- gpt4all-j does not seem to be supported?
- it's not working. HOT 1
- [Binding/UI] Node-RED nodes and flows for GPT4All
- Package is broken, downloaded files are no longer hosted at the paths hard-coded in the script HOT 1
- Support for nous-gpt4-vicuna-13b? HOT 1
- Axios error 404 when creating a new GPT4All instance -- npm version out of date? HOT 3
- Opinion
- [BUG] Windows model downloads not working as expected HOT 3
- GPT3 downloading model was taking too long HOT 2
- Root readme.md says import from "gpt4all-ts" but should be "gpt4all" HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gpt4all-ts.