Comments (6)
okay, seems like this happens when temperature is 0.
after removing that param I'm seeing text being generated, but it contains some weird tokens. Any idea what's up with that
"text": "\u00b4amangert'\nmeaning it involves the use of astronauts to\nperform certain activities?\nOr is Amagert a management wizard who writes a\nspell to reverse the age of wizards who are\nover 400 years old?\nAnd these are specific examples. There are\nmany many others. But yet it has not been taken\nto court to see what can be argued in this.\n1. Pepsi does not believe that its position is\na legal one. Applying full compensation is a\nrelief and not an apology). It could have argued\nto its conclusion using equal measures, but\noffered an apology to quash all worries caused.\nIt did not.\nThats the difference between different types of\napologies. Different shows and different apology\nmethods. Advertising as well as politics use the\nchannel to deliver the apology to its target\nsure tackle the question i will just choose the\napproach which will please people. Your question\nis wrong. Diet Pepsi which is Ig2 with carbohydrates\n3 per cent gave the nation its first national\nIcy Capital Pepsi.\nso how can you say it is a full compensation?\na lot of young little guys... during",
from ai00_server.
You may change your prompt into "A profression that involves going to space is an", i.e., without the space at the end. With/without a space at the end is totally different thing for the model.
from ai00_server.
openai_api_base = "http://0.0.0.0:65530/api/oai" 0.0.0.0 means any local ip
use 127.0.0.1 maybe
from ai00_server.
the response told you ==> "finish_reason": "length"
payload = {
"prompt": prompt,
"max_tokens": 3, <=======
"model": "rwkv",
"temperature": 0
}
"max_tokens": 3, ===> "max_tokens": max_tokens,
from ai00_server.
openai_api_base = "http://0.0.0.0:65530/api/oai" 0.0.0.0 means any local ip use 127.0.0.1 maybe
It's not an issue with connecting to the api. The output contains weird tokens
from ai00_server.
@cryscan I'll give that a shot next time I'm messing around with rwkv.
From what I remember though, it'd happen even if i only put the word "Hello" as the prompt.
from ai00_server.
Related Issues (20)
- 用openai的API库发送请求,返回HTTP400 HOT 3
- 聊天过程中,输入问题后,希望加入回车发送问题 HOT 2
- 2 bugs in mirostat sampler HOT 3
- Crash on chat: Cannot start a runtime from within a runtime. HOT 3
- Need help to run server in Kaggle HOT 2
- server start problems HOT 3
- 小小的要求,能有主题更换功能吗? HOT 2
- Add min-p samping HOT 1
- Feature request: NoRepeatNgram
- [bug] Penalty decay argument seems to be compulsory? HOT 1
- v0.4 前后端需求汇总
- 1.76环境ubuntu编译报错 HOT 2
- Issue starting server on Manjaro HOT 2
- ambiguous finish reason
- 0.3.24 outputs gibberish HOT 5
- Feature request: Huggingface tokenizer support HOT 1
- Documents should not be deployed if not finished HOT 3
- 怎么中断聊天 HOT 1
- 怎么中断聊天
- 使用ai00频繁爆语料 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai00_server.