Code Monkey home page Code Monkey logo

Comments (6)

benbot avatar benbot commented on June 3, 2024

okay, seems like this happens when temperature is 0.

after removing that param I'm seeing text being generated, but it contains some weird tokens. Any idea what's up with that

      "text": "\u00b4amangert'\nmeaning it involves the use of astronauts to\nperform certain activities?\nOr is Amagert a management wizard who writes a\nspell to reverse the age of wizards who are\nover 400 years old?\nAnd these are specific examples. There are\nmany many others. But yet it has not been taken\nto court to see what can be argued in this.\n1. Pepsi does not believe that its position is\na legal one. Applying full compensation is a\nrelief and not an apology). It could have argued\nto its conclusion using equal measures, but\noffered an apology to quash all worries caused.\nIt did not.\nThats the difference between different types of\napologies. Different shows and different apology\nmethods. Advertising as well as politics use the\nchannel to deliver the apology to its target\nsure tackle the question i will just choose the\napproach which will please people. Your question\nis wrong. Diet Pepsi which is Ig2 with carbohydrates\n3 per cent gave the nation its first national\nIcy Capital Pepsi.\nso how can you say it is a full compensation?\na lot of young little guys... during",

from ai00_server.

cryscan avatar cryscan commented on June 3, 2024

You may change your prompt into "A profression that involves going to space is an", i.e., without the space at the end. With/without a space at the end is totally different thing for the model.

from ai00_server.

cgisky1980 avatar cgisky1980 commented on June 3, 2024

openai_api_base = "http://0.0.0.0:65530/api/oai" 0.0.0.0 means any local ip
use 127.0.0.1 maybe

from ai00_server.

cgisky1980 avatar cgisky1980 commented on June 3, 2024

the response told you ==> "finish_reason": "length"

payload = {
"prompt": prompt,
"max_tokens": 3, <=======
"model": "rwkv",
"temperature": 0
}

  "max_tokens": 3,  ===>      "max_tokens": max_tokens, 

from ai00_server.

benbot avatar benbot commented on June 3, 2024

openai_api_base = "http://0.0.0.0:65530/api/oai" 0.0.0.0 means any local ip use 127.0.0.1 maybe

It's not an issue with connecting to the api. The output contains weird tokens

from ai00_server.

benbot avatar benbot commented on June 3, 2024

@cryscan I'll give that a shot next time I'm messing around with rwkv.

From what I remember though, it'd happen even if i only put the word "Hello" as the prompt.

from ai00_server.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.