[Feature Request]: 关于 max_tokens 用法的建议 about chatgpt-next-web HOT 3 CLOSED

Bot detected the issue body's language is not English, translate it automatically.

Title: [Feature Request]: Suggestions on max_tokens usage

Problem Description

The max_tokens parameter of different models is used in different ways. In some models, if the value passed in max_tokens is inappropriate, the request will be rejected or the enunciation will be interrupted. Adding additional settings of max_tokens to the visual model is due to this problem. Regarding whether max_tokens should be passed or not. There are also many issues discussed.

Solution Description

I would like to give a suggestion for this. You can set a toggle button on the front end to control whether the current conversation passes the max_tokens parameter to the model. This can appropriately reduce the hard coding work in the program when adapting to the new model, because in addition to the determination of isVisionModel, the user can directly pass max_tokens through the front-end control. I think this design can effectively reduce the conversation trouble caused by the max_tokens parameter.

Alternatives Considered

No response

Additional Context

No response

from chatgpt-next-web.

非常同意你对max_tokens的看法，目前看，max_tokens和具体模型是强关联的，因此，在新版本中，我们将会把max_tokens作为具体模型的参数，支持用户对于模型的max_tokens进行自定义

from chatgpt-next-web.

Bot detected the issue body's language is not English, translate it automatically.

I very much agree with your view on max_tokens. At present, max_tokens is strongly related to the specific model. Therefore, in the new version, we will use max_tokens as a parameter of the specific model to support users to customize the max_tokens of the model.

from chatgpt-next-web.