🐛 bug: timeout streaming error when used with LocalAI about mattermost-plugin-ai HOT 3 OPEN

I encountered the same issue with ollama as well. I think it's because the default value for StreamTimeoutSecond is too short. Is it possible to configure this value?

from mattermost-plugin-ai.

Me too.

How exactly do we solve this?

I know I'm lengthening that time, but each version has a different source, so I don't know what to change. I'm using the latest version of 0.8.

from mattermost-plugin-ai.

I refer to the configuration file of this plugin, there is a parameter to configure the streaming timeout in seconds.

StreamingTimeoutSeconds int json:"streamingTimeoutSeconds"

https://github.com/mattermost/mattermost-plugin-ai/blob/master/server/ai/configuration.go

After you have enabled this plugin in MatterMost, open up MatterMost configuration file (config.json) and look for the section belonging to this plugin. It should look something like this.

"service":{
"apiKey": ,
"apiURL": ,
"defaultModel": ,
"id": ,
"orgId": ,
"password": ,
"tokenLimit": ,
"type": ,
"username":
}

Append "streamingTimeoutSeconds": xxx, to "service" object, save and restart MatterMost service. The timeout should be extended to the value configured in the MatterMost config file.

Would be much easier if this field is made configurable in the UI.

from mattermost-plugin-ai.