Comments (12)
@a3957273 apologies for the late response. We're working on a design to support multiple bots tied to different LLMs in Enterprise, would love to get your feedback on it if you have a chance: https://www.loom.com/share/9e7cbcc3d36a4c93ac0ce818c1439dd4
Configuration of multiple bots tied to different LLMs:
UI selector to target conversations with different bots:
UI selector to target summaries and other UI interactions with different bots:
Happy to setup a call to chat through it more detail.
Can I also ask what Mattermost server version you are running?
from mattermost-plugin-ai.
@esethna Ideally, we would be able to select a user group. I guess using a private channel would be equivalent? Using a Team like currently can do it, but as I understand it using Teams comes with other constraints that might affect the deployment.
from mattermost-plugin-ai.
Thanks for sharing this @a3957273! This is certainly something we're considering.
At the moment we have recompiled multiple versions of the plugin with different names and configuration, but this is not scaling well as more and more models are being introduced
Do you mind expanding on some of the challenges you're facing with scaling in this way?
from mattermost-plugin-ai.
Hey, apologies for the delay. This account is not regularly checked. When running fewer than half a dozen models, it was okay to spend ~30 minutes changing the plugin identifier, updating the selector, altering all the unique information, updating our internal plugin store and creating the config for it. This is impractical for running dozens or hundreds of models, especially when we want to run multiple versions of the same model.
from mattermost-plugin-ai.
Now with v0.4 and the custom display type, it's become increasingly difficult to support multiple bots. We can no longer run multiple of the same plugins or we run into issues with the frontend plugin.
Is there any route at the moment to running multiple LLMs on one instance?
from mattermost-plugin-ai.
At the moment we've solved this by allocating one "primary" plugin. This plugin is setup to be the only one to add UI functionality. Then, every other plugin is a "secondary" plugin which only provides a bot to chat with.
from mattermost-plugin-ai.
This looks fantastic and precisely what we'd be looking for! I've tried out the multiple bot feature that's available in the latest commits and it seems rather a good way of specifying them. I enjoy the added features here such as allowing the selection of custom profile pictures, as well as the simplicity of switching between them.
from mattermost-plugin-ai.
+1 on this, the proposed UI looks very useful to experiment with various models. In the per bot configuration, it would be ideal to be able to control who can use it.
from mattermost-plugin-ai.
Thanks for the feedback!
@etiennellipse when you say "In the per bot configuration, it would be ideal to be able to control who can use it." can you expand on the specific controls you're looking for and why they are needed?
For example, is it a list of individuals who have access to each bot, or is it based on teams, channels, custom user groups etc?
from mattermost-plugin-ai.
@esethna this UI available in current repo?
from mattermost-plugin-ai.
@grandtele not yet. The designs I shared above are concepts we are validating before we build. Please share any feedback you have on them!
from mattermost-plugin-ai.
#175 Is our implementation of the suggestions in this issue.
It is included in the 0.8.0 release on the repo: https://github.com/mattermost/mattermost-plugin-ai/releases/tag/v0.8.0
@a3957273 and everyone else we would love to hear feedback from everyone here if the solution works for them and how we can improve.
from mattermost-plugin-ai.
Related Issues (20)
- 🐛 bug: Anthropic model integration Issue: Header requirement error and failed responses HOT 5
- 🐛 bug: deleting suggested prompt prevents me from using another suggested prompt
- 💡 idea: add supported Mattermost server versions to README
- 🐛 bug: When replying in a thread, the response from OpenAI is not updated on the main screen in the stream.
- Why Does My AI Reply to My Threads Instead of Posting Directly in the Channel? HOT 5
- 💡 idea: add google gemini to list of supported backends HOT 2
- 💡 idea: Update README header image to say "Mattermost AI Copilot" instead of "The Mattermost AI Plugin" HOT 1
- 💡 idea: remove duplicative docs HOT 1
- 💡 idea: add a data-preloaded Mattermost server to facilitate demos and testing
- 💡 idea: Take into account the user locale for AI actions HOT 8
- 💡 idea: Soften the Enterprise requirement for multiple LLM backends (Add AI Service) HOT 2
- 💡 idea: Plugin operation via proxy
- Initiating an Indefinite Number of Same Bot Conversation
- 💡 idea: Export Prometheus Metrics about usage HOT 3
- Design Preview: AI-enhanced Search
- 🐛 bug: timeout streaming error when used with LocalAI HOT 4
- 🐛 bug: prompt buttons populate the Thread input instead of AI RHS input
- 🐛 bug: failure with anthropic claude engine when multiple user messages in a row HOT 4
- 🐛 bug: Somtimes the blinking cursor on responces appears in the wrong place.
- 🐛 bug: Hover state for AI menu inconsistant with other post menus
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mattermost-plugin-ai.