Support MySQL about mattermost-plugin-ai HOT 25 OPEN

when you are going to be share out guidance for existing users and customers around migrating to PostgreSQL. We need your help and waiting to hearing from you.

Or, ideally, a migrator that can just take in the new Postgres config details and perform the migration MySQL -> PostgreSQL.

Agree, Mattermost needs to provide this--the schemas between MySQL and PostgreSQL are similar but not identical and we need to work with our community to provide migration guidance. Let me circle back with @chenilim and see when we might be able to provide more guidance.

from mattermost-plugin-ai.

Many customers still use MySQL and as long as there is no clear & easy migration part, there will be no customer-based feedback on the AI plugin. I'm still willing to switch, but I will not do this without a documented path on what I've got to do. Another problem is the non-existing knowledge on PostgreSQL in my company...

from mattermost-plugin-ai.

@cahaseler @jprusch agree with your input. It doesn't make sense to have all the default point to MySQL and yet only support PostgreSQL for AI.

We'll take an action internally to discuss and share back.

from mattermost-plugin-ai.

@jprusch @cahaseler as discussed we have published the first draft here. https://docs.mattermost.com/deploy/postgres-migration.html

Any thoughts feedback please share, if possible, at community.mattermost.com (@neil.barnett).

from mattermost-plugin-ai.

Hi @jprusch after many years of trying to make things work, we've made the decision to start moving away from MySQL as a Mattermost community, primarily because of reliability and performance issues at scale, and shifting to PostgreSQL.

We're going to be sharing out guidance for existing users and customers around migrating to PostgreSQL as this gets underway, and our new investments will start guiding towards PostgreSQL.

We realize this may narrow the number of people and organizations that participate in our community, however we believe being more streamlined in our support matrix is going to result in stronger results for the community that comes along with us.

from mattermost-plugin-ai.

Well that forces customers who have a strong MySQL knowledge to switch to PostgreSQL presumingly leading to more support requests. Performance might be an issue on high-scale implementations for thousands of users. These customers naturally license the enterprise version & got support from Mattermost. Medium & small customers with 10 - 1000 users will not hit any of the performance limits. Running MySQL since 2007 we never had any reliability issues & have we a working replication out of the box.
I just came about this article:

https://www.percona.com/blog/mysql-or-postgresql-which-is-better/

The most important part is:

I used to be the Certification Manager for MySQL AB (and Sun Microsystems and Oracle) and
spoke frequently to hiring managers who routinely told me it was very hard to find 
qualified MySQL DBAs. And they said it was impossible to find qualified PostgreSQL DBAs.
If you and your staff have experience and skill in one of the databases, 
then you will probably skew your criteria in that direction 

That about says it all...

I wonder, how we're going to migrate our MySQL Mattermost environment to PostgreSQL without having any knowledge about how to securely run & maintain a PostgreSQL infrastructure. And no, we're not going to use Docker.

from mattermost-plugin-ai.

I'm also following the performance channel on Community

https://community.mattermost.com/core/pl/jfbu7hyaffnffjicjo19tuxbfh

It would be more honest to just say that two supported RDBMSs is one too much & there is no manpower to support two.

from mattermost-plugin-ai.

Thanks @jprusch, that's a better way to put it, we don't have the capacity to support two databases.

Most of the support effort happens at scale, and most of it happens with MySQL. By transitioning our community and customers to PostgreSQL we can transfer time and energy from support to platform innovation.

This may result in a smaller community with fewer admins who can run the full system, or it may mean the energy transitioned to innovation brings in a bigger community who enjoy broader and deeper benefits, or the outcome could be something in-between or different.

from mattermost-plugin-ai.

This all said, we're still in the very early days of this project, and the story is just starting to unfold.

When Mattermost itself started, we were in the opposite position--MySQL-only and adding PostgreSQL only after GitLab required it for us to be part of the their omnibus.

from mattermost-plugin-ai.

Hello @it33 , we are using mysql and want to use plugin. if the plugin is not supported with mysql when you are going to be share out guidance for existing users and customers around migrating to PostgreSQL. We need your help and waiting to hearing from you. Best Regards!

from mattermost-plugin-ai.

I second for the MySQL support.

Alternatively it would be great to have some guidelines from Mattermost team. Or, ideally, a migrator that can just take in the new Postgres config details and perform the migration MySQL -> PostgreSQL.

It's a pitty this plugin only supports Postgres :(

from mattermost-plugin-ai.

Pretty sure we've to go thru:

https://docs.mattermost.com/manage/bulk-export-tool.html

from mattermost-plugin-ai.

Pretty sure we've to go thru:

https://docs.mattermost.com/manage/bulk-export-tool.html

@jprusch I've found 2 exchanges where people seem to be successfully using pg_loader for this:

• https://forum.mattermost.com/t/migrating-from-mariadb-to-postgresql-db/14194
• mattermost/mattermost#18351 (comment)

I'll be migrating this weekend based on the information from these 2 posts, so hopefully will be able to report back how it's gone.

from mattermost-plugin-ai.

We have deployments that have exported from MySQL and attempted to import into PostgreSQL and the schemas are close but not exact, we could also potentially also see if community has done this before and what issues they hit and fixes from a real world perspective, in addition to working the migration into the product and engineering backlog,

It really depends on if someone from the community has the skill and inclination to make a contribution in this area, after solving the issue for themselves,

Side note: We've been running experiments internally on ChatGPT 4, and something like a migration from MySQL to PostgreSQL schema using the existing export function could be an interesting use case.

UPDATE: It seems--in a very healthy and positive way--our community is a little ahead of our product and engineering backlog looking into MySQL and PostgreSQL migration, as showcased by the post just before this one.

from mattermost-plugin-ai.

Pretty sure we've to go thru:

https://docs.mattermost.com/manage/bulk-export-tool.html

@jprusch using mmctl and the export/import workflow would indeed be a valid path but we are focusing on a tool that will migrate directly from mysql' to pgsqland so reduce overhead in the task. As @grrinch points out a utility likepg_loader` is in the candidate list today.

Anyone looking to discuss/contribute, take part in early testing or such, please reach out to me over at community.mattermost.com.

from mattermost-plugin-ai.

Also frustrated by this - all the resources I can find that allow me to easily deploy a mattermost server to Azure (the kubernetes guide and the bitnami packaged VM) only support mySQL, but apparently it's essentially deprecated to new features like your AI plugin and there's no migration path provided? Seems like you need to be focusing on critical core features like what database you're using before spending time on AI addons.

from mattermost-plugin-ai.

it33 is there any news? about mysql support?

from mattermost-plugin-ai.

@Bolderus we're working providing more support for migrating from MySQL to PostgreSQL. The community is correct that it's somewhat confusing having a number of default deployment options install MySQL after we're announcing a move away from the platform.

Let us figure out internally who is the right person to speak on this more publicly. To be transparent, there are no plans to support OpenOps on MySQL due to challenges we foresee supporting deployments at scale, which could lower the velocity of the work, as it has in other Mattermost workstreams.

from mattermost-plugin-ai.

I can only repeat: As long as there is not clear and easy migration process, you won't get any feedback of customers already on MySQL. Nobody sets up a new installation when Mattermost is already running and implemented in company processes.
I follow the discussions around OpenOps, the AI channel & the great YouTube videos on the achievements you make, but I've no time to just set up a new environment to play around with it & check use cases for my coworkers.

from mattermost-plugin-ai.

from mattermost-plugin-ai.

Definitely appreciate all the feedback,

We have @nab-77 who will be the right owner internally at Mattermost to discuss MySQL to PostgreSQL migration, and I think he's posted in different forums on the topic. @nab-77 is on @wiersgallak's team with @chenilim, and I believe he's back tomorrow.

For context, the original intention of OpenOps is to be a "sandbox" to try out LLM and GenAI features outside of production, before flowing confidential data into 3rd party backends, setting policy and governance on acceptable usage, etc.

Original announcement here:

• Open source AI-enhanced chat collaboration sandbox accelerates evaluation of generative AI models and usage policies in real world workflows while maintaining full data control

For this reason, we invested in options like Gitpod, showcased by team members like @azigler, to try out the features of the platform and clear out the trust and safety priorities ahead of rollout.

At the same time, we realize there are many deployments that are further ahead than we anticipated for deploying use cases to production, where PostgreSQL migration is a larger issue than we realized.

from mattermost-plugin-ai.

@jprusch @cahaseler We plan to publish the first draft of the mysql-to-pgsql guide later today (on docs.mattermost.com). This first draft focuses on channels data, with playbooks/boards following later. Your thoughts, testing & feedback will be greatly appreciated.

As soon as it publishes I will share here.

from mattermost-plugin-ai.

Thanks for migration Migration guidelines but ı couldnt start comand morph apply up --driver postgres --dsn "postgres://user:pass@localhost:5432/mydb?sslmode=disable" --path ./db/migrations/postgres --number 1 and I am getting error
usage: morph [options]

how can I solve this problem ? also is it possible for someone make a video Migration guidelines from MySQL to PostgreSQL. really I will be so happy!

Best Regards!

from mattermost-plugin-ai.

Anybody can help above the problem ? does anybody managed migration and also is it posible for someone upload video for migration process ? Really I need your help!

Best Regards!

from mattermost-plugin-ai.

is it possible for someone to make a migration video ? I need to migrate but commands not working. anybody please help me ?

from mattermost-plugin-ai.