Code Monkey home page Code Monkey logo

Comments (51)

arjun810 avatar arjun810 commented on May 12, 2024 51

Available for RDS now! https://aws.amazon.com/about-aws/whats-new/2023/05/amazon-rds-postgresql-pgvector-ml-model-integration/

from pgvector.

seanaguinaga avatar seanaguinaga commented on May 12, 2024 32

Need that Google CloudSQL 8)

from pgvector.

pthieu avatar pthieu commented on May 12, 2024 19

fingers crossed for RDS 🀞

from pgvector.

mmmaia avatar mmmaia commented on May 12, 2024 14

Render added support to their PostgreSQL service.

https://twitter.com/render/status/1646249514045702144

from pgvector.

m-abdelwahab avatar m-abdelwahab commented on May 12, 2024 10

Hey @ankane! Neon recently added support for pgvector: https://neon.tech/docs/release-notes/2023-02-14

from pgvector.

mareksuscak avatar mareksuscak commented on May 12, 2024 10

It seems to me that Google has recently secretly added support for pgvector 0.4.2 in POSTGRES_15_2.R20230530.01_00 maintenance update! The list of extensions in the documentation has not been updated yet to reflect this but running SELECT * FROM pg_available_extensions; on a recently updated Cloud SQL instance shows this:

CleanShot 2023-06-19 at 16 56 34

Yas!

from pgvector.

packi avatar packi commented on May 12, 2024 10

We've added pgvector to our supported extensions at Aiven, starting from PG13, see https://docs.aiven.io/docs/products/postgresql/reference/list-of-extensions. You may need to apply a maintenance upgrade to get it in your existing service.

from pgvector.

gregnr avatar gregnr commented on May 12, 2024 9

@ankane Funny, I was planning to send a PR shortly to request adding Supabase to the list. Been working with their team to get that integrated:
supabase/postgres#472

Thanks again for making a great extension. Currently using this to store and query OpenAI Embeddings.

from pgvector.

mfreed avatar mfreed commented on May 12, 2024 8

Timescale supports pgVector in its cloud offering.

image

from pgvector.

george-bitdotio avatar george-bitdotio commented on May 12, 2024 7

Howdy! bit.io now supports pgvector :)

from pgvector.

atomkirk avatar atomkirk commented on May 12, 2024 7

Please upvote the issue to request this extension on GCP Cloud SQL https://issuetracker.google.com/issues/278521774

from pgvector.

Winslett avatar Winslett commented on May 12, 2024 6

Crunchy Bridge

from pgvector.

gasabr avatar gasabr commented on May 12, 2024 6

yandex cloud provides an extension too https://cloud.yandex.com/en/docs/managed-postgresql/operations/extensions/cluster-extensions

from pgvector.

Vonng avatar Vonng commented on May 12, 2024 5

Pigsty - Free RDS PG Alternative

now add pgvector as default extension in v2.0.2

from pgvector.

mwmeyer avatar mwmeyer commented on May 12, 2024 5

No digital ocean hosted PG yet. Heres an upvote support request for others that want it: https://ideas.digitalocean.com/app-framework-services/p/saving-openai-embeddings-with-pgvector

from pgvector.

mulander avatar mulander commented on May 12, 2024 5

pgvector is now available on Azure:

  • Azure Database for PostgreSQL Flexible Server

Follow this page to enable vector in the allowed extensions and then simply CREATE EXTENSION vector; on your Flexible Server.

  • Azure Cosmos DB for PostgreSQL

Just connect to your cluster and issue SELECT create_extension('vector');

Main readme update submitted as #129

from pgvector.

jdowning avatar jdowning commented on May 12, 2024 5

Heroku Postges supports pgvector:

from pgvector.

MSuter6 avatar MSuter6 commented on May 12, 2024 5

Northflank now also supports pgvector with its PostgreSQL addon offering: https://northflank.com/docs/v1/application/databases-and-persistence/deploy-databases-on-northflank/deploy-postgresql-on-northflank#postgresql-specifications.

from pgvector.

bbedward avatar bbedward commented on May 12, 2024 4

We added the extension to spilo to use with postgres-operator in kubernetes.

https://github.com/stablecog/spilo

Can just use the docker image in the helm chart values, or build your own:

https://hub.docker.com/r/stablecog/spilo

15.3+ has pgvector for Postgres 11-15

from pgvector.

montanalow avatar montanalow commented on May 12, 2024 4

Also available on hosted PostgresML databases.

from pgvector.

ganesh-rao avatar ganesh-rao commented on May 12, 2024 4

I believe AWS now supports pgvector on Aurora PostgresSQL:

https://docs.aws.amazon.com/AmazonRDS/latest/AuroraPostgreSQLReleaseNotes/AuroraPostgreSQL.Updates.html#AuroraPostgreSQL.Updates.20180305.153X

It's also listed here for Postgres 15.3:
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraPostgreSQLReleaseNotes/AuroraPostgreSQL.Extensions.html#AuroraPostgreSQL.Extensions.15

from pgvector.

mmmaia avatar mmmaia commented on May 12, 2024 3

anyone has setup pg_vector on Railway? Didn't found anything about installing extensions there :/

@NicolasLopes7 It's not possible yet. You can vote and comment on these feature requests:

from pgvector.

pabloem avatar pabloem commented on May 12, 2024 3

Also Google's AlloyDB has added support for PGVector: https://cloud.google.com/blog/products/databases/announcing-vector-support-in-postgresql-services-to-power-ai-enabled-applications

from pgvector.

enchorb avatar enchorb commented on May 12, 2024 3

Correct, pgvector works on Amazon RDS for PostgresSQL but not on Amazon Aurora PostgresSQL.

from pgvector.

schoblaska avatar schoblaska commented on May 12, 2024 3

DigitalOcean now lists pgvector on their page of supported extensions (for PostgreSQL 13 and newer): https://docs.digitalocean.com/products/databases/postgresql/details/supported-extensions/

from pgvector.

gulcin avatar gulcin commented on May 12, 2024 3

EDB's BigAnimal Postgres-as-a-Service supports pgvector:

BigAnimal is EDB’s managed Postgres service that allows you to run Postgres on all major cloud platforms. Now, you can enable pgvector on your databases and start experimenting!

from pgvector.

Bacto avatar Bacto commented on May 12, 2024 2

Hi!

pgvector is available on Stackhero PostgreSQL cloud hosting solution with PostgreSQL 15 πŸ₯³πŸ₯³πŸ₯³

from pgvector.

ankane avatar ankane commented on May 12, 2024 2

@jcoc611-gvt I think it'd be good to move this to an Azure support channel. Illegal instruction typically means pgvector was compiled with AVX instructions that aren't available on the machine (and will only appear with vectors of 8+ or 16+ dimensions).

from pgvector.

guillim avatar guillim commented on May 12, 2024 2

It seems to me that Google has recently secretly added support for pgvector 0.4.2 in POSTGRES_15_2.R20230530.01_00 maintenance update! The list of extensions in the documentation has not been updated yet to reflect this but running SELECT * FROM pg_available_extensions; on a recently updated Cloud SQL instance shows this:

CleanShot 2023-06-19 at 16 56 34

Yas!

It’s now in the official documentation !!!

from pgvector.

shayons avatar shayons commented on May 12, 2024 2

The pgvector extension is available on Aurora PostgreSQL as of July 13 (https://aws.amazon.com/about-aws/whats-new/2023/07/amazon-aurora-postgresql-pgvector-vector-storage-similarity-search) on versions 15.3, 14.8, 13.11, 12.15 and higher. Here's a blog that shows you how to build an AI powered chat bot application and perform sentiment analysis using pgvector and Amazon Aurora PostgreSQL - https://aws.amazon.com/blogs/database/leverage-pgvector-and-amazon-aurora-postgresql-for-natural-language-processing-chatbots-and-sentiment-analysis/

from pgvector.

jcoc611-gvt avatar jcoc611-gvt commented on May 12, 2024 1

@mulander Seems like extension vector is not yet available in Azure Flexible Server (also not present in this doc). Do you know when it will be in general availability?

@jcoc611-gvt What region are you checking and is it on a new or deployed cluster? The documentation update (including the doc you linked) is scheduled to be published on the 23rd of May.

@mulander Seems like new clusters can enable vector whereas existing ones cannot.

In any case, it seems like pgvector is crashing on INSERT or UPDATE large vectors (e.g. 1536 dimensions). Logs look something like this:

LOG: server process (PID 3517) was terminated by signal 4: Illegal instruction

Even on a simple table such as

CREATE TABLE test (id bigserial PRIMARY KEY,  v vector(1536));

This works fine for trivially small vectors e.g. 1-2 dimensions.

Perhaps pgvector was compiled with optimizations not supported in Azure flexible database environment? Or is it a matter of configuring server parameters/using a SKU with more RAM?

Edit: seems like one needs to update track_activity_query_size on Azure to fit the embedding array for it to work.

from pgvector.

ankane avatar ankane commented on May 12, 2024 1

Hi @aytekinar, please create a new issue for this.

from pgvector.

knightjdr avatar knightjdr commented on May 12, 2024 1

It looks like RDS support does not include Aurora: Aurora extension support

While I couldn't find a documented way to make a request, this email address appears to work: [email protected]

from pgvector.

ankane avatar ankane commented on May 12, 2024

Awesome, big thanks for adding it!

from pgvector.

ankane avatar ankane commented on May 12, 2024

Thanks @m-abdelwahab, great to hear!

from pgvector.

NicolasLopes7 avatar NicolasLopes7 commented on May 12, 2024

anyone has setup pg_vector on Railway? Didn't found anything about installing extensions there :/

from pgvector.

Bacto avatar Bacto commented on May 12, 2024

And it is also available for Heroku via Stackhero PostgreSQL add-on πŸ‘Œ

from pgvector.

jcoc611-gvt avatar jcoc611-gvt commented on May 12, 2024

@mulander Seems like extension vector is not yet available in Azure Flexible Server (also not present in this doc). Do you know when it will be in general availability?

from pgvector.

mulander avatar mulander commented on May 12, 2024

@mulander Seems like extension vector is not yet available in Azure Flexible Server (also not present in this doc). Do you know when it will be in general availability?

@jcoc611-gvt What region are you checking and is it on a new or deployed cluster? The documentation update (including the doc you linked) is scheduled to be published on the 23rd of May.

from pgvector.

aytekinar avatar aytekinar commented on May 12, 2024

Hi @jcoc611-gvt and @ankane,

I am from the Azure Cosmos DB for PostgreSQL team, and I am also in touch with @mulander and Azure Database for PostgreSQL Flexible Server devs in our internal thread, investigating the issue.

We also believe the offending line is OPTFLAGS = -march=native, and we will try overriding it to avoid any potential issues in the future, especially when/if the extension is built on one machine/architecture and distributed to other machines (this happens when the span of supported VM sizes is large).

For us to investigate the issue and help you better and faster, @jcoc611-gvt, could you please share with us which VM size you were using when you tested the below excerpt:

CREATE TABLE test (id bigserial PRIMARY KEY,  v vector(1536));

from pgvector.

louis030195 avatar louis030195 commented on May 12, 2024

https://github.com/different-ai/embedbase hosted version uses pgvector in supabase :)

from pgvector.

nikhilshinday avatar nikhilshinday commented on May 12, 2024

anyone have an update on Aurora pgvector support on RDS?

from pgvector.

developeralim avatar developeralim commented on May 12, 2024

image
I faced this issue when i was installing pgvector. i am using windows 10 . can anyone help me please

from pgvector.

enchorb avatar enchorb commented on May 12, 2024

+1 pgvector for AWS Aurora

from pgvector.

disbelief avatar disbelief commented on May 12, 2024

So I guess this announcement from AWS on May 3 about pgvector support doesn't apply to Aurora? https://aws.amazon.com/about-aws/whats-new/2023/05/amazon-rds-postgresql-pgvector-ml-model-integration/

from pgvector.

retendo avatar retendo commented on May 12, 2024

Although it is not documented, this seems to work on DigitalOcean Managed Postgres as well now. At least with Postgres 15. It didn't work with Postgres 12 though.

from pgvector.

amadeus633 avatar amadeus633 commented on May 12, 2024

I believe AWS now supports pgvector on Aurora PostgresSQL:

https://docs.aws.amazon.com/AmazonRDS/latest/AuroraPostgreSQLReleaseNotes/AuroraPostgreSQL.Updates.html#AuroraPostgreSQL.Updates.20180305.153X

It's also listed here for Postgres 15.3: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraPostgreSQLReleaseNotes/AuroraPostgreSQL.Extensions.html#AuroraPostgreSQL.Extensions.15

Do you know if this includes Postgres on AWS Lightsail?

from pgvector.

StubbornDeer avatar StubbornDeer commented on May 12, 2024

AWS Postgres 14: https://docs.aws.amazon.com/AmazonRDS/latest/PostgreSQLReleaseNotes/postgresql-extensions.html#postgresql-extensions-14x

from pgvector.

vishnu-narayanan avatar vishnu-narayanan commented on May 12, 2024

AWS Postgres 13: https://docs.aws.amazon.com/AmazonRDS/latest/PostgreSQLReleaseNotes/postgresql-extensions.html#postgresql-extensions-13x

from pgvector.

ClearedFram3 avatar ClearedFram3 commented on May 12, 2024

(off topic) @guillim is the GUI you show something from google cloud or a standalone product?

from pgvector.

jcrupi avatar jcrupi commented on May 12, 2024

Looks like Azure Postgres Flex Server only supports pgvector .4,0

from pgvector.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.