Comments (3)
Thanks @pythonpen ! Have you looked for a solution like this today? Are there any integrations you'd like to use today but can't?
I'll sync with the team and put this on our roadmap, but we're realistically not going to be able to tackle this for a while. Thanks for starting the discussion!
from readyset.
Thanks @jbensal for consideration in the roadmap - Sure, it can be long short. Just made a suggestion only - for having this as an add-on capability in ReadySet.
Today this type of realtime ETL requirements are coded at the application level via webhooks (which works pretty good - but not very reliable sometimes due to bugs in the code or application failures), however if such integrations are moved closer to the DB and can call webhook functions when a db change happens can be more reliable and can ascertain the ACID properties for the DB as well.
For high fidelity data inter-operability applications in the domain of Healthcare (Patient Health Record - inter-ops etc), having such reliable db change based webhook triggers are good.
I don't know yet if such realtime ETL capabilities exists native to the DB - maybe PostREST can do it or Store Procedures can do it, also I know that Supabase and Firebase has these type of function hooks based on db changes.
But having it outside like in a Readyset - can have the potential to proxy these webhook trigger services in DB neutral way. (irrespective of what you use as the DB - like MySQL / Postgres / Supabase etc )
from readyset.
This is a nice problem to solve for - even as a separate product I guess
from readyset.
Related Issues (20)
- Problem when starting readyset with mysql HOT 2
- Clarify standalone as preferred means to run ReadySet from source
- no data was found
- Query Support Checker Tool HOT 1
- Update Cluster Types
- Document using Railway w/ReadySet HOT 4
- `show caches` breaks after seeing cached query alias HOT 1
- Caches recreated with wrong query string after backwards-incompatible upgrade
- Provide a more clear error when snapshotting a non-supported version of a database
- Group and Vectorize Filter node operations
- JIT compiled code for efficient fused filter evaluation operation HOT 1
- Show ReadySet Status improvements
- Include an instance specific unique ID in logs
- Query ID is treated as an identifier in some SQL extensions and a string literal in others
- 'show readyset status' shows Incorrect DB connection value when connecting to an Aurora instance
- Re-evaluate whether caches should have names HOT 2
- Error when connecting to db that doesn't have a password requirement
- Allow running logs without timestamps
- ctrl-c handler logs broken pipe errors
- Make non-blocking reads the default
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from readyset.