Comments (3)
Another remark for this - currently attribute family contains specifications for both readers and writers that apply to it. That is fundamentally wrong, because the read settings might (and will) be dependent on the actual reader (type of processing involved). We need to break the whole specification to:
- descriptors (entities, attributes, transforms, views)
- attribute families - physical storage, not including any settings for neither write nor read
- accessors - settings for write (single) and customizable settings for read using particular attribute family - this might also include settings about what strategy to choose when multiple options exist for a attribute family select choice (e.g. multiple commit logs, multiple families that can serve given access, etc.)
@JozoVilcek would you have any feedback or thoughts on this?
from proxima-platform.
I have nothing to add. Breakdown of responsibilities sounds right to me.
from proxima-platform.
Done.
from proxima-platform.
Related Issues (20)
- [ingest-server] Add support for multiget/multilist
- Add Stream#reshuffle()
- Add Stream#impulse and Stream#atFixedRate HOT 1
- proxima-core jar file contains unshaded dependencies HOT 5
- Remove euphoria dependency HOT 1
- BatchLogReader blocked on close HOT 2
- Optimize ZKGlobalWatermarkTracker HOT 1
- [flink] add FlinkGlobalWatermarkTracker
- Avoid using Thread.interrupt() for business logic in TerminationContext
- Handle transactional writes in replication controller
- proxima-tools: make reduceValueStateByKey optionally non-sorted HOT 1
- Flaky LocalKafkaCommitLogDescriptortest.testPollFromManyMoreConsumersThanPartitionsMovesWatermark
- Missing coder for PCollection HOT 1
- Transaction auto-open needs special flag
- Flaky DirectBatchUnboundedSourceTest.testDirectBatchUnboundedSourceWithMany
- [ingest-server] allow wildcardPrefix in ListRequest to specify real prefix, not just wildcard attribute
- Add calendar windowing to Stream
- beam-tools: Deadlock while reading batchSnapshot when user exception is thrown
- Add scan method to ingest RPC
- Gradle incorrectly generates pom
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from proxima-platform.