silverton-io / buz Goto Github PK
View Code? Open in Web Editor NEWServerless multi-protocol + multi-destination event collection system.
Home Page: https://buz.dev/
License: Apache License 2.0
Serverless multi-protocol + multi-destination event collection system.
Home Page: https://buz.dev/
License: Apache License 2.0
A straight-shot to kinesis fh would be killer.
Kinesis should be supported along with kafka, pubsub, etc.
It would be sweet to auto-rotate letsencrypt or something, so SSL termination at the collector is possible.
Use https://docusaurus.io/ or mkdocs or something
https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage
should be payload format, event type, version, source, etc
Clickhouse should be a supported destination
The following fields need to be properly supported:
Snowplow handlers could be done better. Do better.
Currently way bigger than it should be and should be cut down. A lot.
should be payload format, event type, version, source, etc
xeipuuv/gojsonschema
is fast, but this thing should support 2020-12
https://github.com/santhosh-tekuri/jsonschema looks like a viable option
The sinks have too much redundant code - incrementing the stats counters can be consolidated.
A bunch of fields could either be optionally-included, nested, or dropped altogether.
There's stuff lying around. Do better.
Schemas that should be a thing:
See how few moving pieces are actually necessary.
All handlers should look, act, smell, and feel the same.
probably via an auth'd endpoint
We want to be able to explicitly deny incoming messages by:
If an incoming req cannot be handled in an appropriate amount of time, it should time out so the tracker can retry instead of hang.
This "appropriate amount of time" should be tunable.
Reqs currently hang forever when the sink cannot be published to. This is bad.
Firebolt should be a supported destination
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.