riverscorpion Goto Github PK

flink-table-store

湖存储 An Apache Flink subproject to provide storage for dynamic tables.

flinkx

FlinkX改名chunjun，Based on Apache Flink. support data synchronization/integration and streaming SQL computation.

hawq

Apache HAWQ 是一个 Hadoop 原生 SQL 查询引擎，它结合了 MPP 数据库的关键技术优势和 Hadoop 的可扩展性和便利性。HAWQ 以原生方式从 HDFS 读取数据并将数据写入 HDFS。

hbase-book

Contains the code used in the HBase: The Definitive Guide book.

hetu-core

hudi

Upserts, Deletes And Incremental Processing on Big Data.

incubator-linkis

连接访问Spark, Presto, Flink 等底层引擎,同时实现跨引擎上下文共享、统一的计算任务和引擎治理与编排能力，Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

incubator-seatunnel

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

inlong

Apache InLong - a one-stop integration framework for massive data

kafka

Mirror of Apache Kafka

kylin

构造亚秒级别数据仓库 Apache Kylin

leaf

Distributed ID Generate Service

luckysheetserver

类似于wps Excel，这个是后台部分 Luckysheet java backend

matrixone

专为异构工作负载打造的全球规模、云边缘原生大数据引擎，也就是一个数据库Planet scale, cloud-edge native big data engine crafted for heterogeneous workloads

minio-java

可以替代hdfs框架，但是必须与Kubernetes 连用，MinIO Client SDK for Java

mist

超高性能且不受时间回拨影响的全局唯一 ID 生成算法，薄雾算法

mobydq

:whale: Tool to automate data quality checks on data pipelines数据质量检测

mysql-binlog-connector-java

MySQL Binary Log connector；debezium使用的就是这个东西去读取的mysql binlog

pika

Pika是一个可持久化的大容量redis存储服务，Pika是一个兼容redis的nosql，由奇虎的DBA和基础设施团队开发

presto

The official home of the Presto distributed SQL query engine for big data

rainbond

Cloud-native and easy-to-use application management platform | 云原生且易用的应用管理平台

snowflake

Twitter的雪花算法SnowFlake，使用Java语言实现。

spark-on-k8s-operator

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

sqlflow

通过SQL语句分析出血缘关系/血缘地图。仅限使用SQL语句生成。Brings SQL and AI together.

sreworks

提供专业高效、安全可靠的一站式"数据化、智能化"运维SaaS应用套件（交、监、管、控、营、服）和云原生运维开发平台

stable-diffusion-webui

自动生成图片Stable Diffusion web UI

starrocks

极速全场景 MPP 企业级数据库/数据仓库 产品 StarRocks is a next-gen sub-second MPP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics and ad-hoc query.

tis-solr

an enterprise ETL System base on DataX

uid-generator

UniqueID generator

zeppelin

Zeppelin是一个高性能，高可用的分布式Key-Value存储平台，以高性能、大集群为目标；基础来自PiKa和redis；Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.