Topic: hadoop Goto Github

👇 Here are 3157 public repositories matching this topic...

absaoss / spline
hadoop,Data Lineage Tracking And Visualization Solution
Organization: absaoss
Home Page: https://absaoss.github.io/spline/
spark lineage tracking visualization bigdata hadoop scala

alluxio / alluxio
hadoop,Alluxio, data orchestration for analytics and machine learning in the cloud
Organization: alluxio
Home Page: https://www.alluxio.io
alluxio memory-speed hadoop spark presto tensorflow data-analysis data-orchestration virtual-distributed-filesystem

apache / calcite
hadoop,Apache Calcite
Organization: apache
Home Page: https://calcite.apache.org/
geospatial calcite java big-data hadoop sql

apache / carbondata
hadoop,High performance data store solution
Organization: apache
Home Page: carbondata.apache.org
scala java big-data carbondata data-format apache spark hadoop

apache / doris
hadoop,Apache Doris is an easy-to-use, high performance and unified analytics database.
Organization: apache
Home Page: https://doris.apache.org
olap database hadoop hive hudi iceberg real-time sql bigquery dbt

apache / drill
hadoop,Apache Drill is a distributed MPP query layer for self describing data
Organization: apache
Home Page: https://drill.apache.org/
java big-data drill sql hive hadoop jdbc parquet

apache / hadoop
hadoop,Apache Hadoop
Organization: apache
Home Page: https://hadoop.apache.org/
hadoop

apache / hive
hadoop,Apache Hive
Organization: apache
Home Page: https://hive.apache.org/
java hive database sql apache big-data hadoop

apache / ignite
hadoop,Apache Ignite
Organization: apache
Home Page: https://ignite.apache.org/
distributed-sql-database iot osgi network-client ignite data-management-platform big-data cloud database network-server

apache / kyuubi
hadoop,Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Organization: apache
Home Page: https://kyuubi.apache.org/
spark hive sql thrift jdbc spark-sql data-lake hadoop kubernetes hacktoberfest

apache / nutch
hadoop,Apache Nutch is an extensible and scalable web crawler
Organization: apache
Home Page: https://nutch.apache.org/
java nutch web-crawler crawling hadoop apache

apache / ozone
hadoop,Scalable, redundant, and distributed object store for Apache Hadoop
Organization: apache
Home Page: https://ozone.apache.org
hadoop object-store storage big-data s3 kubernetes

big-data-europe / docker-hadoop
hadoop,Apache Hadoop docker image
Organization: big-data-europe
hadoop-docker docker-hadoop hadoop hadoop-cluster docker

cdarlint / winutils
hadoop,winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows
User: cdarlint
hadoop winutils binaries

cerndb / dist-keras
hadoop,Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.
Organization: cerndb
Home Page: http://joerihermans.com/work/distributed-keras/
machine-learning deep-learning apache-spark data-parallelism distributed-optimizers keras optimization-algorithms tensorflow data-science hadoop

collabh / bigdata-growth
hadoop,大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。
User: collabh
flink kafka hive mapreduce spark olap kudu hadoop hbase debezium

dahuoyzs / javapdf
hadoop,🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)
User: dahuoyzs
hadoop java-pdf jvm mysql mysql-innodb

data-science-projects-and-resources / data-science-ebooks
hadoop,Data Science E-books, Interview Resources and Cheat-sheets
Organization: data-science-projects-and-resources
Home Page: https://data-science-projects-and-resources.github.io/Data-Science-EBooks/
python data-science machine-learning nlp free free-ebook-download deep-learning hadoop interview-questions data-science-interview

deeplearning4j / deeplearning4j
hadoop,Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
Organization: deeplearning4j
Home Page: http://deeplearning4j.konduit.ai
java gpu deeplearning neural-nets deeplearning4j dl4j hadoop spark intellij artificial-intelligence

donnemartin / data-science-ipython-notebooks
hadoop,Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
User: donnemartin
python machine-learning deep-learning data-science big-data aws tensorflow theano caffe scikit-learn

dtstack / taier
hadoop,Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display
Organization: dtstack
Home Page: https://dtstack.github.io/Taier/
distributed-schedule-system dag scheduler job-scheduler workflow-scheduling-system task-schedule cronjob-scheduler data-schedule flink spark

gchq / gaffer
hadoop,A large-scale entity and relation database supporting aggregation of properties
Organization: gchq
accumulo graph graph-database hadoop big-data aggregation hbase parquet spark

geekyouth / szt-bigdata
hadoop,深圳地铁大数据客流分析系统🚇🚄🌟
User: geekyouth
Home Page: https://github.com/geekyouth/SZT-bigdata
kafka szt-bigdata flink spark scala elasticsearch kibana hive redis mongodb

h2oai / h2o-3
hadoop,H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Organization: h2oai
Home Page: http://h2o.ai
h2o machine-learning data-science deep-learning big-data ensemble-learning gbm random-forest naive-bayes pca

harisekhon / devops-bash-tools
hadoop,1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
User: harisekhon
Home Page: https://www.linkedin.com/in/HariSekhon
bash docker perl cloudera hadoop kafka postgresql mysql devops jenkins

harisekhon / devops-python-tools
hadoop,80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
User: harisekhon
Home Page: https://www.linkedin.com/in/HariSekhon
cloudformation python hbase json avro parquet spark pyspark travis-ci elasticsearch

harisekhon / dockerfiles
hadoop,50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak
User: harisekhon
Home Page: https://www.linkedin.com/in/HariSekhon
hadoop hbase cassandra solr solrcloud kafka consul zookeeper apache-drill dockerhub

harisekhon / nagios-plugins
hadoop,450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
User: harisekhon
Home Page: https://www.linkedin.com/in/HariSekhon
nagios-plugins zookeeper hadoop hbase cloudera jenkins cassandra elasticsearch docker kafka

heibaiying / bigdata-notes
hadoop,大数据入门指南 :star:
User: heibaiying
hadoop hdfs yarn mapreduce hive spark storm hbase scala kafka

linkedin / school-of-sre
hadoop,At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.
Organization: linkedin
Home Page: https://linkedin.github.io/school-of-sre/
sre linux networking git python mysql nosql hadoop system-design security

luckyzxl2016 / movie_recommend
hadoop,基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统
User: luckyzxl2016
spark-mllib spark-streaming ssm-maven scrapy scala hadoop nginx hive mysql

moosefs / moosefs
hadoop,MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
Organization: moosefs
Home Page: https://moosefs.com
software-defined-storage posix filesystem file-system distributed-file-system clustering distributed-storage distributed-computing fuse big-data

moran1607 / bigdataguide
hadoop,大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
User: moran1607
hadoop zookeeper hive flume kafka hbase spark flink scala bigdata

obenner / data-engineering-interview-questions
hadoop,More than 2000+ Data engineer interview questions.
User: obenner
data-engineering interview-questions interview hadoop hadoop-hdfs spark flink sql kafka hive

oeljeklaus-you / useractionanalyzeplatform
hadoop,电商用户行为分析大数据平台
User: oeljeklaus-you
spark java hadoop sparkjava spark-sql accumulator kyro

prestodb / presto
hadoop,The official home of the Presto distributed SQL query engine for big data
Organization: prestodb
Home Page: http://prestodb.io
java presto hive hadoop big-data sql data lakehouse query

qihoo360 / xlearning
hadoop,AI on Hadoop
Organization: qihoo360
hadoop tensorflow caffe mxnet ai deeplearning machinelearning yarn

realguoshuai / hadoop_study
hadoop,定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)
User: realguoshuai
hadoop java

spotify / luigi
hadoop,Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Organization: spotify
python luigi orchestration-framework scheduling hadoop

sunnyandgood / bigdata
hadoop,💎🔥大数据学习笔记
User: sunnyandgood
hadoop hive hbase hdfs zookeeper sqoop mapreduce flume mysql linux

tencent / apijson
hadoop,🏆 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构。 🏆 A JSON Transmission Protocol and an ORM Library 🚀 provides APIs and Docs without writing any code.
Organization: tencent
Home Page: http://apijson.cn
postgresql-database tidb sqlserver oracle clickhouse postgresql hive hadoop tdengine low-code

teradata / kylo
hadoop,Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.
Organization: teradata
Home Page: http://kylo.io
spark nifi kylo data-lake teradata hadoop

tomwhite / hadoop-book
hadoop,Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White
User: tomwhite
Home Page: http://www.hadoopbook.com/
hadoop book o-reilly

tony-framework / tony
hadoop,TonY is a framework to natively run deep learning frameworks on Apache Hadoop.
Organization: tony-framework
Home Page: https://tony-project.ai
tensorflow hadoop-yarn hadoop machine-learning deep-learning horovod

trinodb / trino
hadoop,Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Organization: trinodb
Home Page: https://trino.io
java presto hive hadoop big-data sql prestodb database databases distributed-systems

wangzhiwubigdata / god-of-bigdata
hadoop,专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
User: wangzhiwubigdata
flink spark hadoop hdfs hive hbase kafka zookeeper bigdata flume

webankfintech / dataspherestudio
hadoop,DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Organization: webankfintech
Home Page: https://github.com/WeBankFinTech/DataSphereStudio-Doc
workflow governance azkaban davinci linkis spark hive hadoop visualis zeppelin

webankfintech / wedatasphere
hadoop,WeDataSphere is a financial grade, one-stop big data platform suite.
Organization: webankfintech
hadoop spark hive ide schedulis scriptis linkis dataspherestudio qualitis flink

wgzhao / addax
hadoop,Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.
User: wgzhao
Home Page: https://wgzhao.github.io/Addax/
hadoop hive database data-integrity clickhouse influxdb kudu mysql sqlserver trino

will-che / bigdata-interview
hadoop,:dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
User: will-che
bigdata spark kafka hbase flink hadoop hdfs mapreduce yarn interview