Topic: pipeline Goto Github

👇 Here are 4676 public repositories matching this topic...

airbytehq / airbyte
pipeline,The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Organization: airbytehq
Home Page: https://airbyte.com
data pipeline data-analysis data-engineering java python etl change-data-capture data-collection data-integration

alan-turing-institute / mlj.jl
pipeline,A Julia machine learning framework
Organization: alan-turing-institute
Home Page: https://alan-turing-institute.github.io/MLJ.jl/dev/
machine-learning julia pipelines tuning data-science tuning-parameters predictive-modeling classification regression statistics

alibaba / dawn
pipeline,:sunrise: Dawn is a lightweight task management and build tool for front-end and nodejs.
Organization: alibaba
Home Page: https://alibaba.github.io/dawn/
build-tool build front-end dawn dawn-cli task pack pipeline middleware construction

alibaba / pipcook
pipeline,Machine learning platform for Web developers
Organization: alibaba
Home Page: https://alibaba.github.io/pipcook/
js machine-learning tensorflow pipeline

alirezadir / production-level-deep-learning
pipeline,A guideline for building practical production-level deep learning systems to be deployed in real world applications.
User: alirezadir
machine-learning deep-learning pipeline scalable-applications production-system tfx kubeflow artificial-intelligence ai practical-machine-learning

apptension / saas-boilerplate
pipeline,SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!
Organization: apptension
Home Page: https://apptension.com/saas-boilerplate
cdk stack boilerplate frontend backend workers pipeline django docker saas

argoproj / argo-cd
pipeline,Declarative Continuous Deployment for Kubernetes
Organization: argoproj
Home Page: https://argo-cd.readthedocs.io
argo kubernetes continuous-deployment gitops continuous-delivery docker cd cicd pipeline devops

avaiga / taipy
pipeline,Turns Data and AI algorithms into production-ready web applications in no time.
Organization: avaiga
Home Page: https://www.taipy.io
automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines

axelderomblay / mlbox
pipeline,MLBox is a powerful Automated Machine Learning python library.
User: axelderomblay
Home Page: https://mlbox.readthedocs.io/en/latest/
machine-learning auto-ml kaggle deep-learning stacking pipeline optimization preprocessing encoding prediction

bloodaxe / pytorch-toolbelt
pipeline,PyTorch extensions for fast R&D prototyping and Kaggle farming
User: bloodaxe
pytorch kaggle image-classification image-segmentation deep-learning segmentation python image-processing machine-learning focal-loss

brunch / brunch
pipeline,:fork_and_knife: Web applications made easy. Since 2011.
Organization: brunch
Home Page: https://brunch.io
javascript workflow build-automation pipeline brunch

chunelfeng / cgraph
pipeline,【A common used C++ DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork
User: chunelfeng
Home Page: http://www.chunel.cn
dag threadpool workflow taskflow cpp concurrency ai pipeline pytorch tensorflow

edyoda / data-science-complete-tutorial
pipeline,For extensive instructor led learning
Organization: edyoda
Home Page: https://www.edyoda.com/program/data-scientist-program
machine-learning scikit-learn linear-regression nearest-neighbors feature-selection decision-trees numpy pandas pipeline

entilzha / pyfunctional
pipeline,Python library for creating data pipelines with chain functional programming
User: entilzha
Home Page: http://pyfunctional.pedro.ai
python datascience pipeline data functional-programming

epicgamesext / blendertools
pipeline,Blender addons that improve the game development workflow between Blender and Unreal.
Organization: epicgamesext
Home Page: https://epicgamesext.github.io/BlenderTools/
python blender blender-addon unreal pipeline

firecow / gitlab-ci-local
pipeline,Tired of pushing to test your .gitlab-ci.yml?
User: firecow
gitlab local pipeline git ci cd push untracked uncomitted gitlab-ci

gaia-pipeline / gaia
pipeline,Build powerful pipelines in any programming language.
Organization: gaia-pipeline
go pipeline automation java python cplusplus build deployment kubernetes continuous-integration

galaxyproject / galaxy
pipeline,Data intensive science for everyone.
Organization: galaxyproject
Home Page: https://galaxyproject.org
bioinformatics workflow genomics science sequencing ngs dna usegalaxy pipeline workflow-engine

gonglei007 / gamedevmind
pipeline,最全面的游戏开发技术图谱。帮助游戏开发者们在已知问题上节省时间，省出更多的精力投入到更有创造性的工作中去。
User: gonglei007
game-development unity3d 3d programming unreal-engine unrealengine game shader game-server framework

google / xls
pipeline,XLS: Accelerated HW Synthesis
Organization: google
Home Page: http://google.github.io/xls/
compiler high-level-synthesis hls open-source pipeline verilog mid-level-synthesis

great-expectations / great_expectations
pipeline,Always know what to expect from your data.
Organization: great-expectations
Home Page: https://docs.greatexpectations.io/
cleandata data-engineering data-profilers data-profiling data-quality data-science data-unit-tests datacleaner datacleaning dataquality dataunittest eda exploratory-analysis exploratory-data-analysis exploratorydataanalysis mlops pipeline pipeline-debt pipeline-testing pipeline-tests

hu17889 / go_spider
pipeline,[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
User: hu17889
spider crawler go schedule pipeline

iam-veeramalla / jenkins-zero-to-hero
pipeline,Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.
User: iam-veeramalla
Home Page: https://www.youtube.com/@AbhishekVeeramalla
argocd cicd docker gitops jenkins kubernetes pipeline

instill-ai / instill-core
pipeline,🔮 Instill Core is an open-source no-/low-code data, model, and pipeline orchestration platform
Organization: instill-ai
Home Page: https://www.instill.tech
unstructured-data low-code developer-tools etl no-code open-source hacktoberfest ai api cli

jenkins-x / jx
pipeline,Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton
Organization: jenkins-x
Home Page: https://jenkins-x.io/
kubernetes cicd continuous-integration continuous-delivery accelerator openshift gitops environments pipeline devops

jina-ai / jina
pipeline,☁️ Build multimodal AI applications with cloud-native stack
Organization: jina-ai
Home Page: https://docs.jina.ai
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline

kedro-org / kedro
pipeline,Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Organization: kedro-org
Home Page: https://kedro.org
pipeline kedro hacktoberfest mlops experiment-tracking python machine-learning machine-learning-engineering

kestra-io / kestra
pipeline,Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Organization: kestra-io
Home Page: https://kestra.io
workflow workflow-engine orchestration scheduler data-pipeline elt etl data data-engineering data-orchestration

kubeflow / pipelines
pipeline,Machine Learning Pipelines for Kubeflow
Organization: kubeflow
Home Page: https://www.kubeflow.org/docs/components/pipelines/
kubeflow-pipelines mlops kubeflow machine-learning kubernetes pipeline data-science

lastbackend / lastbackend
pipeline,System for containerized apps management. From build to scaling.
Organization: lastbackend
Home Page: https://lastbackend.com
cloud docker hosting continuous-delivery continuous-integration backend go golang containers lastbackend paas kubernetes service-discovery devops orchestration devtools pipeline container ci cd

mage-ai / mage-ai
pipeline,🧙 Build, run, and manage data pipelines for integrating and transforming data.
Organization: mage-ai
Home Page: https://www.mage.ai/
machine-learning artificial-intelligence data data-engineering data-science python elt etl pipelines data-pipelines

mara / mara-pipelines
pipeline,A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Organization: mara
etl data-integration python postgresql pipeline data

marimo-team / marimo
pipeline,A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
Organization: marimo-team
Home Page: https://marimo.io
notebooks python data-science machine-learning artificial-intelligence data-visualization developer-tools reactive pipeline web-app dag dataflow

moby / datakit
pipeline,Connect processes into powerful data pipelines with a simple git-like filesystem interface
Organization: moby
datakit filesystem-api data-flow database docker pipeline

nextflow-io / nextflow
pipeline,A DSL for data-driven computational pipelines
Organization: nextflow-io
Home Page: http://nextflow.io
bioinformatics workflow-engine pipeline pipeline-framework nextflow cloud groovy sge slurm aws

nteract / papermill
pipeline,📚 Parameterize, execute, and analyze notebooks
Organization: nteract
Home Page: http://papermill.readthedocs.io/en/latest/
jupyter notebooks notebook-generator nteract publishing pipeline notebook python r julia scala

prefecthq / prefect
pipeline,Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
Organization: prefecthq
Home Page: https://prefect.io
python workflow data-engineering data-science workflow-engine prefect infrastructure ml-ops data-ops automation

projectdiscovery / httpx
pipeline,httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
Organization: projectdiscovery
Home Page: https://docs.projectdiscovery.io/tools/httpx
http bugbounty ssl-certificate pipeline pentest-tool cybersecurity osint hacktoberfest cli lib

prql / prql
pipeline,PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
Organization: prql
Home Page: https://prql-lang.org
data pipeline sql

reugn / go-streams
pipeline,A lightweight stream processing library for Go
User: reugn
Home Page: https://pkg.go.dev/github.com/reugn/go-streams
aerospike data-pipeline data-stream etl kafka kafka-streams low-code nats-streaming pipeline pulsar redis stream-processing stream-processor streaming-api streaming-data streams throttling websocket windowing workflow

ropensci / drake
pipeline,An R-focused pipeline toolkit for reproducibility and high-performance computing
Organization: ropensci
Home Page: https://docs.ropensci.org/drake
reproducibility high-performance-computing r data-science drake makefile pipeline workflow reproducible-research rstats

scipipe / scipipe
pipeline,Robust, flexible and resource-efficient pipelines using Go and the commandline
Organization: scipipe
Home Page: https://scipipe.org
scientific-workflows bioinformatics-pipeline workflow go dataflow pipeline cheminformatics bioinformatics fbp scipipe

stelligent / mu
pipeline,A full-stack DevOps on AWS framework
Organization: stelligent
Home Page: https://getmu.io
microservice pipeline golang continuous-delivery docker ecs cloudformation codepipeline

tc39 / proposal-pipeline-operator
pipeline,A proposal for adding a useful pipe operator to JavaScript.
Organization: tc39
Home Page: http://tc39.github.io/proposal-pipeline-operator/
javascript tc39 proposal pipeline operator syntax

tektoncd / pipeline
pipeline,A cloud-native Pipeline resource.
Organization: tektoncd
Home Page: https://tekton.dev
tekton pipeline kubernetes cdf hacktoberfest

tencentblueking / bk-sops
pipeline,蓝鲸智云标准运维(SOPS)
Organization: tencentblueking
Home Page: https://bk.tencent.com
python devops-tools blueking pipeline bpmn2 flow flowengine bpmn-engine workflow workflow-engine

tencentmusic / cube-studio
pipeline,cube studio开源云原生一站式机器学习/深度学习AI平台，支持sso登录，多租户/多项目组，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
Organization: tencentmusic
kubernetes inference mlops workflow ai pytorch spark argo kubeflow automl

towhee-io / towhee
pipeline,Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
Organization: towhee-io
Home Page: https://towhee.io
machine-learning convolutional-networks embedding-vectors embeddings computer-vision image-processing video-processing feature-extraction image-retrieval unstructured-data

vectordotdev / vector
pipeline,A high-performance observability data pipeline.
Organization: vectordotdev
Home Page: https://vector.dev
router logs metrics rust observability forwarder vector parser events stream-processing

yuanzhoulvpi2017 / zero_nlp
pipeline,中文nlp解决方案(大模型、数据、模型、训练、推理)
User: yuanzhoulvpi2017
bert nlp transformers gpt2 chatglm-6b clip gpt gpt-neox pytorch text-generation