Topic: pipelines Goto Github

👇 Here are 1033 public repositories matching this topic...

acln0 / zerocopy
pipelines,Zero-copy I/O primitives and pipelines for Go. Linux-specific.
User: acln0
splice tee linux go zero-copy pipelines

agnostiqhq / covalent
pipelines,Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
Organization: agnostiqhq
Home Page: https://www.covalent.xyz
covalent data-pipeline data-science deep-learning hacktoberfest hpc hpc-applications machine-learning machinelearning machinelearning-python orchestration parallelization pipelines python quantum quantum-computing quantum-machine-learning workflow workflow-automation workflow-management

argoproj / argo-events
pipelines,Event-driven Automation Framework for Kubernetes
Organization: argoproj
Home Page: https://argoproj.github.io/argo-events/
kubernetes event-driven cloudevents workflows triggers automation-framework cloud-native argo pipelines event-source

argoproj / argo-workflows
pipelines,Workflow Engine for Kubernetes
Organization: argoproj
Home Page: https://argo-workflows.readthedocs.io/
airflow argo argo-workflows batch-processing cloud-native cncf dag data-engineering gitops hacktoberfest k8s knative kubernetes machine-learning mlops pipelines workflow workflow-engine

avaiga / taipy
pipelines,Turns Data and AI algorithms into production-ready web applications in no time.
Organization: avaiga
Home Page: https://www.taipy.io
automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines

azure / azure-devops-cli-extension
pipelines,Azure DevOps Extension for Azure CLI
Organization: azure
Home Page: https://docs.microsoft.com/en-us/cli/azure/ext/azure-devops/?view=azure-cli-latest
cicd agile git command-line command-line-tool azure devops azure-devops azure-devops-extension azure-cli

bob-cd / bob
pipelines,This is what CI/CD should've been.
Organization: bob-cd
Home Page: https://bob-cd.github.io
ci cd ci-cd continuous-integration continuous-delivery continuous-deployment clojure jvm docker hacktoberfest

calebwin / pipelines
pipelines,An experimental programming language for data flow
User: calebwin
pipelines pipeline parallel language nim python compiler

concourse / concourse
pipelines,Concourse is a container-based continuous thing-doer written in Go.
Organization: concourse
Home Page: https://concourse-ci.org
go ci pipelines elm concourse continuous-integration continuous-delivery ci-cd hacktoberfest

cross-platform / dspatch
pipelines,The Refreshingly Simple Cross-Platform C++ Dataflow / Patching / Pipelining / Graph Processing / Stream Processing / Reactive Programming Framework
Organization: cross-platform
Home Page: https://flowbasedprogramming.com/
cpp cross-platform data-driven data-flow dataflow dataflow-programming fbp flow-based-programming graph-processing header-only patching pipelines pipelining reactive-programming stream-processing

cuebook / cuelake
pipelines,Use SQL to build ELT pipelines on a data lakehouse.
Organization: cuebook
Home Page: https://cuelake.cuebook.ai
apache-iceberg delta lakehouse datalake data-lake elt etl data-engineering data-integration data-ingestion

dataplane-app / dataplane
pipelines,Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
Organization: dataplane-app
Home Page: https://dataplane.app
golang airflow kubernetes data scheduler workflows workflow-automation data-pipelines data-science data-engineering

dmmiller612 / sparktorch
pipelines,Train and run Pytorch models on Apache Spark.
User: dmmiller612
pytorch sparktorch deep-learning apache-spark pipelines inference distributed-computing

elyra-ai / elyra
pipelines,Elyra extends JupyterLab with an AI centric approach.
Organization: elyra-ai
Home Page: https://elyra.readthedocs.io/en/stable/
notebooks notebook-jupyter jupyterlab jupyterlab-extensions ai machine-learning pipelines kubeflow-pipelines python elyra

harness / drone-cli
pipelines,Command Line Tools for Drone CI
Organization: harness
Home Page: https://docs.drone.io/cli
continuous-integration continuous-delivery pipelines

hydrospheredata / hydro-serving
pipelines,MLOps Platform
Organization: hydrospheredata
Home Page: http://docs.hydrosphere.io
serving scoring spark tensorflow scikit-learn serverless pipelines realtime machine-learning models

intel / dffml
pipelines,The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Organization: intel
Home Page: https://intel.github.io/dffml/main/
machine-learning data-flow asyncio event-based flow-based-programming dag hyperautomation dataflows datasets dffml

jean-njoroge / breast-cancer-risk-prediction
pipelines,Classification of Breast Cancer diagnosis Using Support Vector Machines
User: jean-njoroge
supervised-learning breast-cancer-prediction breast-cancer-tumor breastcancer-classification data-analysis svm exploratory-data-analysis notebook prediction-model dataprocessing

juliaai / mlj.jl
pipelines,A Julia machine learning framework
Organization: juliaai
Home Page: https://juliaai.github.io/MLJ.jl/
machine-learning julia pipelines tuning data-science tuning-parameters predictive-modeling classification regression statistics

juliankemmerer / pipelinec
pipelines,A C-like hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.
User: juliankemmerer
Home Page: https://github.com/JulianKemmerer/PipelineC/wiki
fpga hardware-description-language vhdl pipelines c python hardware hardware-description high-level-synthesis hls

live-keys / livekeys
pipelines,Livekeys - Automation Platform with support for live scripting.
Organization: live-keys
Home Page: https://livekeys.io
pipelines video-processing image-processing live-coding

machine-learning-exchange / mlx
pipelines,Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engine
Organization: machine-learning-exchange
Home Page: https://ml-exchange.org/
models datasets pipelines kubernetes kubeflow-pipeline tekton notebook-jupyter mlx mlx-catalog machine-learning openshift

mage-ai / mage-ai
pipelines,🧙 Build, run, and manage data pipelines for integrating and transforming data.
Organization: mage-ai
Home Page: https://www.mage.ai/
machine-learning artificial-intelligence data data-engineering data-science python elt etl pipelines data-pipelines

mdubourg001 / glci
pipelines,🦊 Test your Gitlab CI Pipelines changes locally using Docker.
User: mdubourg001
gitlab ci gitlab-ci docker jobs pipelines

meltano / meltano
pipelines,Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Organization: meltano
Home Page: https://meltano.com/
dataops dataops-platform elt open-source opensource data pipelines extract-data meltano meltano-sdk

microsoft / psi
pipelines,Platform for Situated Intelligence
Organization: microsoft
Home Page: https://github.com/microsoft/psi/wiki
multimodal streaming human-robot-interaction multimodal-interactions perception framework stream-processing component-library artificial-intelligence pipelines

natayadev / dataengineering-roadmap
pipelines,Un repositorio más con conceptos básicos, desafíos técnicos y recursos sobre ingeniería de datos en español 🧙✨
User: natayadev
Home Page: https://natayadev.github.io/dataengineering-roadmap/
ai big-data data data-engineering pipelines ingenieria-de-datos roadmap

nf-core / modules
pipelines,Repository to host tool-specific module files for the Nextflow DSL2 community!
Organization: nf-core
Home Page: https://nf-co.re/modules
nf-core nextflow modules workflows pipelines dsl2 nf-test

onepanelio / onepanel
pipelines,The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
Organization: onepanelio
Home Page: https://docs.onepanel.ai/
deeplearning pipelines machinelearning jupyterlab tensorflow pytorch tensorboard computer-vision mlops workflows

orchest / orchest
pipelines,Build data pipelines, the easy way 🛠️
Organization: orchest
Home Page: https://orchest.readthedocs.io/en/stable/
data-science machine-learning pipelines ide jupyter cloud self-hosted jupyterlab notebooks docker

ploomber / ploomber
pipelines,The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
Organization: ploomber
Home Page: https://docs.ploomber.io
workflow machine-learning data-science data-engineering mlops papermill jupyter jupyter-notebooks pipelines vscode pycharm notebooks

polyaxon / polyaxon
pipelines,MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
Organization: polyaxon
Home Page: https://polyaxon.com
deep-learning machine-learning artificial-intelligence data-science reinforcement-learning kubernetes tensorflow pytorch keras mxnet

project-codeflare / codeflare
pipelines,Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.
Organization: project-codeflare
Home Page: https://codeflare.dev
automl data-science hyperparameter-optimization machine-learning pipelines ray sklearn workflows

pypyr / pypyr
pipelines,pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
Organization: pypyr
Home Page: https://pypyr.io
pipeline pipeline-runner pipeline-processor pipelines-yaml devops task-runner script script-loader taskrunner automation ci cd ci-cd tool task-manager pipelines continuous-deployment continuous-integration python

pytorch / torchx
pipelines,TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Organization: pytorch
Home Page: https://pytorch.org/torchx
pytorch machine-learning kubernetes slurm distributed-training pipelines components deep-learning python aws-batch

reubenbond / hagar
pipelines,Fast, flexible, and version-tolerant serializer for .NET
User: reubenbond
serializer dotnet-core dotnet serialization-library span pipelines

rosineygp / mkdkr
pipelines,mkdkr = Makefile + Docker
User: rosineygp
Home Page: https://rosineygp.github.io/mkdkr/
makefile docker pipelines bash travis-ci cirleci github-actions jenkins gitlab-ci

salesforce / transmogrifai
pipelines,TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Organization: salesforce
Home Page: https://transmogrif.ai
ml automl transformations estimators dsl pipelines machine-learning scala salesforce einstein

sharpliner / sharpliner
pipelines,Use C# instead of YAML to define your Azure DevOps pipelines
Organization: sharpliner
Home Page: https://www.nuget.org/packages/Sharpliner/
azure-devops-pipelines pipelines yaml azure-devops csharp dotnet

smooks / smooks
pipelines,Extensible data integration Java framework for building XML and non-XML fragment-based applications
Organization: smooks
Home Page: https://www.smooks.org
analytics big-data enterprise-integration etl event-driven java pipelines sax smooks stream-processing xml

stacksimplify / azure-aks-kubernetes-masterclass
pipelines,Azure AKS Kubernetes Masterclass
User: stacksimplify
Home Page: https://stacksimplify.com/azure-aks/azure-kubernetes-service-introduction/
azure-devops aks azure-container-registry kubernetes pipelines

substantic / rain
pipelines,Framework for large distributed pipelines
Organization: substantic
Home Page: https://substantic.github.io/rain/docs/
pipelines distributed-computing python-api rust workflows

tektoncd / triggers
pipelines,Event triggering with Tekton!
Organization: tektoncd
tekton pipelines triggers hacktoberfest

tenzir / tenzir
pipelines,Open source security data pipelines.
Organization: tenzir
Home Page: https://docs.tenzir.com
incident-response threathunting siem soc security dataops investigation pcap secdataops netflow

thomhurst / modularpipelines
pipelines,Write your pipelines in C# !
User: thomhurst
Home Page: https://thomhurst.github.io/ModularPipelines/
build build-system build-tool build-tools csharp pipeline pipeline-deploy pipeline-framework pipelines dotnet

timoschwarzer / gitlab-monitor
pipelines,A web-based monitor dashboard for GitLab CI
User: timoschwarzer
Home Page: https://gitlab-monitor.timoschwarzer.com
gitlab dashboard monitor gitlabci pipelines hacktoberfest

toloka / toloka-kit
pipelines,Toloka-Kit is a Python library for working with Toloka API.
Organization: toloka
Home Page: https://toloka.ai
crowd python3 toloka engineers machine-learning label annotation data-mining api data-labeling

tseemann / shovill
pipelines,⚡♠️ Assemble bacterial isolate genomes from Illumina paired-end reads
User: tseemann
genome-assembler illumina-sequencing pipelines

zenml-io / zenml
pipelines,ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Organization: zenml-io
Home Page: https://zenml.io
mlops machine-learning data-science production-ready devops-tools zenml pipelines metadata-tracking deep-learning pytorch

zorbash / opus
pipelines,A framework for pluggable business logic components
User: zorbash
railway-oriented-programming pipelines dsl elixir