Topic: mlops Goto Github

👇 Here are 2233 public repositories matching this topic...

activeloopai / deeplake
mlops,Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
Organization: activeloopai
Home Page: https://activeloop.ai
ai computer-vision cv data-science data-version-control datalake datasets deep-learning image-processing langchain large-language-models llm machine-learning ml mlops python pytorch tensorflow vector-database vector-search

aimhubio / aim
mlops,Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
Organization: aimhubio
Home Page: https://aimstack.io
python ai data-science data-visualization experiment-tracking machine-learning metadata metadata-tracking ml mlflow

allegroai / clearml
mlops,ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
Organization: allegroai
Home Page: https://clear.ml/docs
version-control experiment-manager version control experiment deeplearning deep-learning machine-learning machinelearning ai

apache / airflow
mlops,Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Organization: apache
Home Page: https://airflow.apache.org/
airflow apache apache-airflow python scheduler workflow automation dag data-engineering data-integration

argilla-io / argilla
mlops,Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
Organization: argilla-io
Home Page: https://docs.argilla.io
human-in-the-loop natural-language-processing mlops developer-tools text-labeling annotation-tool nlp machine-learning active-learning weak-supervision weakly-supervised-learning text-annotation llm ai gpt-4 rlhf langchain

argoproj / argo-workflows
mlops,Workflow Engine for Kubernetes
Organization: argoproj
Home Page: https://argo-workflows.readthedocs.io/
airflow argo argo-workflows batch-processing cloud-native cncf dag data-engineering gitops hacktoberfest k8s knative kubernetes machine-learning mlops pipelines workflow workflow-engine

arize-ai / phoenix
mlops,AI Observability & Evaluation
Organization: arize-ai
Home Page: https://docs.arize.com/phoenix
ml-observability model-observability ai-roi llmops mlops ai-monitoring ai-observability llm-eval aiengineering datasets

ashleve / lightning-hydra-template
mlops,PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡
User: ashleve
pytorch-lightning project-structure config deep-learning hydra template pytorch reproducibility best-practices mlops

avaiga / taipy
mlops,Turns Data and AI algorithms into production-ready web applications in no time.
Organization: avaiga
Home Page: https://www.taipy.io
automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines

aws / amazon-sagemaker-examples
mlops,Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
Organization: aws
Home Page: https://sagemaker-examples.readthedocs.io
sagemaker aws reinforcement-learning machine-learning deep-learning examples jupyter-notebook mlops data-science training

bentoml / bentoml
mlops,The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!
Organization: bentoml
Home Page: https://bentoml.com
ai-inference deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python

bentoml / openllm
mlops,Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
Organization: bentoml
Home Page: https://bentoml.com
llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna

chiphuyen / machine-learning-systems-design
mlops,A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems"
User: chiphuyen
Home Page: https://huyenchip.com/machine-learning-systems-design/toc.html
data-science machine-learning-production mlops

dagster-io / dagster
mlops,An orchestration platform for the development, production, and observation of data assets.
Organization: dagster-io
Home Page: https://dagster.io
data-pipelines dagster workflow data-science workflow-automation python scheduler data-orchestrator etl analytics

datatalksclub / mlops-zoomcamp
mlops,Free MLOps course from DataTalks.Club
Organization: datatalksclub
machine-learning mlops model-deployment model-monitoring workflow-orchestration

deepchecks / deepchecks
mlops,Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
Organization: deepchecks
Home Page: https://docs.deepchecks.com/stable
machine-learning ml model-validation data-validation mlops data-science python jupyter-notebook model-monitoring data-drift

ethicalml / awesome-production-machine-learning
mlops,A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
Organization: ethicalml
Home Page: https://ethicalml.github.io/awesome-production-machine-learning
machine-learning mlops interpretability explainability responsible-ai deep-learning machine-learning-operations ml-ops ml-operations privacy-preserving

evidentlyai / evidently
mlops,Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
Organization: evidentlyai
Home Page: https://www.evidentlyai.com/evidently-oss
data-drift jupyter-notebook pandas-dataframe machine-learning model-monitoring html-report mlops data-science hacktoberfest data-quality

feast-dev / feast
mlops,The Open Source Feature Store for Machine Learning
Organization: feast-dev
Home Page: https://feast.dev
big-data data-engineering data-quality data-science feature-store features machine-learning ml mlops python

fedml-ai / fedml
mlops,FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
Organization: fedml-ai
Home Page: https://TensorOpera.ai
federated-learning deep-learning distributed-training edge-ai machine-learning on-device-training inference-engine mlops model-deployment model-serving

flyteorg / flyte
mlops,Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
Organization: flyteorg
Home Page: https://flyte.org
flyte machine-learning golang scale workflow data-science data-analysis data kubernetes-operator kubernetes

giskard-ai / giskard
mlops,🐢 Open-Source Evaluation & Testing for LLMs and ML models
Organization: giskard-ai
Home Page: https://docs.giskard.ai
mlops ml-validation ml-testing ai-testing ai-safety ml-safety llmops ethical-artificial-intelligence responsible-ai fairness-ai

gokumohandas / made-with-ml
mlops,Learn how to design, develop, deploy and iterate on production-grade ML applications.
User: gokumohandas
Home Page: https://madewithml.com
machine-learning deep-learning pytorch natural-language-processing data-science python mlops data-engineering data-quality distributed-ml llms ray distributed-training

great-expectations / great_expectations
mlops,Always know what to expect from your data.
Organization: great-expectations
Home Page: https://docs.greatexpectations.io/
pipeline-tests dataquality datacleaning datacleaner data-science data-profiling pipeline pipeline-testing cleandata dataunittest

hemansnation / god-level-ai
mlops,A collection of scientific methods, processes, algorithms, and systems to build stories & models.
User: hemansnation
Home Page: https://www.himanshuramchandani.co/
python datastructures numpy pandas matplotlib scikit-learn machine-learning deep-learning pytorch data-science

higgsfield-ai / higgsfield
mlops,Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
Organization: higgsfield-ai
cluster-management deep-learning distributed llama llama2 llm machine-learning mlops pytorch

humansignal / label-studio
mlops,Label Studio is a multi-type data labeling and annotation tool with standardized output format
Organization: humansignal
Home Page: https://labelstud.io
computer-vision deep-learning image-annotation annotation-tool annotation labeling labeling-tool image-labeling image-labelling-tool boundingbox

jina-ai / jina
mlops,☁️ Build multimodal AI applications with cloud-native stack
Organization: jina-ai
Home Page: https://docs.jina.ai
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline fastapi generative-ai docker jaeger llmops opentelemetry cncf microservice orchestration prometheus

kedro-org / kedro
mlops,Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Organization: kedro-org
Home Page: https://kedro.org
pipeline kedro hacktoberfest mlops experiment-tracking python machine-learning machine-learning-engineering

kelvins / awesome-mlops
mlops,:sunglasses: A curated list of awesome MLOps tools
User: kelvins
awesome machine-learning machine-learning-engineering mle mlops data-science ml ai

kserve / kserve
mlops,Standardized Serverless ML Inference Platform on Kubernetes
Organization: kserve
Home Page: https://kserve.github.io/website/
knative machine-learning model-interpretability model-serving istio kubeflow kubeflow-pipelines artificial-intelligence tensorflow pytorch

kubeflow / pipelines
mlops,Machine Learning Pipelines for Kubeflow
Organization: kubeflow
Home Page: https://www.kubeflow.org/docs/components/pipelines/
kubeflow-pipelines mlops kubeflow machine-learning kubernetes pipeline data-science

lancedb / lance
mlops,Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
Organization: lancedb
Home Page: https://lancedb.github.io/lance/
apache-arrow computer-vision data-analysis data-analytics data-centric data-format data-science dataops deep-learning duckdb embeddings llms machine-learning mlops python rust

microsoft / nni
mlops,An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
Organization: microsoft
Home Page: https://nni.readthedocs.io
automl deep-learning neural-architecture-search hyperparameter-optimization distributed bayesian-optimization automated-machine-learning machine-learning machine-learning-algorithms data-science

netflix / metaflow
mlops,:rocket: Build and manage real-life ML, AI, and data science projects with ease!
Organization: netflix
Home Page: https://metaflow.org
machine-learning data-science productivity model-management ai ml ml-platform ml-infrastructure python r

ploomber / ploomber
mlops,The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
Organization: ploomber
Home Page: https://docs.ploomber.io
data-engineering data-science jupyter jupyter-notebooks machine-learning mlops notebooks papermill pipelines pycharm vscode workflow

polyaxon / polyaxon
mlops,MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
Organization: polyaxon
Home Page: https://polyaxon.com
artificial-intelligence caffe data-science deep-learning hyperparameter-optimization jupyter jupyterlab k8s keras kubernetes machine-learning ml mlops mxnet notebook pipelines pytorch reinforcement-learning tensorflow workflow

pytorch / serve
mlops,Serve, optimize and scale PyTorch models in production
Organization: pytorch
Home Page: https://pytorch.org/serve/
pytorch machine-learning mlops serving docker kubernetes optimization cpu gpu metrics

qdrant / qdrant
mlops,Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Organization: qdrant
Home Page: https://qdrant.tech
neural-network matching search-engine knn-algorithm hnsw vector-search nearest-neighbor-search image-search embeddings-similarity approximate-nearest-neighbor-search

seldonio / seldon-core
mlops,An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
Organization: seldonio
Home Page: https://www.seldon.io/tech/products/core/
kubernetes machine-learning deployment serving mlops aiops machine-learning-operations production-machine-learning

skalskip / courses
mlops,This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
User: skalskip
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp

stas00 / ml-engineering
mlops,Machine Learning Engineering Open Book
User: stas00
Home Page: https://stasosphere.com/machine-learning/
pytorch slurm large-language-models llm machine-learning scalability transformers machine-learning-engineering mlops ai

superduper-io / superduper
mlops,Superduper: Bring AI to your database! Integrate AI models and workflows with your database to implement custom AI applications, without moving your data. Including streaming inference, scalable model hosting, training and vector search.
Organization: superduper-io
Home Page: https://superduper.io
ai chatbot data database distributed-ml inference llm-inference llm-serving llmops ml mlops mongodb pretrained-models python pytorch rag semantic-search torch transformers vector-search

tencentmusic / cube-studio
mlops,cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
Organization: tencentmusic
kubernetes inference mlops workflow ai pytorch spark argo kubeflow automl aihub gpt llmops notebook pipeline vgpu

tensorchord / awesome-llmops
mlops,An awesome & curated list of best LLMOps tools for developers
Organization: tensorchord
awesome-list mlops ai-development-tools llmops

visenger / awesome-mlops
mlops,A curated list of references for MLOps
User: visenger
Home Page: https://ml-ops.org
machine-learning mlops data-science engineering federated-learning devops software-engineering ai ml

vllm-project / vllm
mlops,A high-throughput and memory-efficient inference and serving engine for LLMs
Organization: vllm-project
Home Page: https://docs.vllm.ai
gpt llm pytorch llmops mlops model-serving transformer llm-serving inference llama

wandb / wandb
mlops,🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
Organization: wandb
Home Page: https://wandb.ai
machine-learning experiment-track deep-learning keras tensorflow pytorch hyperparameter-search reinforcement-learning mlops data-science

weaviate / weaviate
mlops,Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.
Organization: weaviate
Home Page: https://weaviate.io/developers/weaviate/
search-engine semantic-search semantic-search-engine vector-search vector-search-engine vector-database approximate-nearest-neighbor-search image-search hnsw information-retrieval

zenml-io / zenml
mlops,ZenML 🙏: The bridge between ML and Ops. https://zenml.io.
Organization: zenml-io
Home Page: https://zenml.io
mlops machine-learning data-science production-ready devops-tools zenml pipelines metadata-tracking deep-learning pytorch