This repository provides a comprehensive sample implementation of Azure IoT Operations Data Processor pipelines for industrial related scenarios using Machine Status and Total Counter tag enrichments.
The Azure IoT Operations Data Processor is a component of Azure IoT Operations (AIO) designed to handle the complexity and diversity of industrial data. It achieves this by offering data pipelines that enable you to aggregate, enrich, normalize, and filter data from your devices.
When navigating this repository, you will find a rich assortment of pipeline yaml and scripts to enrich and transform a simulated industrial payload.
This project framework provides the following features:
- AIO Data pipelines to calculate Machine Status and Total Count metrics
- Observability stack that collects metrics and sends them to an OpenTelemetry Collector.
- Validation pipeline that runs e2e tests
You can find a detailed architecture overview in system architecture document.
- A running GitHub Codespace of this repository.
- Dev container setup with k3d cluster. Upon creation of the Codespace, a k3d cluster "devcluster" is already running and ready to use.
- Azure Subscription:
az loginhas been executed and default subscription has been set. Ensure you have access to an Azure subscription where you can deploy resources.
In order to explore the solution, you can use the GitHub Codespace to quickly setup the environment and deploy the Azure IoT Operations components.
Important
Codespaces are easy to setup quickly and tear down later, but they're not suitable for performance evaluation or scale testing. For those scenarios, use a validated environment from the official documentation.
Azure IoT Operations Data Processor is currently in preview and not recommended for production use no matter the environment.
-
Use this GitHub codespace to explore Azure IoT Operations Data Processor in your browser without installing anything on your local machine.
-
Follow the instructions available in the Quickstart README.md. This will setup the infrastructure with an Arc-enabled K3d cluster and Azure IoT Operations components that support AIO Data Processor pipelines and deploy the AIO Data Processor pipelines.
The following video demonstrates the Azure IoT Operations Data Processor Jumpstart in action:
Note: The video is hosted on Microsoft Stream. If you are unable to access the video, please reach out to the repository maintainers.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent