Topic: data-governance Goto Github

Some thing interesting about data-governance

👇 Here are 113 public repositories matching this topic...

agile-lab-dev / governance-decision-record

data-governance,The Governance Decision Record (GDR) is a specification model for (computational) data governance policies inspired from the ADR (Architectural Decision Record).

Organization: agile-lab-dev

architectural-decision-records data data-governance data-management data-management-platform data-mesh platform federated-computational-governance governance-decision-record policy-as-code

atlas-bi / library

data-governance,🤔📈 Atlas | The unified report library.

Organization: atlas-bi

Home Page: https://atlas.bi

atlas documentation-database business-intelligence library data-governance bi bi-library

aws-samples / document-processing-pipeline-for-regulated-industries

data-governance,A boilerplate solution for processing image and PDF documents for regulated industries, with lineage and pipeline operations metadata services.

Organization: aws-samples

Home Page: https://aws.amazon.com/blogs/machine-learning/intelligent-governance-of-document-processing-pipelines-for-regulated-industries/

machine-learning aws cdk aws-lambda amazon-web-services processing-pipelines amazon-textract amazon-dynamodb amazon-elasticsearch-service amazon-comprehend amazon-s3 amazon-sns amazon-sqs aws-cdk pdf-processing image-processing data-analytics data-lineage image-processing-python data-governance

cdcgov / cdh-lava-react

data-governance,CDC Data Hub Lifecycle, Analysis & Visualization Accelerator (LAVA) REACT Components based on machine readable requirements.

Organization: cdcgov

sql databricks metadata security devops data-science azure test-automation data-visualization pyspark

conduktor / conduktor-poc-kafka-protocol

data-governance,POC to demonstrate how to alter incoming/outgoing records in Kafka. It's a toy, don't use it in production.

Organization: conduktor

Home Page: https://www.conduktor.io

chaos data-governance data-mesh kafka gateway

data-drift / data-drift

data-governance,Metrics Observability & Troubleshooting

Organization: data-drift

Home Page: https://www.data-drift.io/

context data-monitoring data-observability data-quality dbt metrics semantic-layer dbt-metrics analytics data-diffing

datasphere-oss / datasphere-government

data-governance,an data-centric government platform

Organization: datasphere-oss

data-management-platform data-governance

datasphere-oss / datasphere-service

data-governance,an open source dataworks platform

Organization: datasphere-oss

middle-office bigdata bigdatacloud-api datamanagement data-governance microservice cloud-native

daxa-ai / pebblo

data-governance,Pebblo enables developers to safely load data and promote their Gen AI app to deployment

Organization: daxa-ai

Home Page: https://daxa.ai/pebblo

data-governance gen-ai llm rag topic-classification entity-classification

elementary-data / elementary

data-governance,The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

Organization: elementary-data

Home Page: https://www.elementary-data.com/

data-lineage data-governance data-warehouse snowflake bigquery data-analysis data-pipelines data-pipeline lineage data-reliability

getstrm / pace

data-governance,Data policy IN, dynamic view OUT: PACE is the Policy As Code Engine. It helps you to programatically create and apply a data policy to a processing platform like Databricks, Snowflake or BigQuery (or plain 'ol Postgres, even!) with definitions imported from Collibra, Datahub, ODD and the like.

Organization: getstrm

Home Page: https://pace.getstrm.com

data-catalog data-processing policy-enforcement bigquery data-contracts data-governance databricks snowflake

googlecloudplatform / auto-data-tokenize

data-governance,Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow

Organization: googlecloudplatform

data-governance cloud-migration tokenization deidentification data-loss-prevention dataflow

googlecloudplatform / bigquery-data-lineage

data-governance,Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Organization: googlecloudplatform

Home Page: https://cloud.google.com/blog/products/data-analytics/architecting-a-data-lineage-system-for-bigquery

data-lineage bigdata bigquery zetasql dataflow data-governance data-management data-catalog

googlecloudplatform / datacatalog-tag-history

data-governance,Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quality and user behaviour. This solution creates Data Catalog Tags history in BigQuery since Data Catalog keeps only the latest version of metadata for fast searchability.

Organization: googlecloudplatform

Home Page: https://cloud.google.com/community/tutorials/datacatalog-tag-history

data-governance metadata-management analytics data-catalog bigquery

guinsoolab / darkseal

data-governance,A Single place to Discover, Collaborate, and Get your data right

Organization: guinsoolab

Home Page: https://guinsoolab.github.io/glab/#/app/darkseal

metadata catalog data-catalog data-discovery data-platform data-structures metadata-management metadata-standard guinsoolab data-documentation

hivemq / hivemq-edge

data-governance,HiveMQ Edge is an MQTT gateway that enables interoperability between OT devices and IT systems. It translates diverse protocols into MQTT for streamlined communication and helps organize data into a unified namespace, making managing and streaming data across your infrastructure easier.

Organization: hivemq

Home Page: http://hivemq.com

edge java mqtt mqtt-sn open-source ads bacnet http modbus opc-ua

huemulsolutions / huemul-bigdatagovernance

data-governance,Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, largos de textos, máximos/mínimos de números y fechas, valores únicos y valores por default. También permite clasificar los campos en aplicabilidad de derechos ARCO para facilitar la implementación de leyes de protección de datos tipo GDPR, identificar los niveles de seguridad y si se está aplicando algún tipo de encriptación. Adicionalmente permite agregar reglas de validación más complejas sobre la misma tabla.

Organization: huemulsolutions

bigdata spark-sql spark hive parquet data data-governance hadoop data-warehouse datamart

mara / mara-metabase

data-governance,Configuration and schema sync for Metabase from Python

Organization: mara

metabase metabase-python metadata python mara data-governance

mara / mara-schema

data-governance,Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables

Organization: mara

metadata datawarehousing python data-governance data-modeling

marquezproject / marquez

data-governance,Collect, aggregate, and visualize a data ecosystem's metadata

Organization: marquezproject

Home Page: https://marquezproject.ai

data-lineage data-discovery data-governance data-provenance metadata-service data-dictionary marquez metadata data-ecosystem-metadata data-ops

mesmacosta / datacatalog-util

data-governance,A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help leverage Data Catalog features.

User: mesmacosta

python bigdata datacatalog bulk csv-export csv csv-import cloud fileset-entries csv-importer data-management data-governance gcp gcp-storage google-datacatalog data-catalog-tagtemplate datacatalog-util filesets

odpi / data-governance

data-governance,Egeria's Guidance on Governance as well as large media files such as presentations and movies

Organization: odpi

Home Page: https://opengovernance.odpi.org/

data-governance odpi-egeria governance guidance semantics egeria

odpi / egeria

data-governance,Egeria core

Organization: odpi

Home Page: https://egeria-project.org

metadata-management governance data-governance data-engineering odpi-egeria linux-foundation odpi hacktoberfest java egeria

open-metadata / openmetadata

data-governance,OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

Organization: open-metadata

Home Page: https://open-metadata.org

metadata datadiscovery data-science dataquality data-profiling metadata-management dataengineering data-catalog data-observability dbt

opendatadiscovery / odd-collector

data-governance,Open-source metadata collector based on ODD Specification

Organization: opendatadiscovery

data-catalog data-discovery data-governance data-observability data-platform data-profiling datacatalog lineage data-piplines hacktoberfest

opendatadiscovery / odd-platform

data-governance,First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

Organization: opendatadiscovery

Home Page: https://opendatadiscovery.org

oss data-platform metadata metadata-management data-pipelines data-engineering observability data-catalog datacatalog data-discovery

opendatadiscovery / opendatadiscovery-specification

data-governance,ODD Specification is a universal open standard for collecting metadata.

Organization: opendatadiscovery

specification spec open-source big-data big-data-platform data-mesh api data-engineering data-discovery opensource

provectus / data-quality-gate

data-governance,Data Quality Gate based on AWS

Organization: provectus

aws data-quality great-expectations redshift s3 athena aws-lambda data-governance terraform

reata / sqllineage

data-governance,SQL Lineage Analysis Tool powered by Python

User: reata

data-discovery data-lineage lineage metadata sql data-governance

ricardolsmendes / datacatalog-tag-manager

data-governance,Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format

User: ricardolsmendes

datacatalog python bigdata csv-import data-governance gcp gcp-datacatalog google-cloud

ricardolsmendes / gcp-datacatalog-python

data-governance,Python samples to help Data Citizens who work with Google Cloud Data Catalog

User: ricardolsmendes

datacatalog python bigdata csv-import data-governance gcp gcp-datacatalog

ryandawsonuk / data-platforms-tools

data-governance,Guide to data platforms and tools

User: ryandawsonuk

azure-synapse-analytics data-warehousing bigquery databricks snowflake data-platform cloudera data-mesh data-governance

sburn / docker-apache-atlas

data-governance,This Apache Atlas is built from the latest release source tarball and patched to be run in a Docker container.

User: sburn

Home Page: https://hub.docker.com/r/sburn/apache-atlas

apache-atlas docker atlas data-governance metadata kickstart dockerfile hbase docker-image hbase-standalone

sodadata / soda-core

data-governance,:zap: Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io

Organization: sodadata

Home Page: https://go.soda.io/core-docs

python data-engineering data-governance data-monitoring data-observability data-profiling data-quality data-quality-checks data-quality-monitoring data-reliability

sonhmai / data-system-design

data-governance,System Design, Solution Architecture, Data Systems Practice

User: sonhmai

architecture data-engineering data-governance data-system-design streaming-data system-design

supernerb / data-governance-compilation

data-governance,This is a compilation of Data Governance resources, examples, models and communities

User: supernerb

governance data-governance

tinkoff / data-detective

data-governance,Data catalog for everything in your company

Organization: tinkoff

data-catalog metadata data-lineage data-governance data-detective

titan-systems / titan

data-governance,Titan Core - Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake data warehouse.

Organization: titan-systems

data-engineering data-warehouse snowflake data-governance dataops secops compliance-as-code devops rbac