Code Monkey home page Code Monkey logo

data-drift's Introduction


Datadrift logo

Data-Drift Build Storybook DataGit version

The Chronological Metric Store

Datadrift helps analytics teams provide auditable metrics to demanding data consumers.

DataDrift

❓ Why Datadrift?

We know providing actionnable and trusted metrics is hard. Here is how Datadrift helps:

Metric changelog and metadata: give data consumers the full context and explain why metrics changed over time.

Drift detection and troobleshooting: solve metric quality issues fast and painlessly.

Open-source: break free from vendor-lock in and shape your own metric store with open-source collaboration.


🚀 Quickstart

dbt installation (beta)

pip install datagit
datagit dbt run

Check the video

Python installation

Put the probe in your pipeline.

>>> from datagit import connector
>>> connector.store_metric(dataframe=dataframe, filepath="data/act_metrics_finance/mrr")

For a step-by-step guide on the python installation, see the docs.

We are in development and we would love to do the installation with you. Fill the form on our website so we can do a 15min demo. If the tool solves your problem then the installation require 2*30 min meeting.


⚡️ Use cases

🔔 Monitoring drift with custom alerting

Become aware of unknown unknowns in your data quality with metric drift alerting. Monitor the quality and consistency of your metrics over time.

DataDrift new drift custom alerting

🔬 Troubleshooting & metric reconciliation

Operationalize your monitoring and solve your underlying data quality issue with lineage drill-down to understand the root cause of the problem.

DataDrift metric drift changelog

🔄 Safe refactoring and migrations

Migrate without hassle and safely between tools with diff-checks before/after and within/across databases.

DataDrift diff compare table

🧠 And much more

We'd love to hear from you if you have any other use case. Just open a new issue to tell us more about it and see how we could help!


💚 Contributing

We 💚 contributions big and small. In priority order (although everything is appreciated) with the most helpful first:


🗓 Upcoming features

Track planning on Github Projects and help us prioritising by upvoting or creating issues.

data-drift's People

Contributors

samox avatar lucasdvrs avatar bl3f avatar marcbllv avatar phc avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.