Code Monkey home page Code Monkey logo

anomaly-detection-in-petroleum-pipelines's Introduction

Anomaly Detection in Petroleum Pipelines ๐Ÿ›ข๏ธ

Problem ๐ŸŽฏ

Detect the position of anomalies in petrol pipelines using data generated from a maintenance device called "Pig" that travels inside the pipeline.

  • Detecting Wielding
  • Visualising Metal loss and or dents

About Data ๐Ÿ“‹

  • Data is in binary format saved in - 'captured_data.bin' file, captured from 84 sensors for 50_000 milliseconds
  • Pigs directly captured/stored data in binary(.bin) format

Data Analysis Insights with Understanding ๐Ÿ“ˆ

  • Data varies with time i.e., Time Series data
  • We can also see a repeated pattern of flux at times in all sensors.

Techniques ๐Ÿ› ๏ธ

  • Normalised data for comparison purposes.
  • Aggregated(sum) all sensors to amplify anamoly.
  • The z-score method is effective here in comparison to the Inter-Quartile Range method as per the observations.
  • Edge detection using Sobel, OpenCV.

Different Approaches Used ๐Ÿ”„

  • Approach 1: Using Various Statistical methods like InterQuartile Range, Z-score, etc.
  • Approach 2: By Filtering anomalies with Sobel Derivatives, Image Processing in OpenCV.

Approach 1 | Approach 2

Output ๐Ÿ“„

Pipe Number Outlier Position
0 0 624
1 0 678
2 1 5070
3 1 5117
4 1 8252
5 1 8286
6 2 11397
7 2 14990
8 3 15001
. . ...
. . ...
. . ...

Conclusion ๐Ÿ“

We can detect the position of welded iron and also visualise the metal loss.

Little Business Understanding

  • Many pipes are welded together to form a pipeline.
  • Pigging is a concept in pipeline maintenance that involves the use of devices known as pigs, which clean pipelines and are capable of checking pipeline conditions from inside.
  • Pigs inspect pipelines by receiving magnetic flux from the walls of the pipe.
  • Applications of Pigging include oil & gas, lube oil, chemical plants and hygienic applications such as pharmaceutical or food, etc.
  • Each "Pig"(here) has 84 sensors in circumference that capture data every millisecond while travelling in pipes. So this becomes a time series problem where each traversal time for each independent pipe is 5_000 milliseconds.

anomaly-detection-in-petroleum-pipelines's People

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.