Code Monkey home page Code Monkey logo

opensrp-server-etl's Introduction

opensrp-server-etl

Transfer CouchDB documents to postgres database.

opensrp-server-etl's People

Contributors

sohelsarder avatar sharon2719 avatar cafootitt avatar craigappl avatar

Stargazers

Peter Lubell-Doughtie avatar

Watchers

Peter Lubell-Doughtie avatar Matt Berg avatar Ukang'a Dickson avatar  avatar Kelvin Jayanoris avatar Simon Kiarie avatar Wambere avatar  avatar Linda Oscar Gcaba avatar James Cloos avatar Hayi Nukman avatar Rizki Sunaryo avatar Kassim Sheghembe avatar  avatar  avatar  avatar Andre Lesa avatar Emmanuel Tarus avatar Maimoona Kausar avatar  avatar ahmad wildan avatar Raihan Ahmed avatar  avatar Tychus avatar  avatar M Ibrahim Iqbal avatar Brian Mwasi avatar  avatar  avatar Denis rwelamila avatar septiadi avatar Proshanto Kumar Sarker avatar  avatar Devashish Choudhury avatar Shoaib Mushtaq avatar Lincoln Simba avatar shakeeb Raza avatar L≡ZRS avatar Isabel Shaw avatar Ephraim (Keyman) Muhia avatar Zahurul Islam Prince avatar  avatar kahammer avatar Nahid hasan prodhan avatar Faith Mutua avatar hngondoki avatar Ahsan .B avatar Kipchirchir Cheroigin avatar Md. Asaduzzaman avatar Kelvin Muchiri avatar  avatar  avatar Zita Tembo avatar Nursat Jahan avatar

Forkers

mz0in

opensrp-server-etl's Issues

BD-Family-Planning data transfer into postgres for MIS1 report generation

BD-Family-Planning data transfer into postgres for MIS1 report generation

Sub Tasks Under This Issue:

  • Transfer Data from CouchDB to PostgreSQL (Creating Different Entity classes, Services and Repositories, implementing utilities, resolving related issues)
  • Writing Raw SQL Queries for each field of MIS Report (Around 150 SQL queries)
  • Writing Web Services for fetching JSON
  • Writing Procedure to produce a final table to get counts of each forms field values of MIS Report
  • Producing the Final MIS Report
  • Future Improvement Issues

Conversion of json data to basic datatype table in PostgreSQL for growPlus

  • Analyzing existing table client, event and their json data column

  • Searching for process to convert json column to other format of data and study their implementation for example: json_each(json), jsonb_array_elements_text(jsonb), etc.

  • Study Materialized view.

  • Finally convert the data to table view so that can be directly loaded to visualize Charts form in GUI and sql deployments.

  • Show view data in GUI

Action data correction for anachronous submission

If any user sync data from Tab with late submission and by this time another schedule generated with another alert status in action table, some mismatch happened in data. To solve this, action data correction needed.

MCare Security ACL

  • Adding functionality for user role and permissions.

  • Password authentication for login

  • Password Encoding during registration and authentication

  • Registration: validation of fields, email verification, matching passwords, etc.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.