Code Monkey home page Code Monkey logo

bikeserverprocessador's Introduction

ETL API made in python

Summary

This API was developed with educational criteria. Basically it is an api that contains essentially 3 routines

  • Read and process a csv file and write to the database
  • Generate a report of the imported data
  • Erase the data if you want to re-import

Database

The api has a connection class and database access functions, the database used was a mysql database, this class has the routines:

  • Database generation, a routine that generates the structure of the database based on the spreadsheets that follow in the example folders, that is, the database was previously developed with the spreadsheets in mind
def Create():
  • Generic recording and reading routine
def Set(command, _conn=None):
def Get(command, _conn=None):
  • Connection function to be reused in functions that have list routines
def GetConnector():
  • Block function (deprecated)
def SetBlock(_list, _conn=None):

Report

Basically the API builds a simple report in html based on a simple sql script

Processing

The Processing Routine basically when reading the data puts them in a class that analyzes the data according to the pre-understanding of the table fields. The recording is done in blocks, where they are defined according to the table type, these insertion blocks only record and do not duplicate or change the data, that is why there is a data deletion button, since it is a routine simple

Demo

Using Local

With docker you can launch the project on your local machine. Just run the following command inside the project:

docker compose up

bikeserverprocessador's People

Contributors

danilosoftwares avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.