Code Monkey home page Code Monkey logo

pycontw-analyzer's Introduction

pycontw-analyzer

pycontw-inalyzer is an integrated analyzer that can extract various types of raw data (e.g. attendee, programs, checkins), and inspect some valuable information via customized strategies construct by each team with their different domain knowledge.

Getting Started

Prerequisites

  • Python 3.8

Obtain data

Analyzer will use mock_data with directory ./mock_data/ by default, you can refresh it via run pipenv run python analyzer/utils/mock_data.py. For real data, please contact conributors listed below.

Run Analyzer

An example program analyzer/app.py would be a great choice for the first try, run it by

pipenv run python analyzer/app.py

Configuration

You can set up configs in analyzer/config.py easily, please refer to the code for advanced instructions.

Development

Architecture

pycontw-inspector currently construct by four layers:

  • extractor: extract raw data from file.
  • provider: collect data form all extractor and provide more explainable data for inspecting.
  • inspector: inspect valuable information via implementing strategies.
  • visualizer: visualize the results data.

Default Raw Data File Tree

data
├── attendee
│   ├── discount_2019.csv
│   ├── reserved_2019.csv
│   └── standard_2019.csv
├── programs
│   └── program_2019.csv
├── proposals
│   └── sql_dump
│       ├── talk.sql
│       └── tutorial.sql
└── vacancies
    ├── cake_resume.csv
    └── linked_in.csv

Execute Task

invoke is used for the tasks management, some available tasks list below:

For Environment

  • inv env.clean
  • inv env.init

For Style

  • inv style.pylint
  • inv style.flake8
  • inv style.blackcheck

For Test

  • inv test.pytest

Contributors

pycontw-analyzer's People

Contributors

rainrainwu avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.