Code Monkey home page Code Monkey logo

usc-infolab / w4h-importhub Goto Github PK

View Code? Open in Web Editor NEW
0.0 2.0 0.0 15.43 MB

๐ŸŒ‰ W4H ImportHub - An intuitive tool designed to effortlessly bridge the gap between your offline datasets and the W4H platform. From seamless CSV integration to smart data mappings, step into the expansive world of W4H with ease.

Home Page: https://usc-infolab.github.io/W4H-ImportHub/

License: MIT License

Python 100.00%
configurable customizable data-import data-mapping database-tools streamlit time-series toolkit w4h csv-integration

w4h-importhub's Introduction

W4H ImportHub: Effortlessly Bridging Your Data to the W4H Ecosystem

W4H ImportHub is designed to integrate offline datasets, like CSV files, into the W4H platform, aligning with the GeoMTS schema and data structures. It aids in the smooth import of data while offering automatic attribute mapping to ensure data consistency and integration with the structure and standards of the W4H platform.

Table of Contents

Documentation

Dive deep into the heart of W4H ImportHub and understand its nuances by visiting the W4H ImportHub Documentation.

Features

  • One-Click W4H Database Instance Creation: Dive into the world of W4H with unparalleled ease. With just a simple click, W4H ImportHub unfurls a complete W4H instance in your database. Give it a name, click, and watch the magic unfold.

  • Drag, Drop, & Integrate CSV Effortlessly: Streamline your data migration journey with our effortless CSV integration. Drag and drop your file, harness our intuitive mapping suggestions, or curate your own โ€“ and swiftly funnel your data into the W4H platform.

  • Intuitive Mapping Dashboard: Our interface doesn't just allow you to define mappings between your data columns and W4H tables; it thinks alongside you, suggesting mappings grounded in intelligent recognition patterns.

  • Configurable DNA: W4H ImportHub is crafted with a flexible DNA. Tailor it, tweak its settings, define what tables to involve, and let it resonate with your specific W4H blueprint. Especially robust for those navigating the waters of time-series data, this feature ensures you wield a tool attuned to your every need.

Prerequisites

Before you embark on your journey with W4H ImportHub, please ensure:

  • Python 3.x is your trusted companion.
  • Essential dependencies are in your toolkit (Check the Installation).

Installation

  1. Clone the repository:

    git clone https://github.com/USC-InfoLab/W4H-ImportHub.git
  2. Install the required dependencies:

    cd W4H-ImportHub
    pip install -r requirements.txt

Usage

  1. Setup Configuration: Before diving into the import process, ensure your environment is set up correctly (see Installation). Copy the config.yaml.example to config.yaml. Within this configuration file, input your database connection details. You can either leverage our default recommended platform configuration or customize it to better match your specific requirements.

  2. Launch the Streamlit app: Run the W4H ImportHub Streamlit dashboard:

    streamlit run import_hub_main.py

This will provide an address which you can use to access the UI in your web browser.

  1. Database Instance Decision: Once on the UI, you'll have the option to either populate an existing W4H database instance or initiate a new one.

  2. CSV Integration: Upload the CSV file you intend to incorporate into the W4H platform.

  3. Mapping Configuration: After finishing the upload, the tool will intelligently suggest a default mapping grounded in the similarity between the CSV column names and the W4H table names. At this stage, review and, if needed, adjust the mapping using the intuitive UI dashboard.

  4. Populate the W4H Database: With the mapping set, confirm the import process. The tool will then swing into action, meticulously populating the W4H database according to your directives.

By following these steps, you can easily bridge the gap between your offline datasets and the expansive world of the W4H platform.

Contributing

Contributions are welcome! If you have any suggestions, bug reports, or feature requests, please open an issue or submit a pull request.

License

This project is licensed under the MIT License. Please keep in mind while the code can be modified and used freely, it's essential to acknowledge or credit the original project if used or referenced in a public domain or another project.

w4h-importhub's People

Contributors

arashhs avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.