Code Monkey home page Code Monkey logo

datathink_2023's Introduction

Urban sensing and data integration at Datathink 2023

Created by Javier Argota Sánchez-Vaquerizo
[email protected]

Computational Social Science (COSS) at ETH Zürich

27-Feb-2023 for Datathink 2023.

Repository for workshop on days 1 and 2.

Basic description

The repository contains some examples of urban sensing from different sources to illustrate data integration and data fusion approaches and limitations.

This data integration pipeline results in data ready to be visualized on Kepler.gl as part of the stack of data collected during Datathink 2023 in Rome.

The collected data consists of measurements of:

  • Air quality (temperature, humidity, PM1, PM2.5 and PM10) with the Co-Sense unit.
  • Location data collected with activity trackers and smartphones using the GeoTracker app.
  • Radio-frequency (RF), electro-magnetic field (EMF), and electric field (EF) intensity captured with the GQ EMF-390 multimeter.

Usage

In each folder:

  • Examples of the mentioned data sources are included, with a notebook (.ipynb file) for the data processing and creation of a new integrated csv file.

  • This csv file can be imported in Kepler.gl for visualization purposes.

  • Finally, the map can be exported in json and html format.

Folder test_roma_20230228 contains the most complete version of the pipeline with the data collected by participants in Datathink.

Two possible usages:

a.

b.

  • Open Google Colab.
  • Open new notebook and link to this repo: https://github.com/Reivajar/datathink_2023.git
  • Open the appropriate notebook. For the Rome version, open data_fusion_v4.ipynb.
  • Download the csv generated files to your local machine directly from Colab files manager (panel on the left side of the browser).

map Kepler

Acknowledgments

The Co-Sense unit and the associated software has been designed by Dr. Sachit Mahajan ([email protected]) at the Chair Computation Social Science as part of the Co-Evolving City Project (CoCi) which has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 re- search and innovation programme under grant agreement No. 833168. Javier Argota Sánchez-Vaquerizo's research is as well supported by CoCi (ERC grant).

CoCi ERC logo

Datathink is a graduate seminar on space and digitazion organized by organized by the UNESCO Chair in Urban Landscape at Université de Montréal in collaboration with Digital Visual Studies at Universität Zürich, and the Max-Planck Society and Biblioteca Hertziana in Rome.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.