Code Monkey home page Code Monkey logo

atlas's Introduction

Atlas

Atlas

Atlas lets you explore your Apple Health data.


PyPI Tests Changelog License

Installation

Install Atlas using pip:

pip install atlas-db

Upgrade Atlas using pip:

pip install atlas-db --upgrade

Uninstall Expanse (old name) using pipx:

pipx uninstall expanse

Explore

Note

Here is a Quarto notebook with example code and SQL queries.

The notebook uses Vega-Altair and Clickhouse (chDB) to explore Apple Health time series data in a .parquet file. The .parquet file was generated by Atlas from an Apple Health export.xml file. vega-altair charts

First we create the .parquet file from the export.xml file.

atlas parquet export.xml -o ah.parquet

We can explore the data in many ways.

It is just a table/dataframe/parquet file with 5 columns.

But here we'll use clickhouse local:

clickhouse local

Let's take a look at the table.

DESCRIBE TABLE `ah.parquet`
┌─name────┬─type────────────────────┬─default_type─┬─default_expression─┬─comment─┬─codec_expression─┬─ttl_expression─┐
│ type    │ Nullable(String)        │              │                    │         │                  │                │
│ start   │ Nullable(DateTime64(6)) │              │                    │         │                  │                │
│ end     │ Nullable(DateTime64(6)) │              │                    │         │                  │                │
│ created │ Nullable(DateTime64(6)) │              │                    │         │                  │                │
│ value   │ Nullable(String)        │              │                    │         │                  │                │
└─────────┴─────────────────────────┴──────────────┴────────────────────┴─────────┴──────────────────┴────────────────┘

What kind of "types" do we have and how many?

SELECT
    type,
    COUNT(*) AS count
FROM `ah.parquet`
GROUP BY type
ORDER BY count DESC
┌─type───────────────────────────┬──count─┐
│ ActiveEnergyBurned             │ 879902 │
│ HeartRate                      │ 451854 │
│ BasalEnergyBurned              │ 289031 │
│ DistanceWalkingRunning         │ 260500 │
│ StepCount                      │ 217384 │
│ PhysicalEffort                 │  69747 │
│ AppleExerciseTime              │  61363 │
│ AppleStandTime                 │  58309 │
│ EnvironmentalAudioExposure     │  44535 │
│ SleepAnalysis                  │  36599 │
│ WalkingStepLength              │  28281 │
│ WalkingSpeed                   │  28281 │
│ RespiratoryRate                │  27829 │
│ AppleStandHour                 │  25877 │
│ FlightsClimbed                 │  22690 │
│ WalkingDoubleSupportPercentage │  21900 │
│ WalkingAsymmetryPercentage     │  13820 │
│ HeartRateVariabilitySDNN       │  11961 │
│ OxygenSaturation               │   4912 │
│ StairDescentSpeed              │   4718 │
│ StairAscentSpeed               │   4249 │
│ DistanceCycling                │   2890 │
│ TimeInDaylight                 │   2403 │
│ HeadphoneAudioExposure         │   2323 │
│ RestingHeartRate               │   1399 │
│ WalkingHeartRateAverage        │   1176 │
│ DistanceSwimming               │    455 │
│ SwimmingStrokeCount            │    455 │
│ AppleSleepingWristTemperature  │    442 │
│ RunningSpeed                   │    391 │
│ VO2Max                         │    366 │
│ RunningPower                   │    173 │
│ DietaryCaffeine                │    171 │
│ AppleWalkingSteadiness         │    138 │
│ SixMinuteWalkTestDistance      │    122 │
│ HeartRateRecoveryOneMinute     │     76 │
│ RunningVerticalOscillation     │     74 │
│ RunningGroundContactTime       │     67 │
│ RunningStrideLength            │     54 │
│ MindfulSession                 │     34 │
│ HighHeartRateEvent             │     18 │
│ AudioExposureEvent             │     14 │
│ BodyMass                       │     14 │
│ Height                         │      5 │
│ Fatigue                        │      1 │
│ HKDataTypeSleepDurationGoal    │      1 │
└────────────────────────────────┴────────┘

What's our total step count?

Note

The value column is type Nullable(String) so we have to cast toFloat64 to sum up the step values.

SELECT sum(toFloat64(value))
FROM `ah.parquet`
WHERE type = 'StepCount'
┌─sum(toFloat64(value))─┐
│              30295811 │
└───────────────────────┘

30.295.811 (30.29 million) steps. That's a lot of steps!

How to get the Apple Health export.xml file

group-figma-small

  • open the Apple Health app on iOS
  • tap on your profile picture (or initials) at the top right
  • tap on Export All Health Data
  • tap on Export
  • wait a few seconds to a few minutes (~3min for 10 years of data)
  • get the export.zip archive via Airdrop to a Mac (or save to Files)

Note

The export.xml file is in the export.zip archive.

You can expand the export.zip file by double-clicking on it.

This creates a directory named apple_health_export and in it is the export.xml file.

See: Apple Support on how to export Apple Health and Fitness in XML format

Usage

atlas parquet export.xml

Features

  • turn export.xml into a simple parquet file

atlas's People

Contributors

tosh avatar

Stargazers

Ivan Parfilov avatar Skale.io Developer Account avatar Shi Hao avatar Emilia avatar Bernardo C.D.A. Vasconcelos avatar Benjamin Rodde avatar Ryan Orban avatar  avatar Eugene Klimov avatar 陈敏华 avatar Will Benton avatar Kelli Pape avatar  avatar  avatar Sakti Dwi Cahyono avatar  avatar  avatar  avatar Brian Field avatar zdrr avatar Sudara avatar Felipe Menegazzi avatar Miguel Eduardo Gil Biraud avatar Nathan Glover avatar Philipp Haussleiter avatar Jair F Ochoa Davila avatar  avatar Jordan P.R. avatar Dmytro Piliugin avatar Martin Contento avatar  avatar Akshay Ram Vignesh avatar  avatar Tobi avatar  avatar Onuralp SEZER avatar Timar avatar  avatar surya dantuluri avatar Paul avatar Gonçalo Mendes Cabrita avatar Nick Gerovac avatar  avatar Atul Butte avatar Neil Pullman avatar Will Dent avatar Uday avatar Maolin Li avatar Ian Jenkins avatar Christian Rotzoll avatar Colin  Gillingham avatar Steven Syp avatar Wilson Silva avatar Stan avatar ervinismu avatar  avatar Vincent avatar Nima Karimi avatar Juan Carlos Garza Rdz avatar Facundo Muñoz avatar Tobias Lütke avatar Satyam Tiwary avatar Benjamin Doherty avatar Andrey Bukati avatar Cal Paterson avatar  avatar Olivier Dobberkau avatar Airy André avatar  avatar Claas Lange avatar Peter Norris avatar Don Coleman avatar Pierluigi D'Andrea avatar Ivan Parfenchuk avatar Sean Stevens avatar Jaume Corbi avatar Hugo Alves avatar Morgan avatar  avatar Luke Kim avatar Pavel Klymenko avatar Ryan Snowden avatar Darlin Alberto avatar  avatar Lucian avatar Juan Montalvo Bressi avatar Steven Briscoe avatar  avatar  avatar Markus Zimmermann avatar Charlie Holtz avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.