motherapp / weight-csv-to-gfit Goto Github PK

Load weights.csv and import to a Google Fit account

Python 100.00%

weight-csv-to-gfit's Introduction

google-fit-data

Load bulk weight/steps data to a Google Fit account

Download and installation

git clone https://github.com/ryanpconnors/google-fit-data.git
cd google-fit-data
virtualenv -p /usr/bin/python2.7 venv
pip install -r requirements.txt

Import weight data into Google Fit

python weight/import_weight_to_gfit.py

Import steps data into Google Fit

python steps/import_steps_to_gfit.py

weight-csv-to-gfit's People

Contributors

Stargazers

Watchers

Forkers

bluebirch erikw jayesh100 davidkachan ryanpconnors dtrwos tadwohlrapp michlive2 lavinavrovine debarros

weight-csv-to-gfit's Issues

"Unable to fetch DataSource for Dataset:"

Hello,

I've been trying to make this code work again, but my very limited knowledge only got me so far.
By very limited I mean that this is the first time I am interacting with python.

However I managed to fix the oAuth mechanism and some minor issues I had with the code. But I eventually end up in an error, when trying to patch my data into my gfit account.

googleapiclient.errors.HttpError: <HttpError 400 when requesting https://www.googleapis.com/fitness/v1/users/me/dataSources/raw%3Acom.google.weight%3A35873072968%3Aunknown%3Aunknown%3Amaweightimport/datasets/1524024000000000000-1504843200000000000?alt=json&key=AIzaSyA5KxFyd7TlntBDbuags-F4miQo402OG5c returned "Unable to fetch DataSource for Dataset: raw:com.google.weight:35873072968:unknown:unknown:maweightimport">

This is where the error occurs:

    fitness_service.users().dataSources().datasets().patch(
      userId='me',
      dataSourceId=data_source_id,
      datasetId=dataset_id,
      body=dict(
	    minStartTimeNs=min_log_ns,
        maxEndTimeNs=max_log_ns,
        dataSourceId=data_source_id,
        point=weights,
      )).execute()

My current version of the code looks like this (please excuse the excessive amount of prints and commented code. I am a horrible coder):

# -------------------------------------------------------------------------------
# Purpose: Load weights.csv and import to a Google Fit account
# Some codes refer to:
# 1. https://github.com/tantalor/fitsync
# 2. http://www.ewhitling.com/2015/04/28/scrapping-data-from-google-fitness/
import json
import httplib2
import sys
from apiclient.discovery import build
 
from oauth2client.file import Storage
from oauth2client.client import OAuth2WebServerFlow
from oauth2client.tools import run_flow, argparser
from oauth2client.client import AccessTokenRefreshError
from read_weight_csv import read_weights_csv_with_gfit_format
from googleapiclient.errors import HttpError



client_id = '35873072968-gtq30smu2bdnais7qsfs0ccsrb7a8oro.apps.googleusercontent.com'
client_secret = 'K4OuT-VlEtBP4Wd9Y68r9zdF'
scope = 'https://www.googleapis.com/auth/fitness.body.write'



# Setup for Google API:
# Steps: 
# 1. Go https://console.developers.google.com/apis/credentials
# 2. Create credentials => OAuth Client ID
# 3. Set Redirect URI to your URL or the playground https://developers.google.com/oauthplayground
#client_id = '35873072968-gtq30smu2bdnais7qsfs0ccsrb7a8oro.apps.googleusercontent.com'
#CLIENT_SECRET = 'K4OuT-VlEtBP4Wd9Y68r9zdF'
 
# Redirect URI to google Fit, See Steps 3 above
#REDIRECT_URI='https://developers.google.com/oauthplayground'

# See scope here: https://developers.google.com/fit/rest/v1/authorization
#SCOPE = 'https://www.googleapis.com/auth/fitness.body.write'

# API Key
# Steps: 
# 1. Go https://console.developers.google.com/apis/credentials
# 2. Create credentials => API Key => Server Key
API_KEY = 'AIzaSyA5KxFyd7TlntBDbuags-F4miQo402OG5c'

def import_weight_to_gfit():
    # first step of auth
    # only approved IP is my Digital Ocean Server
    flow = OAuth2WebServerFlow(client_id, client_secret, scope)
    storage = Storage('google.json')
    flags = argparser.parse_args([])
    creds = run_flow(flow, storage)
    print "access_token: %s" % creds.access_token
    #run_flow(flow, storage, flags)
    #flow = OAuth2WebServerFlow(client_id=client_id, client_secret=CLIENT_SECRET, scope=SCOPE, redirect_uri=REDIRECT_URI)
    #auth_uri = flow.step1_get_authorize_url()
    #print "Copy this url to web browser for authorization: "
    #print auth_uri

    # hmm, had to manually pull this as part of a Google Security measure. 
    # there must be a way to programatically get this, but this exercise doesn't need it ... yet...
    #token = raw_input("Copy the token from URL and input here: ")
    #cred = flow.step2_exchange(creds.access_token)
    http = httplib2.Http()
    http = creds.authorize(http)
    fitness_service = build('fitness','v1', http=http, developerKey=API_KEY)

    # init the fitness objects
    fitusr = fitness_service.users()
    print "fitnessuser: %s" % fitusr
    fitdatasrc = fitusr.dataSources()
    print "Building the fitness thingies"
    data_source = dict(
        type='raw',
        application=dict(name='maweightimport'),
        dataType=dict(
          name='com.google.weight',
          field=[dict(format='floatPoint', name='weight')]
        ),
        device=dict(
          type='scale',
          manufacturer='unknown',
          model='unknown',
          uid='maweightimport',
          version='1.0',
        )
      )
    print "Getting data sources id"
    def get_data_source_id(dataSource):
      project_number = client_id.split('-')[0]
      return ':'.join((
        dataSource['type'],
        dataSource['dataType']['name'],
        project_number,
        dataSource['device']['manufacturer'],
        dataSource['device']['model'],
        dataSource['device']['uid']))

    print "found data source id: %s" % get_data_source_id(data_source)
    data_source_id = get_data_source_id(data_source)
    # Ensure datasource exists for the device.

			
    print "reading in weights"
    weights = read_weights_csv_with_gfit_format()
    min_log_ns = weights[0]["startTimeNanos"]
    max_log_ns = weights[-1]["startTimeNanos"]
    dataset_id = '%s-%s' % (min_log_ns, max_log_ns)
    print "found data source id: %s" % dataset_id
    # patch data to google fit
    print "test1"
    fitness_service.users().dataSources().datasets().patch(
      userId='me',
      dataSourceId=data_source_id,
      datasetId=dataset_id,
      body=dict(
	    minStartTimeNs=min_log_ns,
        maxEndTimeNs=max_log_ns,
        dataSourceId=data_source_id,
        point=weights,
      )).execute()
    print "test"
    # read data to verify
    print fitness_service.users().dataSources().datasets().get(
        userId='me',
        dataSourceId=data_source_id,
        datasetId=dataset_id).execute()

if __name__=="__main__":
    import_weight_to_gfit()

Link to ewhitling.com broken

import_weight_to_gfit.py says:

# Some codes refer to:
# 1. https://github.com/tantalor/fitsync
# 2. http://www.ewhitling.com/2015/04/28/scrapping-data-from-google-fitness/

The second link no longer exists. I suggest you use https://web.archive.org/web/20160428144922/http://www.ewhitling.com/2015/04/28/scrapping-data-from-google-fitness/

Which weight unit is expected in CSV

I want to import the past 4 years from Libra to Google Fit. I've checked the example csv file, and because the values are about "180" I'm not sure if this is kilograms or pounds.

Before I'll import wrong data I wanted to ask :)
Thanks!

after copying the tocken I get this error : httplib2.SSLHandshakeError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727)

Hi,

after copying the token from the url I get this error :

Traceback (most recent call last):
File "weight/import_weight_to_gfit.py", line 128, in
import_weight_to_gfit()
File "weight/import_weight_to_gfit.py", line 51, in import_weight_to_gfit
cred = flow.step2_exchange(token)
File "/home/madwols/.local/lib/python2.7/site-packages/oauth2client/util.py", line 135, in positional_wrapper
return wrapped(*args, **kwargs)
File "/home/madwols/.local/lib/python2.7/site-packages/oauth2client/client.py", line 2117, in step2_exchange
headers=headers)
File "/home/madwols/.local/lib/python2.7/site-packages/httplib2/init.py", line 1609, in request
(response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
File "/home/madwols/.local/lib/python2.7/site-packages/httplib2/init.py", line 1351, in _request
(response, content) = self._conn_request(conn, request_uri, method, body, headers)
File "/home/madwols/.local/lib/python2.7/site-packages/httplib2/init.py", line 1272, in _conn_request
conn.connect()
File "/home/madwols/.local/lib/python2.7/site-packages/httplib2/init.py", line 1059, in connect
raise SSLHandshakeError(e)
httplib2.SSLHandshakeError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:727)

Do I didn't copy the token properly !?
it so please help me figure out which part of the url should I copy ?

Thank you

IndexError: list index out of range

Hi, thank you for the code. Appreciated! I think this is the only way to import Libra CSV at the moment. However, I am trying to import a sample CSV to get the code working. Everything works out until this error appears:

Reading Weights
Traceback (most recent call last):
File "import_weight_to_gfit.py", line 118, in
import_weight_to_gfit()
File "import_weight_to_gfit.py", line 95, in import_weight_to_gfit
min_log_ns = weights[0]["startTimeNanos"]
IndexError: list index out of range

I believe this is due to the CSV format? I am trying to import following CSV content:

2018-08-20 08:48:00;82.9;81.7294;;;

Initially I removed all lines with # symbols (headers) from the file. Timezone is set to "Europe/Zurich" in read_weight_csv.py

How can I fix this issue? Any ideas?

Best wishes,
Alex

HttpError 400 and 409 when running import script for weight

Trying to run the script.. but getting some errors I don't get.

Received following running script for first time:

got weights...
Traceback (most recent call last):
  File "import_weight_to_gfit.py", line 128, in <module>
    import_weight_to_gfit()
  File "import_weight_to_gfit.py", line 118, in import_weight_to_gfit
    point=weights,
  File "/usr/lib/python2.7/site-packages/googleapiclient/_helpers.py", line 134, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/googleapiclient/http.py", line 915, in execute
    raise HttpError(resp, content, uri=self.uri)
googleapiclient.errors.HttpError: <HttpError 400 when requesting https://fitness.googleapis.com/fitness/v1/users/me/dataSources/raw%3Acom.google.weight%3AAAA%3Awithings%3Asmart-body-MASKEDURLBLABLA returned "Unable to fetch DataSource for Dataset: raw:com.google.weight:ABC:DEF:GHI:JKL". Details: "Unable to fetch DataSource for Dataset: raw:com.google.weight:ABC:DEF:GHI:JKL">

Running script for second or more time:

  File "import_weight_to_gfit.py", line 128, in <module>
    import_weight_to_gfit()
  File "import_weight_to_gfit.py", line 101, in import_weight_to_gfit
    body=data_source).execute()
  File "/usr/lib/python2.7/site-packages/googleapiclient/_helpers.py", line 134, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/googleapiclient/http.py", line 915, in execute
    raise HttpError(resp, content, uri=self.uri)
googleapiclient.errors.HttpError: <HttpError 409 when requesting https://fitness.googleapis.com/fitness/v1/users/me/dataSources?alt=json&key=XXXXXX  returned "Data Source: raw:com.google.weight:ABC:DEF:GHI:JKL already exists". Details: "Data Source: raw:com.google.weight:ABC:DEF:GHI:JKL already exists">

First time I did run it, everythings seems fine.. but Google Fit does not display any weights in Google Fit app.
So not sure weither the data was correct imported.

SyntaxError: Missing parentheses in call to 'print'. Did you mean print("Setuptools version",version,"or greater has been installed.")?

----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in C:\Users\SUMIT~1.CHA\AppData\Local\Temp\pip-install-7uq6ucnp\wsgiref
You are using pip version 19.0.1, however version 19.1.1 is available.
You should consider upgrading via the 'python -m pip install --upgrade pip' command.