- Template Bucket.
- Google Cloud Staging Bucket.
- Apple Health Bucket.
Deploy function that listens to new objects in bucket
$ gcloud functions deploy launchAppleHealthDataflowJob \
--stage-bucket fabio-architecture-1-gcf \
--trigger-bucket fabio-architecture-1-apple-health
- Build and upload the template.
- Upload the template metadata.
- Create a dataset called
fitness_data
- Import CSV for CDC recommendations into BigQuery
cd bigquery
npm install
npm start interview-architecture-1 fitness_data cdc_calorie_needs ./cdc_calorie_needs_lookup.csv
npm start interview-architecture-1 fitness_data cdc_sleep_hours ./cdc_sleep_hours_lookup.csv
- Open the google cloud function and start streaming logs.
- Open Dataflow and watch for a new job being created.
- Upload data to apple health bucket.
- Open Cloud Functions, click on logs, and click on Play button to see logs being streamed.
- Open dataflow and see job running.
- Open BigQuery and see data being populated.
- Open Datalab and start querying data.