visitdata-org / ca_visit_tracking Goto Github PK

Foursquare has given us whole-state data alongside individual County data.
Make it available in the visitdata.org UI

I am trying to figure out how much non-deployed stuff is in github and I have no idea which version I deployed.

Maybe put the github hash of the latest commit on the site somewhere or even hidden in the HTML of the template?

right now there are three independent ways to look at the data:

• https://visitdata.org/
• https://visitdata.org/bydate.html
• https://visitdata.org/bydate.html?datafilename=rawcatsfixed

And no way to navigate between them.

ca.js and ca_bydate.js have some duplicated code which opens up possibility for error when changing things.

for example i am changing some of how we read in the data right now, which is in both.

https://datastudio.google.com/u/0/reporting/1hV7FGnBPuTeDrZ0BBsaZjimLjYt7X792/page/J0GKB

it says all ages but its >65 right?
the last one.

there's no indicator aside from the URL itself to know what state you're in.
literally.

Need to set up Google Cloud Build

for either @dsjoerg or @ajanian

So it's easier to see which page you're on.

i've done this before in highcharts

in regular USA format with day of week

Probably sorted by date, with most recent on top.
And then for the current date, sorted by index descending.
So the top row would be for the most recent date, and the item with the highest index.

Provision a Google Maps API key in a way that we don't need to commit it the the source repo and so that nobody else can steal it and use it on their site.

Idea from Michele. So that we don't get fooled by drops that are weather related.
So, grab weather data for county somehow, and shade chart regions when it's rainy in that county.

If this is going to be in the hands of a few hundred county health officers, they're going to have questions & need a way to reach someone.
Let's have an email address they can reach out to, and have it forward to a list of email addresses.

@markroth8 is this something you can do in the Google Domain console?

Whats a good way to handle daily data updates.
Does one of us just manually move the CSV into place, and do a git push / deploy?

If we can give Foursquare a way to update the data themselves that would be ideal?
Or is manual better so that we can do some data format & sanity check before throwing it up there?

It's our top 404 :)

My brother looked at the data and asked "How is nightlife spot defined?"

A way to toggle "delect/select all counties" (to save clicking ~58 times on some of the venue graphs)

CA wants it

What is it, who should do it?
I know how to update the data files in github but not how to update GDS

It's OK for GDS to be California only for now.
We have data through Mar 31 now in the site, but only up to Mar 30 in GDS.

New checkbox: "Don't show essential places"
By default unchecked.
When checked, the JS doesn't show series that our data has as Essential.
So we show the top N venue types that are not known to be Essential.

https://visitdata.org/bydatesel/Massachusetts/Norfolk%20County/Grocery

it's SHOWTIME

When showing the table, there's no point in showing visitIndex* values that are blank.
Exclude them from the table display.
They are values where we didn't have enough visits to have a confident-enough estimate of the visit Index.

from david shim

https://visitdata.org/bystatesel/Alabama/Restaurants?datafilename=raw
says no data to display
same with https://visitdata.org/bydatesel/Alabama/ALL/Restaurants?datafilename=raw

and yet
$ grep -i ',Restaurants,' static/data/raw.csv | grep Alabama | head 2020-03-01,Alabama,4bf58dd8d48988d1c4941735,Restaurants,112.0,109.0,113.0,41 2020-03-02,Alabama,4bf58dd8d48988d1c4941735,Restaurants,108.0,82.0,110.0,51 2020-03-03,Alabama,4bf58dd8d48988d1c4941735,Restaurants,115.0,113.0,115.0,47 2020-03-04,Alabama,4bf58dd8d48988d1c4941735,Restaurants,101.0,103.0,101.0,50 2020-03-05,Alabama,4bf58dd8d48988d1c4941735,Restaurants,108.0,95.0,108.0,48 2020-03-06,Alabama,4bf58dd8d48988d1c4941735,Restaurants,103.0,83.0,104.0,50 2020-03-07,Alabama,4bf58dd8d48988d1c4941735,Restaurants,108.0,132.0,108.0,44 2020-03-08,Alabama,4bf58dd8d48988d1c4941735,Restaurants,113.0,121.0,113.0,39 2020-03-09,Alabama,4bf58dd8d48988d1c4941735,Restaurants,122.0,102.0,123.0,49 2020-03-10,Alabama,4bf58dd8d48988d1c4941735,Restaurants,100.0,89.0,101.0,52

and

grep -i ',Restaurants,' static/data/rawAlabama.csv | head 2020-03-02,Alabama,Jefferson County,4bf58dd8d48988d1c4941735,Restaurants,160.0,"",162.0,39 2020-03-03,Alabama,Jefferson County,4bf58dd8d48988d1c4941735,Restaurants,127.0,"",126.0,54 2020-03-04,Alabama,Madison County,4bf58dd8d48988d1c4941735,Restaurants,119.0,"",118.0,32 2020-03-05,Alabama,Jefferson County,4bf58dd8d48988d1c4941735,Restaurants,108.0,"",109.0,53 2020-03-06,Alabama,Jefferson County,4bf58dd8d48988d1c4941735,Restaurants,108.0,"",109.0,53 2020-03-07,Alabama,Jefferson County,4bf58dd8d48988d1c4941735,Restaurants,130.0,"",130.0,46 2020-03-07,Alabama,Madison County,4bf58dd8d48988d1c4941735,Restaurants,97.0,"",96.0,28 2020-03-09,Alabama,Jefferson County,4bf58dd8d48988d1c4941735,Restaurants,148.0,"",147.0,49 2020-03-12,Alabama,Jefferson County,4bf58dd8d48988d1c4941735,Restaurants,111.0,"",109.0,52 2020-03-13,Alabama,Madison County,4bf58dd8d48988d1c4941735,Restaurants,104.0,"",105.0,34

What am I missing?

the GDS equivalent of #59

This is probably doable in Highcharts with series.setData().

https://stackoverflow.com/questions/21152885/changing-data-dynamically-for-a-series-in-highcharts

with a reference for how to contact us.
this is in case someone types in a bad URL

Parallel to #62

Example: CA / Kings County on 2020-03-23 for Age 65+, Grocery is 0 because it is missing in the file.

Reported by @dsjoerg

for Matt Jacobus. can't assign him yet for some reason, ugh

Soon Foursquare will give us NY data.
Do we want visitdata.org to have a state selector?
and if you go to visitdata.org/ny then there's no state selector, or it's pre-populated?

For example if you pick a county, and then pick "65 and over", it should re-sort so that the highest visitation index data is on top. That's what you care about, where are the elders going.

County, Venue, age group