datausa / datausa-api Goto Github PK
View Code? Open in Web Editor NEWAPI for accessing US data sets
API for accessing US data sets
You guys are awesome with this stuffs! I just want to say that! I don't know how to talk to You guys, so I make an issue here, sorry ๐. I really inspired by Your work guys, so I intended to make one! I'm willing to present it to my country/land here in Lombok. So I just clone your repository for learning purpose such as how You collect data, how You structure them and so on, any way datausa-site (this one is really big so I may be will clone it tomorrow at my campus, my cell phone plan is really limited ๐ ). A little bit about me, I am bachelor student of Informatics Engineering at local campus in Mataram (we here call it TI an abbreviation for Teknik Informatika), I don't study much about data, yes we have one class of Statistics but not digging too much. So i hope You guys give me some advice in purpose of so my journey to study and provide this system to my country/land having less obstacles, didn't mean i don't want them, I love challenges/obstacles!. But, you know ๐, just a little bit advice maybe. I don't know if you guys can read my English, it's not our native or second language here. But, I hope You guys can understand what i wrote here intuitively ๐. Thank you guys in advance!
Not necessary for current University launch on old architecture, but once we switch over to new architecture we should look at ingesting this. It looks like they use OPE_ID from 1996 onward: https://ifap.ed.gov/DefaultManagement/press/
full/time part enrollment and enrollment by residence
Does this API have a way to filter through all 50 states by order of name or alphabet, delivering only one result per state?
The ability to filter university based on the Carnegie classification hierarchy
ACS PUMS 2015 scheduled to complete in January '16
Could you modify the readme so the portion about the API points to the 'about' section on the site and the wiki?
The examples at the bottom of the BLS page are broken:
https://github.com/DataUSA/datausa-api/wiki/BLS-API
Examples
http://api.datausa.io/api/?show=naics&sumlevel=all&naics=111&required=emp_2012_thousands
http://api.datausa.io/api/?show=soc&sumlevel=all&soc=110000&required=emp_2012_thousands
I'm getting geo attributes returned from this query,because it's not able to find "num_ppl_rca" in the yc table: https://sunbird-api.datausa.io/api/?show=cip&required=avg_wage,num_ppl_rca&sumlevel=all&year=latest
...how difficult is it to add rca values to that table?
@davelandry commented on Fri Apr 28 2017
All locations should have names.
There is a weird "05000US99999" location visible on the map when looking at data from the Dartmouth Atlas. @jspeis do you know what this is? Should we be filtering this out of the data calls?
https://sunbird.datausa.io/map/?level=county&key=total_medicare_enrollees
The top occupation in this chart has an id of 311000
, which when appearing as text links to this page: https://datausa.io/profile/soc/311000/ ... which gets a 404!
It seems that the id should be 311010
and link to this page? https://datausa.io/profile/soc/311010/
This is more of a feature request than a report of a bug.
I have been hugely impressed with your API as I think it could be very useful for social scientists like myself that often use census and economic data and are frustrated with the census site. I especially like that you can specify a variable and a geographic sumlevel, and the results will be returned at the desired unit of analysis. This is a big step forward!
I have created a short guide for constructing queries in R to make your API accessible to scholars:
https://gist.github.com/lecy/0aa782a873cd174573f32d243233ca5b
The hardest part of using this data is that the validity of arguments varies by the underlying data source. So in one instance I can use "show=geo&sumlevel=msa" and in another instance I cannot, which is confusing for users and it makes it frustrating to figure out if you can get data at the desired level.
To address this problem I have included a couple of helper functions in the guide to allow the user to peek at attributes, and to print the set of valid cases based upon the logic view at "http://api.datausa.io/api/logic/?".
For example, I have formatted the query "http://api.datausa.io/api/logic/?show=geo&sumlevel=all" to print a bunch of tables that look like this:
getUsage( "geo" )
# TABLE: ygi_num_emp
# DATA SOURCE: ACS 3-year Estimate
# DEPARTMENT: Census Bureau
# LINK: http://www.census.gov/programs-surveys/acs/
#
# SUPPORTED SUMLEVELS:
#
# acs_ind: 0, 1, 2, all
# geo: nation, state, msa, all
#
# ...67 more tables printed
The problem is that this use case searches by data attribute (show=geo) and references a data table (ygi_num_emp), but in the typical case the user would want to search for valid sumlevels associated with a specific variable. For example, can I find the number of philosophy majors by county?
Ideally there would be a way to specify an API query that submits a variable name and returns all valid attribute-sumlevel pairs (for example show=geo & sumlevel= nation, state, or msa).
It would be possible to create some functions to do this if the following queries are available:
Please let me know if these functions currently exist, or can possibly be added.
Kicking Horse!
The attr call: https://api.datausa.io/attrs/geo/16000US3040580/
Returns the state image_path, but it has a beautiful image: https://datausa.io/profile/geo/16000US3040580/
mainly, the "obesity_diabetes" chart is being removed, so we need to change/remove those from the search.
This column image_meta
needs to be added to the following tables, as well as being hooked up in the API and passed to the attribute calls:
It would be really great if when using the search API and a user types a variable only available in a Map page, that result appears inline with the profile links (ie. "Map of Children in Single-Parent Households").
The search API only returns profiles (and sections of profiles).
I'd like to use your location photos in a project I'm working on.
2015 acs 5 year will be released in december
First, thank you for the work you're doing! It truly is remarkable what you've accomplished.
I'm currently trying to run a query for the enrollments from the IPEDS dataset. However, it returns {"error": "No tables can match the specified query."}
This is the query I'm currently using:
https://api.datausa.io/api/?show=university&sumlevel=all&year=latest&required=enrolled_total
Any help would be greatly appreciated!
as seen in this API call:
...
"ipeds.gradspct_ycu": [null, 2015, 2014]
...
this is currently breaking the CIP profile pages. I can put a filter on the front-end to remove the null
values, but thought this might be a data bug as well
current name:
$48,001, - $75,000
should be:
$48,001 - $75,000
Update documentation for IPEDS operational & financial variables
Starting this github issue to serve as a central location for all new dataset ideas. These are the datasets that have been requested by the client for near-future inclusion on the site:
I'm attempting to get the percentage the population that is white (pop_white
) at the tract level for all tracts in a particular city. The following query returns an empty array of data:
https://api.datausa.io/api/?show=geo&sumlevel=tract&force=acs_5yr.yg_race&limit=5
However, the pop_white
data appears to be visible at the state level.
I'm able to get population data at the tract level (link), but tract level data appears to be unavailable.
Similar to the issue with leg amputations, we need change negative values to null
for certain Dartmouth variables. May be for more variables than this, but definitely for these (and I will continute to update this list if I find other variables):
https://api.datausa.io/api/join/?required=year,industry_iocode,commodity_iocode,value_millions,industry_level&show=geo&limit=500 this api caall gives an error. It says {"error": "No tables can match the specified query."}. Please help.
Hello - I'm trying to access the ACS data (such as this commute means info), but it doesn't appear to be available via the DataUSA API. I have tried to make requests using Python's requests library, but either get a 404 response or (after adding headers to the call) get a bunch of uninterpretable hex.
Is it possible to pull down this data using the API? This is one of the calls I tried:
requests.get("http://banana.datausa.io/api/data?measure=Average Commute Time&drilldowns=Place", headers=headers)
I also tried putting the parameters in a dictionary and passing them that way.
I am using python 3.6.9 and requests 2.23
allow users to search for variables such as obesity and diabetes.
from Ann Perrin:
Can you check on the Medicare hospital inpatient spending data - make sure it's added and labeled correctly. We plan to use it for a story and would like to start as soon as possible. Let me know if there are any issues and timing.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.