search

koopjs / koop-acs

American Community Survey provider for Koop (experimental).
3 stars 2 forks source link

Koop should handle more than a few attributes at a time #1

Open courtneycl opened 9 years ago

courtneycl commented 9 years ago

The adaptor can process up to 7 variables successfully, eg: http://koop.dc.esri.com/acs/2013/state/*/county/*/NAME,B21005_003E,B21005_003M,B21005_004E,B21005_004M,B21005_005E,B21005_005M/FeatureServer/0/

We get a 504 error when attempting to grab 11 by county: http://koop.dc.esri.com/acs/2013/state/*/county/*/NAME,B21005_003E,B21005_003M,B21005_004E,B21005_004M,B21005_005E,B21005_005M,B21005_006E,B21005_006M,B21005_007E,B21005_007M/FeatureServer/0/

If we go by state only it succeeds: http://koop.dc.esri.com/acs/2013/state/*/NAME,B21005_003E,B21005_003M,B21005_004E,B21005_004M,B21005_005E,B21005_005M,B21005_006E,B21005_006M,B21005_007E,B21005_007M/FeatureServer/0/

If we can get it to process 25 variables by county that would be fantastic! Is that too much?

NAME is indeed a valid variable... XML of variables, if it helps: http://api.census.gov/data/2013/acs5/variables.xml

@chelm @dmfenton

chelm commented 9 years ago

So I think the issues here is just the size. It was a concern of mine when I wrote this. We should really try to not request nation wide datasets. Which is not the most pratical thing for me to say.

It does work at the state level: http://koop.dc.esri.com/acs/2013/state/08/county/*/NAME,B21005_003E,B21005_003M,B21005_004E,B21005_004M,B21005_005E,B21005_005M,B21005_006E,B21005_006M,B21005_007E,B21005_007M/FeatureServer/0

but the number of attribute (11 in this case) times the number of counties (~3k and the higher res counties we added) are probably just too much. I'll look at koop and see if see anyhole where this might be fixed.

courtneycl commented 9 years ago

Cool - this isn't very pressing, but it would be nice to get more data in the future. I got some data for just California for the time being.

ajturner commented 9 years ago

@chelm so is the underlying issue that the ACS API requires you to request a specific geography and does not permit you to request ALL data. Therefore you would need to walk over the 51+ state geographies in Koop to provide a nationwide, single dataset.

ajturner commented 9 years ago

Every query must include a geography, and this API supports both FIPS and GNIS geography codes.

meaning that it only does Lookup queries and not true geographic queries