The Hack For LA Data Science team is a Community of Practice within the LA brigade seeking to make analytical and machine learning services available to local communities and organizations.
Fixed Pagination issue. Works fine with smaller datasets, need to set up map/reduce to improve speed.
The way I fixed it was by creating a list of urls that the headers held, then using the request library I call each url. After the url has been called, the python program modifies the json object into non-normalized dataset. We can then read in the result into a dataframe with pandas.
Fixed Pagination issue. Works fine with smaller datasets, need to set up map/reduce to improve speed. The way I fixed it was by creating a list of urls that the headers held, then using the request library I call each url. After the url has been called, the python program modifies the json object into non-normalized dataset. We can then read in the result into a dataframe with pandas.