Move active business script to GCP

CityOfLosAngeles / civis-gcp-transition

Transition Civis jobs to Google Cloud Platform

Apache License 2.0

0 stars 0 forks source link

Move active business script to GCP #9

Closed tiffanychu90 closed 3 years ago

tiffanychu90 commented 3 years ago

Active business script pulls from Socrata, joins to census block groups, counts businesses per industry
Writes to AGOL feature layer
[x] Clean up script - update to newer geopandas syntax, opt for using dictionaries to map with updated values, rather than looping through each row and column.
[x] Overwrite CSV in GitHub
[x] Schedule in GCP

tiffanychu90 commented 3 years ago

@trantom: I added a new_updated_table.parquet into the active-business branch, the src/ folder. test4.ipynb would probably be the relevant notebook.

tiffanychu90 commented 3 years ago

@trantom: The solution is here! https://github.com/CityOfLosAngeles/civis-gcp-transition/blob/master/src/activebusiness_blockgroup.py#L204-L225

tiffanychu90 commented 3 years ago

@alexistome09 or @angelarafiles-lacityorg: Can you help with setting up a Cloud Run for src/activebusiness_blockgroup.py?

trantom commented 3 years ago

@tiffanychu90 Thank you for letting me in on it and the discussion. Definitely a little bit of tangle with the objects. Good stuff! 👍

alexistome09 commented 3 years ago

@tiffanychu90 I will work on this.