GreenInfo-Network nyc-crash-mapper-etl-script issues

GreenInfo-Network / nyc-crash-mapper-etl-script

Extract, Transform, and Load script for fetching new data from the NYC Open Data Portal's vehicle collision data and loading into the NYC Crash Mapper table on CARTO.

3 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Puzzling through getting a static IP for the ETL script process on heroku

#42 danrademacher closed 11 months ago
1
Update Heroku stack

#41 danrademacher closed 1 year ago
2
Scope out potential reuse of ETL for crime

#40 sync-by-unito[bot] opened 1 year ago
0
Past records not in any assembly district

#39 gregallensworth closed 1 year ago
3
Redistricting Assembly and City Council districts

#38 danrademacher closed 1 year ago
14
Review data divergence in Crashmapper

#37 sync-by-unito[bot] closed 1 year ago
12
Experiment with NYC geocoder for missing geoms

#36 danrademacher opened 2 years ago
1
Create new FixCoords script, or expand FixTallies

#35 danrademacher closed 2 years ago
8
Crashes Missing from Crashmapper - CB107

#34 sync-by-unito[bot] closed 2 years ago
12
Walkmapper input running but not importing

#33 danrademacher closed 3 years ago
3
Scope out import of 1 year of 311 data to WalkMapper

#32 danrademacher closed 3 years ago
4
New ETL script, similar to main.py, but for Walk Mapper

#31 danrademacher closed 3 years ago
6
Add Business Improvement Districts to ETL process.

#30 danrademacher closed 3 years ago
4
Improve error reporting

#29 danrademacher opened 4 years ago
0
Data import failing, again

#28 danrademacher closed 4 years ago
3
Discussion: Upgrade to Python 3

#27 danrademacher closed 4 years ago
3
Update requirements and README for local running with sendgrid

#26 danrademacher closed 4 years ago
7
Missing Feb 2020 crashes, exceeding API limits

#25 danrademacher closed 4 years ago
13
Vehicle Type apportionment

#24 danrademacher closed 4 years ago
13
Vehicle Type Crosswalk examination tool

#23 gregallensworth closed 4 years ago
3
New Vehicle Type crosswalk and allocations

#22 danrademacher closed 4 years ago
9
Missing crashes since 11/26

#21 danrademacher closed 4 years ago
1
Handle new data ID and auth requirements at Socrata

#20 danrademacher closed 4 years ago
3
Create monthly database backup task

#19 danrademacher opened 5 years ago
11
no data since 11/16

#18 danrademacher closed 5 years ago
7
find_updated_killcounts() bailing with JSON error

#17 gregallensworth closed 5 years ago
2
Yet more QA on missing data

#16 danrademacher closed 5 years ago
6
Suddenly low CARTO quota is killing import

#15 danrademacher closed 5 years ago
6
Assess impact of new API key system

#14 danrademacher closed 5 years ago
3
ETL adjustment or offline task, to find & rectify altered crash records?

#13 gregallensworth closed 6 years ago
8
Crash counts mismatch between CARTO & SODA

#12 gregallensworth closed 6 years ago
21
Intersections crashcount: change to last 24 months

#11 gregallensworth closed 6 years ago
0
New function: intersections crashcount

#10 gregallensworth closed 6 years ago
0
Data vetting and checkup: non-uniquesocrata_id and missing socrata_id

#9 gregallensworth closed 6 years ago
7
#6 ETL script load 1 month back for better catches

#8 gregallensworth closed 6 years ago
0
Custom SODA run for 2015-01-01 to present?

#7 gregallensworth closed 6 years ago
6
Check SODA back 1 month, filter against already-existing records

#6 gregallensworth closed 6 years ago
9
README file, add docs for Windows folks

#5 gregallensworth closed 6 years ago
0
new subtask: nyc_intersections crashcount

#4 gregallensworth closed 6 years ago
1
a few minor fixes

#3 gregallensworth closed 6 years ago
0
Filter out badly geocoded data after updating crashes table in Carto

#2 clhenrick closed 6 years ago
2
How to deal with historic updates to NYC Open Data?

#1 clhenrick closed 7 years ago
1