issues
search
CityofPittsburgh
/
data-rivers
Apache Airflow and Beam ETL scripts for the City of Pittsburgh's data analysis pipelines
10
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Export Delinquency Data to Open Data Bucket
#777
jasonfic
closed
1 week ago
0
Add Dynamic Parcel Geolocation, Integer Council Districts, and GeoJSON Exports to Delinquency DAG
#776
jasonfic
closed
2 weeks ago
0
added df script to dag
#775
woodjt
closed
3 weeks ago
0
modifying extraction to include extra fields
#774
woodjt
closed
1 month ago
0
Refactor gcs loaders
#773
woodjt
closed
1 month ago
0
Refactor gcs loaders
#772
woodjt
closed
1 month ago
0
Remove Refs to Broken GeoPandas Library
#771
jasonfic
closed
1 month ago
0
revised extraction query to meet updated needs. the query will accomo…
#770
woodjt
closed
1 month ago
0
Format PCollection as Dataframe , Export to GCS
#769
jasonfic
closed
1 month ago
0
Directly Export CSVs from Code Enforcement Dataflow
#768
jasonfic
closed
1 month ago
0
Add Ring Time to Twilio Schema
#767
jasonfic
closed
1 month ago
0
hotfix for file name error
#766
woodjt
closed
1 month ago
0
making pli permit query construction a util since it is duplicated in…
#765
woodjt
closed
1 month ago
0
creation of dags to run the entire pipelines for the pli permits. cur…
#764
woodjt
closed
1 month ago
0
seperating all permit extractions into their own gcs loadere files. …
#763
woodjt
closed
1 month ago
0
Pli permits gcs
#762
woodjt
closed
1 month ago
0
just renaming files to be consistent with preferred nomenclature
#761
woodjt
closed
1 month ago
0
Vio af
#760
woodjt
closed
1 month ago
0
Bump urllib3 from 1.25.8 to 1.26.19
#759
dependabot[bot]
closed
1 month ago
1
Vio af
#758
woodjt
closed
2 months ago
0
Dag cleanup
#757
woodjt
closed
2 months ago
0
Prefix change
#756
woodjt
closed
2 months ago
0
Vio gcs hotfix
#755
woodjt
closed
2 months ago
0
Vio
#754
woodjt
closed
2 months ago
0
Violations
#753
woodjt
closed
2 months ago
0
Fix CoGroupByKey by Converting to Bytes After Join
#752
jasonfic
closed
2 months ago
0
changed file loc to use hot metal
#751
woodjt
closed
2 months ago
0
Violations
#750
woodjt
closed
2 months ago
0
Violations
#749
woodjt
closed
2 months ago
0
Change bt table
#748
woodjt
closed
2 months ago
0
Violations
#747
woodjt
closed
2 months ago
0
Add Util Function for Beam.Map() that Converts Whole Datum to 1 Type
#746
jasonfic
closed
2 months ago
0
Move Foreign Key Extraction Map Function to Utils Script
#745
jasonfic
closed
2 months ago
0
Handle Missing Date Fields, Remove Prints
#744
jasonfic
closed
2 months ago
0
Add Param to SwapFieldNames Util to Exclude Missing Fields
#743
jasonfic
closed
2 months ago
0
Move SwapFieldNames Processing to External Python Function
#742
jasonfic
closed
2 months ago
0
Reduce Field Name Swaps, Move Merge Function to Utils
#741
jasonfic
closed
2 months ago
0
Reduce Dataflow Runtime with CoGroupByKey ParDos
#740
jasonfic
closed
2 months ago
0
Change func name
#739
woodjt
closed
2 months ago
0
updating the violations gcs loader which will no longer unnest record…
#738
woodjt
closed
2 months ago
0
just removing some comments and junk
#737
woodjt
closed
2 months ago
0
Datetime hotfix
#736
woodjt
closed
2 months ago
0
Bump requests from 2.23.0 to 2.32.0
#735
dependabot[bot]
closed
2 months ago
1
Prevent Error of Duplicate Incoming Records Breaking Update Query
#734
jasonfic
closed
3 months ago
0
Add Timeout Interval to Eproperty Extract Script
#733
jasonfic
closed
3 months ago
0
Accomodate Removal of Qalert Run Logging, Sort Recent Blobs
#732
jasonfic
closed
4 months ago
0
Remove Unused Imports and Run Logging
#731
jasonfic
closed
4 months ago
0
Leverage ArgeParse to Get Last Successful Run, Remove Unused Imports and Console Logs
#730
jasonfic
closed
4 months ago
0
Remove Successful Run Log Retrieval from Ceridian DAG
#729
jasonfic
closed
4 months ago
0
Use Airflow Context Logging to Fetch Last Successful Run
#728
jasonfic
closed
4 months ago
0
Next