caciviclab / disclosure-backend-static

Campaign finance data powering Open Disclosure California
https://caciviclab.org/odca-jekyll/
15 stars 13 forks source link

use new gdrive-datastore to check and fix gdrive access #328

Closed ChenglimEar closed 10 months ago

ChenglimEar commented 10 months ago

This addresses the problem where we could not test gdrive access from a branch because the branch name was being used as the subfolder where the redacted data was stored on Google Drive. We needed to set the subfolder to always be main since that is where the released redacted data lives.

This should not be approved until the workflow for checking Google Drive access runs successfully. That workflow depends on the SERVICE_ACCOUNT_KEY_JSON secret and the GDRIVE_FOLDER variable being set right.

mikeubell commented 10 months ago
Build diff from Commit 17963a5a84b7b0200b99fe9acdd5ed83d38ea912: ```diff diff --git a/build/_data/stats.json b/build/_data/stats.json index f0b04ca..d284f2d 100644 --- a/build/_data/stats.json +++ b/build/_data/stats.json @@ -1,3 +1,3 @@ { - "date_processed": "2023-10-29 00:07:45 -0700" + "date_processed": "2023-10-30 00:07:25 -0700" } ```
mikeubell commented 10 months ago
Build diff from Commit 13c7e74fe9572a11a1ab1b0c76db2a11ff828a52: ```diff diff --git a/build/_data/stats.json b/build/_data/stats.json index f0b04ca..d284f2d 100644 --- a/build/_data/stats.json +++ b/build/_data/stats.json @@ -1,3 +1,3 @@ { - "date_processed": "2023-10-29 00:07:45 -0700" + "date_processed": "2023-10-30 00:07:25 -0700" } ```
mikeubell commented 10 months ago
Build diff from Commit 84283ed3348dbcd96c97aeb8fe5f4e9417a9a89d: ```diff diff --git a/build/_data/stats.json b/build/_data/stats.json index f0b04ca..d284f2d 100644 --- a/build/_data/stats.json +++ b/build/_data/stats.json @@ -1,3 +1,3 @@ { - "date_processed": "2023-10-29 00:07:45 -0700" + "date_processed": "2023-10-30 00:07:25 -0700" } ```
mikeubell commented 10 months ago
Build diff from Commit 93f7f56e947377c74a9dd49fddecf7f25f0e91a6: ```diff diff --git a/build/_data/stats.json b/build/_data/stats.json index f0b04ca..d284f2d 100644 --- a/build/_data/stats.json +++ b/build/_data/stats.json @@ -1,3 +1,3 @@ { - "date_processed": "2023-10-29 00:07:45 -0700" + "date_processed": "2023-10-30 00:07:25 -0700" } ```
tdooner commented 10 months ago

(I don't really have much context on this anymore, though, so you should probably take my review with a grain of salt.)

mikeubell commented 10 months ago
Build diff from Commit f4f219bea0a166cf98f79c9eb5e426ee88ec17ec: ```diff diff --git a/build/_data/committees/1410941.json b/build/_data/committees/1410941.json index 178a733..fcb85cd 100644 --- a/build/_data/committees/1410941.json +++ b/build/_data/committees/1410941.json @@ -153,7 +153,7 @@ "Tran_Date": "2018-09-24", "Tran_NamF": null, "Tran_NamL": "Morse Management, Inc.", - "Tran_Zip4": "10022" + "Tran_Zip4": "94661" }, { "Filer_ID": "1410941", @@ -164,7 +164,7 @@ "Tran_Date": "2018-09-24", "Tran_NamF": null, "Tran_NamL": "Morse Management, Inc.", - "Tran_Zip4": "94661" + "Tran_Zip4": "10022" }, { "Filer_ID": "1410941", @@ -813,7 +813,7 @@ "Tran_Date": "2018-10-19", "Tran_NamF": "Garrett", "Tran_NamL": "Riegg", - "Tran_Zip4": "94602" + "Tran_Zip4": "94606" }, { "Filer_ID": "1410941", @@ -824,7 +824,7 @@ "Tran_Date": "2018-10-19", "Tran_NamF": "Garrett", "Tran_NamL": "Riegg", - "Tran_Zip4": "94606" + "Tran_Zip4": "94602" }, { "Filer_ID": "1410941", diff --git a/build/_data/committees/1421001.json b/build/_data/committees/1421001.json index 09cc4a0..ff4043a 100644 --- a/build/_data/committees/1421001.json +++ b/build/_data/committees/1421001.json @@ -1198,7 +1198,7 @@ "Tran_Date": "2020-07-15", "Tran_NamF": "Jonathan", "Tran_NamL": "Williams", - "Tran_Zip4": "94602" + "Tran_Zip4": "94603" }, { "Filer_ID": "1421001", @@ -1209,7 +1209,7 @@ "Tran_Date": "2020-07-15", "Tran_NamF": "Jonathan", "Tran_NamL": "Williams", - "Tran_Zip4": "94603" + "Tran_Zip4": "94602" }, { "Filer_ID": "1421001", diff --git a/build/_data/elections/oakland/2018-06-05.json b/build/_data/elections/oakland/2018-06-05.json index b39b338..140316d 100644 --- a/build/_data/elections/oakland/2018-06-05.json +++ b/build/_data/elections/oakland/2018-06-05.json @@ -57,7 +57,7 @@ "total_contributions": 15000.0 }, { - "name": "Service Employees International Union Local 1021 Issues PAC", + "name": "Oakland Athletics Baseball Company", "type": "Measure", "election_name": "oakland-june-2018", "total_contributions": 10000.0 diff --git a/build/_data/elections/oakland/2022-11-08.json b/build/_data/elections/oakland/2022-11-08.json index f716008..d436f62 100644 --- a/build/_data/elections/oakland/2022-11-08.json +++ b/build/_data/elections/oakland/2022-11-08.json @@ -2,13 +2,13 @@ "total_contributions": 6476065.89, "total_contributions_by_source": { "Out of State": 521147.35, - "Within Oakland": 2632398.1800000006, + "Within Oakland": 2632398.1799999997, "Within California": 3006531.1199999996 }, "contributions_by_type": { "PTY": 15900.0, "Committee": 995101.14, - "Individual": 2507910.870000002, + "Individual": 2507910.869999998, "Unitemized": 135828.3, "Self Funding": 2711.0, "Other (includes Businesses)": 2638453.6399999997 @@ -107,7 +107,7 @@ "total_contributions": 6300.0 }, { - "name": "Russ Taplin", + "name": "John Protopappas", "type": "Office", "election_name": "oakland-2022", "total_contributions": 5400.0 diff --git a/build/_data/elections/oakland/2023-11-07.json b/build/_data/elections/oakland/2023-11-07.json index 73ff78f..1d8179a 100644 --- a/build/_data/elections/oakland/2023-11-07.json +++ b/build/_data/elections/oakland/2023-11-07.json @@ -64,19 +64,19 @@ ], "top_contributors_for_offices": [ { - "name": "UA Local 342", + "name": "Service Employees International Union Local 1021 Candidate PAC", "type": "Office", "election_name": "oakland-2023", "total_contributions": 1200.0 }, { - "name": "Service Employees International Union Local 1021 Candidate PAC", + "name": "Laborers Local 304", "type": "Office", "election_name": "oakland-2023", "total_contributions": 1200.0 }, { - "name": "Laborers Local 304", + "name": "UA Local 342", "type": "Office", "election_name": "oakland-2023", "total_contributions": 1200.0 diff --git a/build/_data/elections/oakland/2024-11-05.json b/build/_data/elections/oakland/2024-11-05.json index 129d546..adbcd09 100644 --- a/build/_data/elections/oakland/2024-11-05.json +++ b/build/_data/elections/oakland/2024-11-05.json @@ -49,19 +49,19 @@ ], "top_contributors_for_offices": [ { - "name": "Weylin White", + "name": "Todd Scanlin", "type": "Office", "election_name": "oakland-2024", "total_contributions": 1800.0 }, { - "name": "Todd Scanlin", + "name": "Dow Terry", "type": "Office", "election_name": "oakland-2024", "total_contributions": 1800.0 }, { - "name": "Jacob Zonn", + "name": "Brooke Levin", "type": "Office", "election_name": "oakland-2024", "total_contributions": 1800.0 diff --git a/build/_data/stats.json b/build/_data/stats.json index f0b04ca..d284f2d 100644 --- a/build/_data/stats.json +++ b/build/_data/stats.json @@ -1,3 +1,3 @@ { - "date_processed": "2023-10-29 00:07:45 -0700" + "date_processed": "2023-10-30 00:07:25 -0700" } diff --git a/build/_data/totals.json b/build/_data/totals.json index 4d36b47..83bf617 100644 --- a/build/_data/totals.json +++ b/build/_data/totals.json @@ -782,13 +782,13 @@ "total_contributions": 6476065.89, "total_contributions_by_source": { "Out of State": 521147.35, - "Within Oakland": 2632398.1800000006, + "Within Oakland": 2632398.1799999997, "Within California": 3006531.1199999996 }, "contributions_by_type": { "PTY": 15900.0, "Committee": 995101.14, - "Individual": 2507910.870000002, + "Individual": 2507910.869999998, "Unitemized": 135828.3, "Self Funding": 2711.0, "Other (includes Businesses)": 2638453.6399999997 @@ -887,7 +887,7 @@ "total_contributions": 6300.0 }, { - "name": "Russ Taplin", + "name": "John Protopappas", "type": "Office", "election_name": "oakland-2022", "total_contributions": 5400.0 @@ -1033,7 +1033,7 @@ "total_contributions": 15000.0 }, { - "name": "Service Employees International Union Local 1021 Issues PAC", + "name": "Oakland Athletics Baseball Company", "type": "Measure", "election_name": "oakland-june-2018", "total_contributions": 10000.0 @@ -1377,19 +1377,19 @@ ], "top_contributors_for_offices": [ { - "name": "UA Local 342", + "name": "Service Employees International Union Local 1021 Candidate PAC", "type": "Office", "election_name": "oakland-2023", "total_contributions": 1200.0 }, { - "name": "Service Employees International Union Local 1021 Candidate PAC", + "name": "Laborers Local 304", "type": "Office", "election_name": "oakland-2023", "total_contributions": 1200.0 }, { - "name": "Laborers Local 304", + "name": "UA Local 342", "type": "Office", "election_name": "oakland-2023", "total_contributions": 1200.0 @@ -1493,19 +1493,19 @@ ], "top_contributors_for_offices": [ { - "name": "Weylin White", + "name": "Todd Scanlin", "type": "Office", "election_name": "oakland-2024", "total_contributions": 1800.0 }, { - "name": "Todd Scanlin", + "name": "Dow Terry", "type": "Office", "election_name": "oakland-2024", "total_contributions": 1800.0 }, { - "name": "Jacob Zonn", + "name": "Brooke Levin", "type": "Office", "election_name": "oakland-2024", "total_contributions": 1800.0 ```