Script to read Google Sheet and output JSON data summaries

[eldang]

• [x] Make a per-run temp working directory
• [x] Read Google Sheet
• [x] Do place->people join
• [x] Output places JSON
• [x] Do person->places join
• [x] Do person->assets join
• [x] Output people JSON
• [x] Check if any assets need to be downloaded from Google Drive and download them if so
• [x] Check that the run has produced parseable JSON, and copy files from temp to permanent location if so

[eldang]

@coregis I've set up the fork of your repo and enabled git LFS, and I'll use this issue to track progress on the work we discussed today.

[eldang]

I think it's worth me tracking edits I've made to the data as I've gone through:

1. Added headers to the people sheet where they were missing, because my code does need them to key off.
2. Deleted a row with person ID 10 and place ID 173 from people to places because there is no place with ID 173.

I suspect the second one is a typo from 137, but I figure it's better to ask the client to check that than to assume it myself

[eldang]

There are also a handful of people and places with no counterparts in the other dataset. I'm not making the script fail on these, but it does report them all:

20211007 18:12:18 WARNING __main__: The following people have no associated places:

13: {'name': 'Thomas Dunstan', 'description': 'This architect designed many PNW homes but lived in one in Ballard that is also on its Top 160 Mapping Historic Ballard map.', 'year_born': '1919.0', 'gender': 'M', 'other_names': '', 'birthplace': '', 'occupation': 'architect', 'employer': '', 'born_in_ballard': False, 'profession': 'Architect', 'ballard_childhood': False, 'legacy_business_connection': '', 'association': '', 'cht_mhb': 'Top 160', 'bhs_grad': False, 'bhs_year': '', 'heritage': ['American'], 'audio': [], 'transcript': '13_Dunstan_Thomas_background.pdf', 'photos': ['13_Dunstan_Thomas_photo_01.jpeg', '13_Dunstan_Thomas_photo_02.jpeg'], 'other_materials': ['13_Dunstan_Thomas_Article_01.pdf', '13_Dunstan_Thomas_obituary.pdf', '13_Dunstan_Thomas_house summary.pdf'], 'places': [], 'employers': [], 'family_professions': []}

39: {'name': 'Mary Lou Wilson', 'description': 'Ballard Beach, blackberries, visiting German grandmother and Miss Lund at Carnegie Library.', 'year_born': '1920.0', 'gender': 'F', 'other_names': 'Hoyt', 'birthplace': 'Ballard', 'occupation': '', 'employer': '', 'born_in_ballard': True, 'profession': '', 'ballard_childhood': True, 'legacy_business_connection': 'Carnegie', 'association': '', 'cht_mhb': '', 'bhs_grad': False, 'bhs_year': '', 'heritage': ['German'], 'audio': ['39_Wilson_MaryLou_audio.mp3'], 'transcript': '39_Wilson_MaryLou_transcript.pdf', 'photos': [], 'other_materials': [], 'places': [], 'employers': [], 'family_professions': []}

42: {'name': 'Mary Complita', 'description': '"My obituary will say Mary Gale Complita because there are so many Mary\'s." Runner-up for Mrs. Ballard contest.', 'year_born': '1908.0', 'gender': 'F', 'other_names': '', 'birthplace': 'California', 'occupation': '', 'employer': '', 'born_in_ballard': False, 'profession': '', 'ballard_childhood': False, 'legacy_business_connection': '', 'association': '', 'cht_mhb': '', 'bhs_grad': False, 'bhs_year': '', 'heritage': ['Yugoslavian'], 'audio': ['07_Complita_Louis_Mary_audio.mp3'], 'transcript': '', 'photos': [], 'other_materials': [], 'places': [], 'employers': [], 'family_professions': []}

44: {'name': 'Mary Hamblet', 'description': 'Daughter of Chief of the Kitsalas, one of the various Tshumshian tribes in Metlakatla, British Columbia. Mary Avenue is named for her, and Alonzo for her son.', 'year_born': '1840.0', 'gender': 'F', 'other_names': 'Chief of Kitsalas Tribe Tsumshian', 'birthplace': 'Metlakatla, BC', 'occupation': 'matriarch', 'employer': '', 'born_in_ballard': False, 'profession': 'Mother', 'ballard_childhood': False, 'legacy_business_connection': '', 'association': '', 'cht_mhb': '', 'bhs_grad': False, 'bhs_year': '', 'heritage': ['Native Alaskan', 'Tsumshian'], 'audio': [], 'transcript': '', 'photos': [], 'other_materials': [], 'places': [], 'employers': [], 'family_professions': []}

20211007 18:12:18 WARNING __main__: The following places have no associated people:

169: {'type': '', 'address': '5140 Ballard Avenue NW, Seattle, WA 98107', 'lat': 47.66551630000001, 'long': -122.381808, 'name': 'Owl Conor Byrne', 'people': []}