usc-isi-i2 / dig-etl-engine

Download DIG to run on your laptop or server.
http://usc-isi-i2.github.io/dig/
MIT License
101 stars 39 forks source link

Automate ingestion of REIGN data #165

Closed saggu closed 6 years ago

saggu commented 6 years ago

https://docs.google.com/spreadsheets/d/1mrtORyhXw9TJMBYLAGPrikA4VDpla_Eq7L-NsEQ5VXg/edit#gid=1690064134

Political data

saggu commented 6 years ago

http://oefresearch.org/datasets/reign

GreatYYX commented 6 years ago

Need to write a custom script to download google sheet, URL is here https://docs.google.com/spreadsheets/d/1mrtORyhXw9TJMBYLAGPrikA4VDpla_Eq7L-NsEQ5VXg/edit#gid=1823216053, could use google api: https://developers.google.com/sheets/api/quickstart/python

GreatYYX commented 6 years ago

no need to use api anymore, use this url: https://docs.google.com/spreadsheets/d/1mrtORyhXw9TJMBYLAGPrikA4VDpla_Eq7L-NsEQ5VXg/pub?output=xlsx . @szeke 's script need to support getting data from a certain sheet from a xls/xlsx file.