devinit / digital-platform

PostgreSQL/analyst → MongoDB → Development Data Hub
http://data.devinit.org:8888/#!/ & http://data.devinit.org/#!/
3 stars 12 forks source link

Import script won't import from `dimension` #255

Open dw8547 opened 7 years ago

dw8547 commented 7 years ago

https://github.com/devinit/digital-platform/blob/development/nodejs/js/datamap_raw.js trips up when it gets to the dimension tables:

"country-year/warehouse/dimension/di_id.csv": "dimension.\"di_id\"",
"country-year/warehouse/dimension/di_id_to_iso_3166_1_map.csv": "dimension.\"di_id_to_iso_3166_1_map\"",
"country-year/warehouse/dimension/iso_3166_1.csv": "dimension.\"iso_3166_1\"",
"country-year/warehouse/dimension/oecd_donor.csv": "dimension.\"oecd_donor\"",
"country-year/warehouse/dimension/oecd_loc_donor.csv": "dimension.\"oecd_loc_donor\"",
"country-year/warehouse/dimension/oecd_crs_donor.csv": "dimension.\"oecd_crs_donor\"",
"country-year/warehouse/dimension/oecd_dac_1_donor.csv": "dimension.\"oecd_dac_1_donor\"",
"country-year/warehouse/dimension/oecd_dac_2a_donor.csv": "dimension.\"oecd_dac_2a_donor\"",
"country-year/warehouse/dimension/oecd_dac_2b_donor.csv": "dimension.\"oecd_dac_2b_donor\"",
"country-year/warehouse/dimension/oecd_donor_to_di_id_map.csv": dimension.\"oecd_donor_to_di_id_map\"",
"country-year/warehouse/dimension/oecd_donor_to_iso_3166_1_map.csv": "dimension.\"oecd_donor_to_iso_3166_1_map\"",
"country-year/warehouse/dimension/oecd_donor_type.csv": "dimension.\"oecd_donor_type\"",
"country-year/warehouse/dimension/oecd_recipient.csv": "dimension.\"recipient\"",
"country-year/warehouse/dimension/oecd_loc_recipient.csv": "dimension.\"oecd_loc_recipient\"",
"country-year/warehouse/dimension/oecd_crs_recipient.csv": "dimension.\"oecd_crs_recipient\"",
"country-year/warehouse/dimension/oecd_dac_2a_recipient.csv": "dimension.\"oecd_dac_2a_recipient\"",
"country-year/warehouse/dimension/oecd_dac_2b_recipient.csv": "dimension.\"oecd_dac_2b_recipient\"",
"country-year/warehouse/dimension/oecd_recipient_to_di_id_map.csv": "dimension.\"oecd_recipient_to_di_id_map\"",
"country-year/warehouse/dimension/oecd_recipient_to_iso_3166_1_map.csv": "dimension.\"oecd_recipient_to_iso_3166_1_map\"",
"country-year/warehouse/dimension/oecd_recipient_income_group.csv": "dimension.\"oecd_recipient_income_group\"",
"country-year/warehouse/dimension/imf_weo_country.csv": "dimension.\"imf_weo_country\"",
"country-year/warehouse/dimension/imf_weo_country_to_di_id_map.csv": "dimension.\"imf_weo_country_to_di_id_map\"",
"country-year/warehouse/dimension/wb_wdi_country.csv": "dimension.\"wb_wdi_country\"",
"country-year/warehouse/dimension/wb_wdi_country_to_di_id_map.csv": "dimension.\"wb_wdi_country_to_di_id_map\"",
"country-year/warehouse/dimension/wb_wdi_country_to_imf_weo_country_map.csv": "dimension.\"wb_wdi_country_to_imf_weo_country_map\""
import_script_dimension_bug

Quite possibly something to do with the fact that we have a column called di_id in the table called di_id.