Closed todowede closed 3 years ago
Updated the following codes - mainly to read the raw EURO data in excel without any preprocessing.
config/input_check/columns/EURO.csv
config/key_map/EURO.csv
config/who_coding/EURO.csv
openpyxl>=3.0.6
requirements.txt
src/master.py
weekly_import
src/postprocess/EURO.py
src/prepare_merge.py
src/preprocess.py
src/processing/CDC_ITF.py
src/processing/EURO.py
who_code
euro_weekly_upload
tests/postprocessing/test_postprocess_EURO.py
Updated the following codes - mainly to read the raw EURO data in excel without any preprocessing.
Include all EURO data columns header in the columns config file
config/input_check/columns/EURO.csv
Update the key_map values for EURO data to recognise the new column headers
config/key_map/EURO.csv
Update new who_code combinations for EURO
config/who_coding/EURO.csv
Include
openpyxl>=3.0.6
in package requirements (required as engine for pandas.read_excel)requirements.txt
Change of date to read previous_update for weekly processing run
src/master.py
Update to the function
weekly_import
for the progressive upload of EURO datasrc/postprocess/EURO.py
Change of date to read previous_update and previous_not_cleansed for weekly processing run
src/prepare_merge.py
Read the raw excel file from EURO (comment out previous code that read csv file)
src/preprocess.py
Apply utils.replace_conditional for manual country name change for CDC
src/processing/CDC_ITF.py
Update code to accommodate mixed enforcement type in EURO data
src/processing/EURO.py
write test for function
weekly_import
that upload onlywho_code
ineuro_weekly_upload
configtests/postprocessing/test_postprocess_EURO.py