search

lshtm-gis / WHO_PHSM_Cleaning

Cleaning PHSM provider data for WHO
https://lshtm-gis.github.io/WHO_PHSM_Cleaning/html/
MIT License
0 stars 1 forks source link

Convert records to DataFrame once. #127

Closed hamishgibbs closed 3 years ago

hamishgibbs commented 3 years ago

Currently - individual records are being converted to a dataframe and then concatenated together.

This is very inefficient.

Should be replaced by converting the entire list of record-oriented dicts to a DataFrame in a single step.

https://github.com/lshtm-gis/WHO_PHSM_Cleaning/blob/f746f5f4c014c8ebf3ad002ffdc931274481d82f/src/process.py#L67-L73

hamishgibbs commented 3 years ago

Added in #129.