ONSdigital / SDG_11.2.1

Analysis for the UN Sustainable Development Goal 11.2.1
https://onsdigital.github.io/SDG_11.2.1/
Apache License 2.0
5 stars 7 forks source link

Improve efficiency of `get_whole_nation_pop_df` #408

Open jwestw opened 1 year ago

jwestw commented 1 year ago

get_whole_nation_pop_df is used to build the whole nation population estimates. It reads many excel files and returns the results in dfs which get concat'd at the end.

The reading of these Excel files in a for-loop is painfully slow. It could be massively sped up with asynchronous programming.