thinkingmachines / unicef-ai4d-poverty-mapping

UNICEF AI4D Relative Wealth Mapping Project - datasets, models, and scripts for building relative wealth estimation models across Southeast Asia (SEA)
https://thinkingmachines.github.io/unicef-ai4d-poverty-mapping
MIT License
20 stars 8 forks source link

Add classifier experiments notebook #149

Closed tm-jace-peralta closed 1 year ago

tm-jace-peralta commented 1 year ago

This PR includes a classifier experiment notebook that (1) categorizes the output of the regression model into 5 income groups (A-richest to E-poorest), and (2) creates matrix-based metrics to evaluate the model's performance when its output is grouped into those income categories.

review-notebook-app[bot] commented 1 year ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

tm-jc-nacpil commented 1 year ago

The notebook looks good to me! The categorize_wealth_index function is pretty neat :D

For the merge conflict, it's a bit strange na it pulled my commits from my previous PR on the single-country model din. Merging #149 and #150 together might cause conflict kasi it's duplicating work (#149 #150 are moving the the same file)

I wonder if this will resolve it.

  1. Approve and merge #150 to main. This will clean up the 2023-02-21-single-country-rollouts folder
  2. On this branch, stash notebooks/2023-02-21-single-country-rollouts/2023_02-21-tl_final_model_training.ipynb and notebooks/2023-02-21-single-country-rollouts/model_tl_rollout.pkl
  3. Pull the merged changes on main from step 1 to feat/add-classifier-experiments
  4. Push updated branch feat/add-classifier-experiments
  5. Approve and merge #149 to main

This is also just my best guess haha. @alronlam @butchtm looping you in incase you have any thoughts on this :D. Lmk if we should also do a pair prog session to work on this!

Edit: since this PR shouldn't change anything about the single-country rollout, maybe it would be easier to unstage the classifier notebook, create a new branch from the latest main, then add the notebook to this new branch?

tm-jace-peralta commented 1 year ago

thanks for looking into this @tm-jc-nacpil, i agree to just close this PR and start a new one with the correct branching.