Open tgherzog opened 4 years ago
@tgherzog Yes, the current version of the chart is quite rough. Let me see what I can do to address the specific points you raised. Will get back to you early next week on this.
Hi @tgherzog I think I addressed most of your comments in the updated app. Let me know.
Hi @tonyfujs - would it be possible in the legend to show AUC as well as indicator count as shown in the screen grab below? These are ideas that are developed in the paper and it would be good to show them to the user.
AUC is "area under curve" and in this case is defined as the sum of the bar values divided by the number of indicators. Or another way, the number of MRVs relative to the selected year divided by nCountries * nSeries.
N is simply the number of indicators that have % coverage > 0.
You can also refer to my python notebook if helpful:
https://github.com/worldbank/ESG_gaps_research/blob/master/python/coverage-analysis.ipynb
Hi @tgherzog Sure. Let me take a look at this.
@tgherzog I just updated the app. https://datanalytics.worldbank.org/esg_imputation/ Let me know when you have a few minutes to clear out a couple of questions I have. Thanks!
@tonyfujs I just took a look. Visually, looks good, but I'm seeing different results for the same input parameters comparing yours to mine in the python notebook above in both the chart and the stats in the legend (I added some code to the notebook so you could see the raw output in github even if you can't run it):
Year/Max CV/Years to Impute: 2018/0.5/1
Total Indicators: 115
Total Economies: 217
Total Observations: 24955
Actual Observations (before/after): 7659/8333
AUC (before/after): 30.7/33.4
Indicators with MRV>=2018 (before/after): 54/75
Improved Indicators (previously 0%/all): 21/43
Indicators with 50% coverage (before/after): 38/38
Thanks @tgherzog Will look at this.
Hi @tgherzog Everything should be good now. My code was relying on an outdated ESG_cv.feather file: I streamlined this so it now depends on the exact same files used in the variability chapter.
@tonyfujs - I wanted to see if there's the possibility to make a few fixes to the CV browser tool you added to what's currently section 4.3: