Dataset Explore (by 1.18)

[wangqianwen0418]

:mag: other Data Sets

potential datasets:

• [x] https://www.kaggle.com/c/GiveMeSomeCredit/data
• [ ] US Federal Reserve. Report to the congress on credit scoring and its effects on the availability and affordability of credit. (used in equality paper)
• [x] Adult dataset
• [ ] Dutch Census of 2001 []

these datasets are related to financial problems, considering other domains?

how to explore:

• data preprocess
• model generation & samples generation
• find key_attributes
• analyze key_groups

[wangqianwen0418]

@YuzheJiang if you have initial results. You can post comments here.

[wangqianwen0418]

• [x] NYC's publicly available stop and frisk data: https://github.com/stablemarkets/StopAndFrisk (used in the supplementary material of "Counterfactual Fairness")
• [x] “American University Data” IPEDS dataset Enrollment rate and graduation rate using machine learning and IPEDS dataset: https://www.kaggle.com/sumithbhongale/american-university-data-ipeds-dataset/home
  i have checked this, cannot be used. each item is a university, not a student
• [x] Students' Academic Performance Dataset xAPI-Educational Mining Dataset https://www.kaggle.com/aljarah/xAPI-Edu-Data/home

[YuzheJiang]

potential dataset to be used:

1. xAPI (about students' academic performance) label: performance(L,M,H)
2. adult (census data). label: whether income exceeds $50K/yr
3. bank_term_deposit. label: whether a persons buys term deposit
4. German_credit. label: good/bad credit score
5. give_me_credit. label: good/bad credit score
6. NYC_stop_frisk. label:
7. student_performance. label: 0-20 score in 3 courses, respectively
8. uni admission data: missing

Next milestone: refine the pipeline, encapsulate codes and integrate into the system due: 1.21

keep searching datasets, especially admission data.