socialfoundations / folktables

Datasets derived from US census data
MIT License
234 stars 20 forks source link

Overlapping between the Adult dataset and the Reconstructed Adult dataset #36

Closed wxl-lxw closed 1 year ago

wxl-lxw commented 1 year ago

Hello! As I am planning to conduct pretraining on the Adult dataset and then fine-tune on the Reconstructed Adult dataset, I am wondering if there is any overlapping between the two datasets. Specifically, I am interested in knowing if there are any data points that appear in both datasets. If there are, could you please provide the matched ID so that I can filter them out from my analysis?

Thank you very much for your assistance.