Closed dolph closed 5 years ago
Here are some comments from Karthikeyan Natesan ramamurthy, one of the maintainers:
There is randomness in splitting the datasets into train and test partitions and also in the algorithm itself. _When I ran this locally I got the following result:
Transformed training dataset
Difference in mean outcomes between unprivileged and privileged groups = -0.013180_
It is ok to have results slightly different from that of the code pattern. As for why results change between local and cloud, it could be because the two versions of python used could have different behaviors during random number generation.
I am seeing the difference in mean outcomes between unprivileged and privileged get worse after mitigation: Before: -0.102466 After: -0.136480
There is an issue for this in the AIF360 repo: https://github.com/IBM/AIF360/issues/51
Potential issue reported by @lidderupk: