EU's new law regarding predictive models and "Right To An Explanation"

[traversc]

https://arxiv.org/abs/1606.08813

We summarize the potential impact that the European Union's new General Data Protection Regulation will have on the routine use of machine learning algorithms. Slated to take effect as law across the EU in 2018, it will restrict automated individual decision-making (that is, algorithms that make decisions based on user-level predictors) which "significantly affect" users. The law will also effectively create a "right to explanation," whereby a user can ask for an explanation of an algorithmic decision that was made about them. We argue that while this law will pose large challenges for industry, it highlights opportunities for computer scientists to take the lead in designing algorithms and evaluation frameworks which avoid discrimination and enable explanation.

Since we can't fully understand how deep learning models work, it seems to suggest that deep learning use in the clinical setting may be restricted.

Here's an article in the news about it: https://www.techdirt.com/articles/20160708/11040034922/activists-cheer-eus-right-to-explanation-algorithmic-decisions-how-will-it-work-when-theres-nothing-to-explain.shtml

[cgreene]

@traversc : definitely a great point for the discussion section!