I'm not sure how you can reproduce this bug but what it looks like to me is it seems like there are two overlays when the dialog appears. When I click on 'Yes' once, the background gets a bit lighter in transparency so I'm thinking this is when the first overlay is removed. Then I click on 'Yes' again because the dialog is still present. And only then the dialog closes.
Update
It's not only for the Yes button, but the No button as well.
I'm not sure how you can reproduce this bug but what it looks like to me is it seems like there are two overlays when the dialog appears. When I click on 'Yes' once, the background gets a bit lighter in transparency so I'm thinking this is when the first overlay is removed. Then I click on 'Yes' again because the dialog is still present. And only then the dialog closes.
Update It's not only for the Yes button, but the No button as well.