Create an ellipse. When you mouse-up when you're satisfied with the shape and it comes to the rotation part, the ellipse gets rotated a bit even though you the mouse hasn't moved yet. The amount of initial rotation seems to depend on the zoom level.
No problem at 100% zoom. The issue doesn't present with the rectangle tool.
Do this:
No problem at 100% zoom. The issue doesn't present with the rectangle tool.