Drop dependency on py

[frenzymadness]

pytest 7.2 and tox 4 no longer depend on py and it's not needed here as well.