github CI: run most stuff on ubuntu 24.04

[ThomasWaldmann]

Only keep the python 3.9/3.10 testing on 22.04, so we can see if there is any ubuntu version specific difference in test behaviour.