Upgrade to datafusion 39 and arrow 52

[sergiimk]

Initial attempt to upgrade to datafusion v39 and latest jiter - in case you find this helpful.

Note the proposed change of dependency pinning to a specific major release, related to #12.

Also note that one test is failing - I could not yet figure out what am I doing wrong with the new way to initialize UnionArray.

[davidhewitt]

Oops looks like we raced a bit on preparing this one @sergiimk - I also opened #15 yesterday!

I agree with pinning to a specific major release, I did the same in my PR👍

[davidhewitt]

Superseded by #15, thanks for the contribution 🙏