mitchelllisle / sparkdantic

✨ A Pydantic to PySpark schema library
https://mitchelllisle.github.io/sparkdantic/
MIT License
55 stars 10 forks source link

Add support for lower spark versions #374

Closed chidifrank closed 4 months ago

chidifrank commented 4 months ago

Broadening the version compatibility since I am running into some version constraint issues on on-premises infrastructure we do not manage ourselves. Their spark version is pinned to 3.3.1