Add support for lower spark versions

mitchelllisle / sparkdantic

✨ A Pydantic to PySpark schema library

https://mitchelllisle.github.io/sparkdantic/

MIT License

53 stars 10 forks source link

Add support for lower spark versions #374

Closed chidifrank closed 2 months ago

chidifrank commented 2 months ago

Broadening the version compatibility since I am running into some version constraint issues on on-premises infrastructure we do not manage ourselves. Their spark version is pinned to 3.3.1