MrPowers / mack

Delta Lake helper methods in PySpark
https://mrpowers.github.io/mack/
MIT License
286 stars 42 forks source link

Introducing tox to this project #131

Open huynguyent opened 5 months ago

huynguyent commented 5 months ago

Is your feature request related to a problem? Please describe.

The goal of this project is to maintain compatibility for a wide range of dependencies, for example different versions of pyspark or deltalake. However with the current set up, the test suites only test what is in the lock file. This makes it hard to detect breaking changes, both from upstream and from this project.

Describe the solution you'd like

Use tox to test against different combination of important dependencies, such as pyspark and deltalake

Poetry seems to have tox support but I haven't tried it myself: https://python-poetry.org/docs/faq/#is-tox-supported

Describe alternatives you've considered

Maybe multiple poetry dependency groups if we won't wanna use tox

Additional context Add any other context or screenshots about the feature request here.

Willingness to contribute

Would you be willing to contribute an implementation of this feature?