search

MrPowers / chispa

PySpark test helper methods with beautiful error messages
https://mrpowers.github.io/chispa/
MIT License
595 stars 65 forks source link

Run tests for multiple PySpark versions in CI #61

Open MrPowers opened 1 year ago

MrPowers commented 1 year ago

See here for an example: https://github.com/MrPowers/quinn/pull/98

This is a good way we make sure we keep supporting legacy versions of Spark well for a long time.

We always want to support lots of Spark versions.

Oguzozcn commented 1 year ago

Hi, so all I have to do is set up a testing environment, install the necessary versions of PySpark and configure CI on my system to run tests against multiple versions, and then run the existing test suite to ensure it passes, right?

MrPowers commented 1 year ago

@Oguzozcn - Yea, the scope is to run the CI test suite against multiple versions of Spark. This will ensure that the project works for multiple supported Spark versions. Let me know if you'd like me to assign this issue to you.

Oguzozcn commented 1 year ago

Sure, I will try my best.

MrPowers commented 1 year ago

Thanks @Oguzozcn, assigned the issue to you. Feel free to ping me if you need any help.

MrPowers commented 1 year ago

@Oguzozcn - unassigning you cause it looks like this didn't ever get worked on.