search

fabiogouw / spark-aws-messaging

A custom sink provider for Apache Spark that sends the content of a dataframe to an AWS SQS
MIT License
21 stars 5 forks source link

Image versioning for tests #22

Closed fabiogouw closed 5 months ago

fabiogouw commented 5 months ago

Since this library can be used by different Spark versions, I'm adding this capability of running the same integration test set against specific versions of Spark (3.1.2, 3.3.2 and 3.5.1).

This will slow down the building process, but will increase the confidence in releasing new versions of this library.