awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
641 stars 303 forks source link

AWSGlueETL artifact updated on maven without bumping the version #101

Closed GytisZ closed 3 years ago

GytisZ commented 3 years ago

The version of AWSGlueETL published to the AWS Maven repository has changed. (It's the package that glue-setup.sh installs).

It's still 1.0.0, however the hashes are different, the dependencies are different.

This has broken down our testing pipeline and wasted a lot of time tracking down the reason. It's also impossible for us to somehow "rollback" or choose a good time for the upgrade.

I'm not sure what else to say. Changing your published artifacts like that is a terrible engineering practice. This is not the first time this happens.

If you're changing the versions of the dependencies, or doing any changes - just publish 1.0.1. Please 🙏

(The repository in question)

    <repository>
      <id>aws-glue-etl-artifacts</id>
      <url>https://aws-glue-etl-artifacts.s3.amazonaws.com/release/</url>
    </repository>