awslabs / amazon-emr-on-eks-custom-image-cli

Amazon EMR on EKS Custom Image CLI
Apache License 2.0
25 stars 9 forks source link

Add emr-6.15.0 release #31

Open Carmenliukang opened 5 months ago

Carmenliukang commented 5 months ago

Issue #, if available:

Description of changes:

Update support to emr-6.15.0 release

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Tested end to end for emr-6.15.0:

Amazon EMR on EKS - Custom Image CLI
Version: 1.06
... Checking if docker cli is installed
... Checking Image Manifest
[INFO] Image ID: e3c6ac0839ccfe22f207e829089bacb9de0f90b63d3c5f3d285fc7af966ec17c
[INFO] Created On: 2024-01-09T05:43:08.645625466Z
[INFO] Default User Set to hadoop:hadoop : PASS
[INFO] Working Directory Set to /home/hadoop : PASS
[INFO] Entrypoint Set to /usr/bin/entrypoint.sh : PASS
[INFO] JAVA_HOME is set with value: /etc/alternatives/jre : PASS
[INFO] SPARK_HOME is set with value: /usr/lib/spark : PASS
[INFO] File Structure Test for spark-jars-6-12 in /usr/lib/spark/jars: PASS
[INFO] File Structure Test for spark-jars-6-13 in /usr/lib/spark/jars: PASS
[INFO] File Structure Test for spark-jars-6-15 in /usr/lib/spark/jars: PASS
[INFO] File Structure Test for hadoop-jars-6-15 in /usr/lib/hadoop/lib: PASS
[ERROR] hadoop-openstack MUST be in /usr/lib/hadoop : FAIL
... Start Running Sample Spark Job
[INFO] File Structure Test for hadoop-files-6-15 in /usr/lib/hadoop: PASS
[INFO] Sample Spark Job Test with local:///usr/lib/spark/examples/jars/spark-examples.jar : PASS
-----------------------------------------------------------------
Custom Image Validation Failed. Please see individual test results above for detailed information.
-----------------------------------------------------------------

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Carmenliukang commented 4 months ago

@amazon-auto @zhuyulin27 Please review, many thanks.