This PR adds oci-add-hooks package to the ECS AL2023 Neuron AMI. We install this package on the AL2 (and AL2 Kernel 5.10) INF AMIs today.
Implementation details
scripts/enable-ecs-agent-inferentia-support.sh: Removed the condition that skips installation on anything other than the AL2 (and AL2 Kernel 5.10) INF AMIs. Only the AL2 (and AL2 Kernel 5.10) INF and AL2023 NEU ECS AMI recipes consume this code, so it is safe to remove the condition completely.
Testing
Built a test AMI and ran our agent and AMI functional tests against it. They passed.
Follow the docker runtime setup for OCI neuron as described in this AWS neuron tutorial.
Confirmed that the docker daemon is able to configure the oci-neuron runtime correctly on the test AMI, by inspecting docker daemon logs.
Also compared it against the latest available ECS AL2023 Neuron AMI where the daemon runs into an error due to the missing oci-add-hooks package.
Build a pytorch neuron container image and run a container with a neuron device configured, as described in this tutorial.
The docker container runs successfully on my instance using the test AMI.
Summary
This PR adds oci-add-hooks package to the ECS AL2023 Neuron AMI. We install this package on the AL2 (and AL2 Kernel 5.10) INF AMIs today.
Implementation details
scripts/enable-ecs-agent-inferentia-support.sh
: Removed the condition that skips installation on anything other than the AL2 (and AL2 Kernel 5.10) INF AMIs. Only the AL2 (and AL2 Kernel 5.10) INF and AL2023 NEU ECS AMI recipes consume this code, so it is safe to remove the condition completely.Testing
oci-add-hooks
package.Build a pytorch neuron container image and run a container with a neuron device configured, as described in this tutorial.
The docker container runs successfully on my instance using the test AMI.
Whereas, the same setup fails on the latest available ECS AL2023 Neuron AMI.
New tests cover the changes: N/A
Description for the changelog
Enhancement: add oci-add-hooks package to the ECS AL2023 Neuron AMI.
Licensing
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.