huggingface / optimum-neuron

Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
Apache License 2.0
176 stars 53 forks source link

Add setup runtime step for K8S #541

Closed glegendre01 closed 3 months ago

glegendre01 commented 3 months ago

What does this PR do?

After moving the Inferentia2 builder to Kubernetes, only the AWS Neuron dkms driver is installed on each builder. This adds an installation step to add other tools.

Fixes # (issue)

Before submitting