huggingface / optimum-neuron

Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.

Apache License 2.0

196 stars 59 forks source link

upgrade optimum and then install optimum-neuron #533

Closed shub-kris closed 5 months ago

shub-kris commented 6 months ago

What does this PR do?

This PR fixes issue #532 and applies the fix suggested by @dacorvo here: https://github.com/huggingface/optimum-neuron/issues/142#issuecomment-2022448325

Fixes # (issue)

Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

dacorvo commented 6 months ago

Let's improve tests to make sure it really works.

shub-kris commented 6 months ago

Let's improve tests to make sure it really works.

It doesn't work, when I try

JingyaHuang commented 5 months ago

My recent commits shall solve the installation issue, could you review it? Tested with ami-0b40b2acbce648147, the cli works as expected and the issue reported #545 is also solved. @dacorvo @philschmid @shub-kris