aws-neuron / aws-neuron-sdk

Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services
https://aws.amazon.com/machine-learning/neuron/
Other
420 stars 136 forks source link

AWS NeuronX sdk installation #916

Open Zkarape opened 4 days ago

Zkarape commented 4 days ago

Hello, I am struggling with this error while installing neuronx both locally and on a SageMaker notebook instance on ml.m5.xlarge instance. Guide me please how to install correctly to compile my model to deploy on inf2 instance. If you need more info, let me know.

File ~/anaconda3/envs/python3/lib/python3.10/site-packages/tensorflow_neuronx/init.py:1 ----> 1 raise ImportError("WRONG PACKAGE. Please install the package from Neuron Repository - pip.repos.neuron.amazonaws.com")

ImportError: WRONG PACKAGE. Please install the package from Neuron Repository - pip.repos.neuron.amazonaws.com

I will highly appreciate any help and guidance.

jyang-aws commented 3 days ago

Hi Zkarape, could you follow these steps https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/ubuntu/torch-neuronx-ubuntu20.html#setup-torch-neuronx-ubuntu20 based on your OS? Please make sure to include python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com/ Let us know if you still see any issues on the setup.

Zkarape commented 2 days ago

Thanks a lot for reaching out. Sure, I will try and let you know.

Regards, Zhenya.

On Thu, Jun 27, 2024 at 10:33 PM jyang-aws @.***> wrote:

Hi Zkarape, could you follow these steps https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/ubuntu/torch-neuronx-ubuntu20.html#setup-torch-neuronx-ubuntu20 based on your OS? Please make sure to include python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com/ Let us know if you still see any issues on the setup.

— Reply to this email directly, view it on GitHub https://github.com/aws-neuron/aws-neuron-sdk/issues/916#issuecomment-2195430364, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZKBB6SCHYNEMMZHVNC33P3ZJRLF7AVCNFSM6AAAAABJ6HZQE6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOJVGQZTAMZWGQ . You are receiving this because you authored the thread.Message ID: @.***>