Open pinak-p opened 5 hours ago
Hi @pinak-p,
What's the neuron-sdk and optimum-neuron version that you are using? I just tested with the following setup, and I have compiled the models without any issue:
aws-neuronx-collectives/unknown,now 2.22.26.0-17a033bc8 amd64 [installed]
aws-neuronx-dkms/unknown,now 2.18.12.0 amd64 [installed]
aws-neuronx-runtime-lib/unknown,now 2.22.14.0-6e27b8d5b amd64 [installed]
aws-neuronx-tools/unknown,now 2.19.0.0 amd64 [installed]
aws-neuronx-runtime-discovery 2.9
diffusers 0.30.3
libneuronxla 2.0.4115.0
neuronx-cc 2.15.128.0+56dc5a86
neuronx-distributed 0.9.0
optimum 1.22.0
optimum-neuron 0.0.25.dev0
sentence-transformers 3.1.0
torch 2.1.2
torch-neuronx 2.1.2.2.3.0
torch-xla 2.1.4
torchvision 0.16.2
transformers 4.43.2
transformers-neuronx 0.12.313
Thank you, it succeeds after I upgrade the dependencies.
System Info
Who can help?
@JingyaHuang
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction (minimal, reproducible, runnable)
optimum-cli export neuron --model stabilityai/stable-diffusion-2-1-base --batch_size 1 --height 512 --width 512 --auto_cast matmul --auto_cast_type bf16 --num_images_per_prompt 1 . /sd_neuron/
The above command throws the below error
Expected behavior
The model should successfully be exported.