search

aws-neuron / aws-neuron-samples

Example code for AWS Neuron SDK developers building inference and training applications
Other
101 stars 32 forks source link

TypeError: Got unsupported ScalarType BFloat16 #33

Closed eric80116 closed 9 months ago

eric80116 commented 9 months ago

When running the "Compile the model into an optimized TorchScript and save the TorchScript" step on the torch-neuronx/inference/hf_pretrained_sd2_512_inference.ipynb and got the error of "Got unsupported ScalarType BFloat16"

jeffhataws commented 9 months ago

Hi @eric80116, thanks for filing the issue. This is a known issue. Will you try the solution in https://github.com/aws-neuron/aws-neuron-samples/issues/31 ?

eric80116 commented 9 months ago

Fixed it. Thanks