issues
search
aws-neuron
/
aws-neuron-sdk
Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services
https://aws.amazon.com/machine-learning/neuron/
Other
420
stars
136
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
2.18.0 miscellaneous updates
#866
aws-rxgupta
closed
2 months ago
0
compiler_args not passed in for torch_neuronx.trace
#865
brianloyal
opened
2 months ago
3
Error: "Backward sending grads, but get None"
#864
wfckl789
closed
2 months ago
1
Internal Compiler error when compiling a model
#863
alexandrekm
closed
2 months ago
4
Dynamic batching in inference doesn't work when embedding layers are included and input is two tensors
#862
fabiozappo
closed
1 month ago
2
Embedding layer of ViT not supported with dynamic batch size
#861
fabiozappo
closed
2 months ago
1
tensor copy out too slow (XLATensor::ToTensor)
#860
aws-liuliiily
closed
2 months ago
0
[HF][Optimum] Compiling unet in stable diffusion XL pipeline failed since Neuron SDK 2.18
#859
JingyaHuang
opened
2 months ago
8
Need to use swap memory for loading (sdxl turbo) model, But I can't set it in sagemaker
#858
Suprhimp
opened
2 months ago
3
Neuron SDK Release 2.18.0
#857
aws-rxgupta
closed
3 months ago
0
Quantized `mistral` model on Inf2 with Neuron?
#856
jpaye
opened
3 months ago
4
Error when using torch.block_diag method
#855
joelamzn
closed
1 month ago
2
Issue on page /general/faq/training/neuron-training.html
#854
alexaprize-osman
opened
3 months ago
1
Mixtral-8x7B-Instruct-v0.1 | neuronx-cc compilation failure
#853
cyril-k
opened
3 months ago
2
Latest version of neuron-device-plugin (2.19.16.0) contains known security vulnerabilities
#852
WestonReed
opened
3 months ago
4
[Optimum-neuron]T5 tensor parallel official example not working as expected
#851
JingyaHuang
opened
3 months ago
5
chore: Update documentation for installing EFA device plugin to use official EKS chart
#850
bryantbiggs
opened
3 months ago
2
RuntimeError when running llama2_inference.ipynb
#849
crane-sapia
opened
3 months ago
1
Segmentation fault on neuronx when compiling model jinaai/jina-embeddings-v2-base-en
#848
dbertero-w
opened
3 months ago
3
Compatibility with xformers
#847
TommasoBendinelli
closed
3 months ago
2
[HF][Optimum] Weights Neff separation not implemented for PyTorch 2.X in Neuron SDK 2.17
#846
JingyaHuang
closed
2 months ago
2
Fix a typo in compiler faq.rst
#845
navyxliu
opened
4 months ago
1
facebook/detr-resnet-50 Compile Error
#844
feknall
opened
4 months ago
2
Error when trying to install aws-neuronx-dkms 2.* on the ubuntu-latest runner in GitHub Action
#843
tmotegi
closed
2 months ago
7
AttributeError in neuron_parallel_compile with NoneType compiled_hlo_status During Model Recompilation
#842
arashsadrieh
closed
2 weeks ago
4
``AttributeError: module 'mpmath' has no attribute 'rational'`` after installing torch-neuronx 2.1beta
#841
jeffhataws
opened
4 months ago
0
issue(blocking): neuron requires protobuf <3.20
#840
jhazenaai
opened
4 months ago
1
Cannot complete "Compiling and Deploying HuggingFace Pretrained BERT on Trn1 or Inf2" exercise due to error
#839
astanley-work
closed
4 months ago
1
Update index.rst.
#838
Almas222
closed
3 months ago
0
Issue(non-blocking): PIP compile install defaults to older versions of neuron-cc
#837
jhazenaai
closed
3 weeks ago
2
Dense / inaccessible stack trace while compiling model
#836
sallamander317
closed
1 month ago
6
Trying to trace a model via torch_neuronx but getting issue: RuntimeError: The following operation failed in the TorchScript interpreter
#835
ramsum56
closed
3 months ago
3
torch-neuronx pip package has erroneous requirements
#834
marty-sullivan
opened
4 months ago
2
Update tensorflow-neuron.rst
#833
mattman95
closed
4 months ago
1
Flan-UL2 | Compilation Failure
#832
chintanckg
opened
4 months ago
20
Compiler Crash on Differences in Slice Op
#831
xanderdunn
opened
4 months ago
1
Update pull_request_template.md
#830
musunita
opened
4 months ago
0
Error compiling StableDiffusionInstructPix2Pix - Access pattern out of bound. Instruction: identity_pool_1_I-6634-418669-tc Opcode
#829
yahavb
closed
1 month ago
2
Does AWS Neuron supports GPT2LMHeadModel from Hugging Face (pytorch) ?
#828
echatzikyriakidis
closed
4 months ago
2
[inf1][torch-neuron] WARNING:Neuron:No operator is placed on Neuron runtime; returning a CPU trace
#827
PigletOS
closed
5 months ago
2
[inf1][torch-neuron][performance] convolution performance gets worse when the resolution gets large compared to GPU.
#826
PigletOS
opened
5 months ago
1
Neuron compilation failed for LIama-2 70B with Optimum-neuron 0.0.17 within TGI-Neuron DLC
#825
Neo9061
opened
5 months ago
3
Inferentia performance is not desirable
#824
mostafafarzaneh
opened
5 months ago
2
Error on serving model using tensorflow_model_server_neuron
#823
mostafafarzaneh
closed
5 months ago
4
ValueError: Weight with shape torch.Size([8192, 1024]) cannot be sharded along dimension 1. This results in 25 weight partitions which cannot be distributed to 24 NeuronCores evenly
#822
Sadden
closed
4 months ago
3
How use custom signature with inf1 trace?
#821
mostafafarzaneh
closed
5 months ago
5
ERROR NEFF:neff_parse NEFF version: 2.0, features: 0x100 are not supported. Currently supporting: 0x80000000000000ff
#820
Sadden
closed
5 months ago
3
Compiler generated too many instructions (6888787). This maybe due to a failure in parallelism extraction by the tensorizer.
#819
Sadden
closed
3 months ago
4
Bump readthedocs-sphinx-search from 0.1.1 to 0.3.2
#818
dependabot[bot]
opened
5 months ago
0
Found security vulnerabilities in neuron-device-plugin:2.19.9.0 image
#817
Bin-security
closed
5 months ago
3
Previous
Next