aws-neuron aws-neuron-sdk issues

aws-neuron / aws-neuron-sdk

Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services

https://aws.amazon.com/machine-learning/neuron/

Other

420 stars 136 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

AWS NeuronX sdk installation

#916 Zkarape opened 2 days ago
2
neuron-distributed for inference

#915 sonic182 closed 2 days ago
1
DataParallel Support on CRF inference

#914 jyang-aws opened 3 days ago
1
Model doesn't support task text-classification for the neuron backend

#913 ldoff-tech42 opened 3 days ago
0
Issue on page /frameworks/torch/torch-neuronx/programming-guide/training/pytorch-neuron-programming-guide.html

#912 yahavb opened 5 days ago
0
ECS inf1 neuron hook script fails

#911 rantoniuk opened 1 week ago
2
Is it possible to compile a model when no NeuronCores are available?

#910 CozyDoomer closed 1 week ago
2
Update finetuning_llama2_7b_ptl.rst

#909 bevhanno opened 1 week ago
0
support for aten::upsample_nearest3d

#908 SimonRelu opened 1 week ago
0
Is there something wrong in torch_neuronx.trace ?

#907 mhokchuekchuek opened 1 week ago
2
Input tensors not being read torch neuronx 2.1.2

#906 PrateekAg1511 closed 3 days ago
4
Quite largely increased latency with weights/neff separated

#905 JingyaHuang opened 2 weeks ago
1
PDF print on the home page is empty when the left side is collapsed

#904 yishaigalatzer opened 2 weeks ago
1
BERT model implemented usiing TransformerEncoder returns all NaNs when running it torch==1.13.1

#903 sgaseretto opened 2 weeks ago
1
RuntimeError: Bad StatusOr access: INVALID_ARGUMENT: PJRT_Client_Create: error condition nullptr != (args)->client->Error(): Init: error condition !(num_devices > 0):

#902 PrateekAg1511 opened 2 weeks ago
3
Input tensor is not an XLA tensor: CPUFloatType while using crf.decode function

#901 PrateekAg1511 opened 2 weeks ago
4
JAX inference (Beta)

#900 eshalakhotia closed 3 weeks ago
0
Support for falcon 2 / falcon 2 vlm

#899 renos opened 3 weeks ago
1
Multiple models on torchserve

#898 brunonishimoto closed 2 weeks ago
5
Bad image quality for Stable Diffusion 1.5 after applying the optimized attenstion score

#897 JingyaHuang closed 20 hours ago
4
Added inf2 instance type

#896 jdwisman opened 1 month ago
0
k8s-neuron-device-plugin - LICENSE and Source

#895 adammw opened 1 month ago
0
NEFF Unable to open: kelf-b.json - 2 when loading in a model traced on 4 NeuronCores

#894 Bartosz-G opened 1 month ago
1
Error "ImportError: cannot import name 'packaging' from 'pkg_resources'" when using latest setuptools version 70

#893 jeffhataws opened 1 month ago
5
Failing to load a traced model

#892 brunonishimoto closed 1 month ago
3
Running Llama3 Returns Tensor Allocate Status 2

#891 pedrohernandezgeladocma opened 1 month ago
3
Doc issue: Inf2 data types has bad link for int8

#890 jimburtoft opened 1 month ago
1
Is F.interpolate support on neuronx-cc due to Unsupported CustomCall target: ResizeBilinear

#889 takipipo opened 1 month ago
1
When running BERT pretraining tutorial, seeing errors ``RuntimeError: unable to open file <> in read-only mode: No such file or directory ``

#888 jeffhataws opened 1 month ago
0
uninterruptible containers when neurons attached to it

#887 oOraph closed 1 month ago
6
`neuron_parallel_compile` fails when an non utf-8 character

#886 michaelbenayoun opened 1 month ago
1
docs: add copybutton

#885 clumsy opened 1 month ago
0
Compilation failed for llama3-70B model - Estimated peak HBM usage (22.839451) exceeds 16GB. Neff won't be able to load on chip

#884 ak-org opened 1 month ago
3
Compilation Error with torch_neuronx.trace on EC2 inf2.xlarge

#883 SergioMartinezAvahitech opened 1 month ago
5
Error: MPMD detected but reload is not supported yet

#882 wfckl789 closed 1 month ago
1
Internal tensorizer error when trying to compile and train a simple CNN

#881 sgaseretto opened 1 month ago
3
Llama-3 inference samples and performance metrics update

#880 aws-rxgupta closed 1 month ago
0
optimum_neuron sample with sd_15_512

#879 yahavb opened 2 months ago
0
Internal tensorizer error on RWKV model

#878 pm-mck opened 2 months ago
4
Neuron SDK Release 2.18.2

#877 micwade-aws closed 2 months ago
0
Converting TF2 MaskRCNN model to NeuronX on Inf2 instance fails

#876 saintarian closed 1 month ago
2
Issue while installing torch-neuronx==2.1.*

#875 bindu-0107 opened 2 months ago
3
fix: remove redundant namespace of cluster-scoped resource

#874 djmcgreal-cc opened 2 months ago
0
LLM engine not using Neuron device with continuous batching using vLLM

#873 ashwinikumar-sa closed 2 months ago
2
Failure on neuron-cc compilation when a nn model is moved to Neuron device

#872 wfckl789 opened 2 months ago
2
add section on additional nrt logging controls

#871 aws-rxgupta closed 2 months ago
0
Neuron v2.18.0 Performance Updates

#870 aws-rxgupta closed 2 months ago
0
Bug in `configure_pjrt_environment`

#869 michaelbenayoun opened 2 months ago
1
torch.argsort crashes when tensor is on Neuron device

#868 evellasques opened 2 months ago
1
Neuron SDK Release 2.18.1

#867 awsjoshir closed 2 months ago
0