issues
search
aws-neuron
/
aws-neuron-sdk
Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services
https://aws.amazon.com/machine-learning/neuron/
Other
464
stars
154
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
remove markdown formatting in ScalarE activation_accum code block
#989
starskyreverie
opened
2 months ago
0
Eager debug mode urllib3 error
#988
gbpdt
opened
2 months ago
5
Number of instructions (8658944) is over the threshold (5000000)
#987
hasadata
closed
1 month ago
7
2.20 Performance page updates, runtime release notes, and minor documentation updates
#986
aws-trsharma
closed
2 months ago
0
Neuron Runtime Release Notes for SDK 2.20
#985
aws-trsharma
closed
1 month ago
0
Neuron Runtime Release Notes for SDK 2.20
#984
aws-trsharma
closed
2 months ago
0
Conversion of YOLOv8x torchscript to torch_neuron failing
#983
Harish-Sundaravel
opened
2 months ago
0
Adding Helm Chart, Node problem detector and Github repos
#982
aws-trsharma
closed
2 months ago
0
Neuron SDK Release 2.20.0
#981
aws-trsharma
closed
2 months ago
0
Llama-3-70B compiles in 8-bit on inf2.24xlarge but doesn't start: error in TDRV:dma_queue_init_batch_execute
#980
juliensimon
opened
2 months ago
1
Compiling SD1.5 for Neuron with resolution 512x768 fails
#979
mludvig
opened
2 months ago
0
[Pytorch] Inf1, neuron-cc stuck and memory keep incresing to 100G
#978
PigletOS
opened
2 months ago
0
Update container devflows link to target the right place
#977
nikhilym
closed
2 months ago
0
Compiling YOLOX model error
#976
mvinci12
opened
2 months ago
0
[PyTorch] cxx11 ABI support (torch-neuronx)
#975
eshalakhotia
opened
3 months ago
0
[PyTorch] Top-p sampling on device
#974
eshalakhotia
opened
3 months ago
0
[PyTorch] Diffusion-Transformer (image generation) for inference
#973
eshalakhotia
opened
3 months ago
0
[PyTorch] FP8 KV Cache (weights only)
#972
eshalakhotia
opened
3 months ago
0
[PyTorch] INT8 for inference (weights only)
#971
eshalakhotia
opened
3 months ago
0
[PyTorch] LLaVA model inference
#970
eshalakhotia
opened
3 months ago
0
[PyTorch] Multi-LoRA inference
#969
eshalakhotia
opened
3 months ago
0
[PyTorch] Paged attention in vLLM
#968
eshalakhotia
opened
3 months ago
0
[PyTorch] Combined Continuous Batching and Speculative Decoding
#967
eshalakhotia
opened
3 months ago
0
[PyTorch] Conformer (WeNet BestRQ) model inference
#966
eshalakhotia
opened
3 months ago
0
[JAX] JAX inference support
#965
eshalakhotia
opened
3 months ago
0
[PyTorch] INT8 compute for inference
#964
eshalakhotia
opened
3 months ago
0
[PyTorch] DBRX model inference with Continuous batching
#963
eshalakhotia
opened
3 months ago
0
[JAX] JAX training support
#962
eshalakhotia
opened
3 months ago
0
[PyTorch] PEFT LoRA support
#961
eshalakhotia
opened
3 months ago
0
[PyTorch] NxD Training Launch (Beta)
#960
eshalakhotia
opened
3 months ago
0
[PyTorch] LlaVA model training
#959
eshalakhotia
opened
3 months ago
0
[PyTorch] Video-LLaVA model training
#958
eshalakhotia
opened
3 months ago
0
[PyTorch] PEFT QLoRA
#957
eshalakhotia
opened
3 months ago
1
[PyTorch] DBRX model training support [Beta]
#956
eshalakhotia
opened
3 months ago
0
[PyTorch] Fully Sharded Data Parallel (FSDP)
#955
eshalakhotia
opened
3 months ago
0
[PyTorch] WeNet BestRQ (Conformer) model training support
#954
eshalakhotia
opened
3 months ago
0
[PyTorch] Diffusion Transformers (DIT) model training
#953
eshalakhotia
opened
3 months ago
0
[PyTorch] ORPO (model alignment)
#952
eshalakhotia
opened
3 months ago
0
[PyTorch] PPO (model alignment)
#951
eshalakhotia
opened
3 months ago
0
[PyTorch] DPO (model alignment)
#950
eshalakhotia
opened
3 months ago
0
[JAX] MoE Support
#949
eshalakhotia
opened
3 months ago
1
Compilation failure - Unhandled exception with message: tensor size must be more than 0, input1_set
#948
ariveram2111
opened
3 months ago
1
Compilation failure - Internal tensorizer error: NeuronValueNumbering:insertAtEnd()
#947
ariveram2111
opened
3 months ago
1
Issue on page /general/models/index.html
#946
Almas222
closed
3 months ago
2
Error during driver installation: aws-neuron
#945
ssotank
closed
3 months ago
4
Compiling model using torch.neuron in local is possible, but compiling model using torch.neuronx in local is not possible.
#944
newgrit1004
closed
3 months ago
2
Trying to get the NEFF file when using the tensorflow neuronx trace API
#943
kandakji
closed
3 months ago
1
Is it possible to compile and create model graph for Inf2 instance on a CPU only instance using neuronx-cc compiler
#942
samarth1612
opened
3 months ago
5
[Brainstorming] Computation Placement on NeuronCore Engines
#941
JigaoLuo
closed
2 months ago
3
Please add Qwen/Qwen2-7B model to the neuron cache
#940
jas0n1iu
opened
3 months ago
1
Previous
Next