-
** What's the problem: **
Presently, deploying [Neuron plugins for k8s](https://github.com/aws-neuron/aws-neuron-sdk/tree/v2.11.0/src/k8) requires manual configuration using YAML files, which can b…
-
-
As there is more demand for LoRA based fine-tuning of models, we would like to have support for it in Optimum Neuron to optimize the user experience. We need to make sure that it can effectively use t…
-
————————env lib detail:——————————————
inf2.24xlarge
ubuntu@ip-172-31-12-212:~/vllm$ pip list|grep -i neuron
aws-neuronx-runtime-discovery 2.9
libneuronxla 2.0.755
neuro…
-
[The model](https://github.com/ModelDBRepository/136095/) fails with:
```plaintext
-Segmentation violation
-Backtrace:
- /lib/x86_64-linux-gnu/libc.so.6 : ()+0x42520
- %model_dir%/x86_64/libnrn…
-
This issue occurs when building a layer with the maximum number of possible unqiue connections. For example, a layer with three neurons should have three possible connections: (0, 1), (1, 2) and (0, 2…
-
Here is a long-term issue for the request of adding new neuron models.
-
The query has changed; will need something like this to quickly pull in all zettels.
```vim
let l:cmd = g:neuron_executable.' -d "'.g:neuron_dir.'" query --cached | jq ".result | .vertices | to_e…
-
hello,
i am trying to test the sentiment neuron approach in https://github.com/openai/generating-reviews-discovering-sentiment over a new dataset.
I trained the model on my dataset, this generates…
-
Neuron SDK has released beta support for PyTorch 2.0 in the 2.15 release with a new PJRT runtime. This needs to be supported by Optimum Neuron if running with PT 2.0