-
## Description
Currently, the options for [Transformers-NeuronX Engine in LMI](https://docs.djl.ai/master/docs/serving/serving/docs/lmi/tutorials/tnx_aot_tutorial.html) don't include the possibility …
-
Hello,
I am currently working on applying the model to the FlyWire Dataset v783. However, I am unsure of the proper method to create the complete list of Flywire neurons as a CSV file, as well as t…
-
I am facing an issue with pynestml.codegeneration.nest_code_generator_utils. I am trying to run stdp_windows.ipynb in the EBRAIN jupyterlab environment.
`module_name, neuron_model_name, synapse_mo…
-
I want to know how we can run the speculative decoding(Assisted Generation) to increase the token/sec for llama2 based model for optimum.neuron to run on inf2. Similar to what transformers have done f…
-
I'm trying to quantize a Mistral (7B) model to run with `aws-neuron` on an `Inf2` instance
It seems like the [`int8 weight storage`](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/librarie…
jpaye updated
4 months ago
-
I created a workshop/tutorial for Amazon SageMaker + HF Optimum Neuron and in the notebooks I extract some metadata from Optimum Neuron to plot tables of compatible models for training and inference. …
-
In order to be usable by the neuroscience community, we would at least need to add:
- [Izhikevich model](https://www.izhikevich.org/publications/spikes.pdf)
- [Hodgkin-Huxley model](https://neuronal…
-
![A GIF or MEME to give some spice of the internet](https://media.giphy.com/media/HzPtbOKyBoBFsK4hyc/giphy.gif?cid=790b7611uxgwd2nty2bphzkapx144myrtpfsy3xddweznfgf&ep=v1_gifs_search&rid=giphy.gif&…
-
## Context
There is a limit of 64 species in eion.cpp, see comment in the code:
```
/* an embarassing hack */
/* up to 32 possible ions */
/* continuously compute a bitmap that al…
-
### Your current environment
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC version: (U…