-
I am using the newest AMI image from yesterday, with optimum-neuronx 0.0.17 (https://aws.amazon.com/marketplace/pp/prodview-gr3e6yiscria2) I have not tried using another image yet.
I am trying to …
-
Hi team, when trying to bump Optimum Neuron to the latest Neuron sdk 2.18 release, we notice that the compilation of unet for SDXL model failed with the latest compiler. Here are more details about th…
-
####
**Lab Name**: Biosignal Processing and Analysis Lab
**Department**: Biotechnology and Biomedical Engineering
**List of Experiments and Repositories**:
1: Bio signal import and channe…
-
Hi team,
The Optimum Neuron team observed a quite large difference in latency when the model is compiled with non-inlined weights/neff.
## TL;DR
**The latency of non-inlined sd models is al…
-
Compiling and loading Llama 2 in Neuron is working great for me on a `inf2.8xlarge` with the new release `2.16`.
However, I have a unique use case where I need to be able to input embeddings direct…
-
The mpi issue with nrniv -python was indeed due to conflicts between anaconda and venv
the issue is more general and results in an error if you run nrninv -python and then from neuron import h
it’…
-
Hi!
I am trying to see how tstellate cells are activated with stimuli with example file *test_physiology.py*.
I added two lines of code:
tstellate_cell_ids = self.tstellate.select(cells_per_ban…
-
When I try to add the following metadata:
```
{
"description": "Code to accompany the paper \"Modeling unitary fields and the single-neuron contribution to local field potentials in the hip…
-
### System Info
```shell
accelerate==0.31.0
aiohttp==3.9.5
aiosignal==1.3.1
anyio==4.3.0
async-timeout==4.0.3
attrs==23.2.0
backcall==0.2.0
bitsandbytes==0.43.1
boto3==1.34.124
botocore==1.3…
-
I started a `inf2.48xlarge` ec2, pull and get into [TGI-Neuron DLC with optimum-neuron 0.0.17 installed](https://github.com/aws/deep-learning-containers/releases/tag/v1.0-hf-tgi-0.0.17-pt-1.13.1-inf-n…