-
Hi,
I am trying to trace crf.decode function in ml.inf2.8xlarge instance.
Here is the code I am trying to run.
def tags(output , mask):
a = model.crf.decode(output , mask)
a = torch…
-
I am running the Ubuntu 22 DLAMI, and trying to profile a simple kernel that performs exponentiation:
```
"""
Example kernel used to demmonstrate Neuron Profile.
"""
import torch
import neuronxc…
-
### Your current environment
```text
Collecting environment information...
WARNING 09-26 20:43:46 _custom_ops.py:18] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm.…
-
I am launching nccl.collective_permute on a trn1.32xlarge. Within the workload, each neuron core sends data to neighboring worker following a pre-specified topology. However, some of the workers exper…
-
Hi !
I was playing with JAX on Neuron recently and came across a bug that is quite annoying.
When trying to shard a very simple MLP layer, depending on the axis you choose, the compilation fails…
-
### Your current environment
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: D…
-
I am working on a use case of loading a model with parallel gpus, then unloading the model, and loading a new model in the same process.
```
@classmethod
async def unload_models(cls, exiting=…
-
Occasionally we get some CVODE test failures on NVHPC (see the full log on BB5 [here](https://gist.githubusercontent.com/bbpbuildbot/214991ed09a083c57d6b1d8bac89bcce/raw/0b22736523cad41859934f291645e1…
-
Do you plan to add support for Python 3.12 to the available list of images?
I am specifically interested in this inference AMI for an `inf1` instance type:
[public.ecr.aws/neuron/pytorch-inference…
-
There are no attributions or information on where these algorithms were originally developed.