-
Hi, I found the error `MPMD detected but reload is not supported yet` will occur if I open `Eager Debug Mode` for a model trained in neuron distributed environment where dp=1, tp=8, pp=4. Could you he…
-
Select input model, base model (analog madness v7) in this case.
It works at 512x512 on cpu/gpu, larger throws:
INFO UNet2DConditionModel: 64, 8, 768, False, False …
-
@philschmid
big fan of your work.
Referring - https://www.philschmid.de/inferentia2-llama3-70b
Trying to recompile the llama3 70b with different parameters on an inferentia inf2.48xlarge ma…
-
There are no attributions or information on where these algorithms were originally developed.
-
I hope this is the right place to ask this question. Let me know if I need to move to another repo.
Currently I'm using `NeuronModelForCausalLM`.
I have a use case where I need to be able to do …
-
Hello!! I am analysing some data and I need to get a .txt file containing the neuron ID, the time at which each spike of that neuron occurs and the points that form the concrete waveform of that spike…
-
Model generates only garbage.
Sample: https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/llama-3-8b-32k-sampling.ipynb
NeuronSDK2.19 PyTorc…
-
Hi, I'm trying to make compatible a Clip model using neuron-distributed (because I'm gonna continue with a multimodal after it)
Currently in my notebook, insidea inf2.xlarge ubuntu 22, I have:
…
-
Hello,
Can you provide an example for the weights used? It will help me understand the format in which they must be provided
```
#include "weights.h"
#include "weights_layer0.h"
#include "weigh…
-
Trying to run t5 model using optimum neuron and run_summarization script leads to failure.
4 experiments were run:
1. ON 0.0.18 using the script on ON github
2. ON 0.0.14 using the script on ON gi…