Closed samir-souza closed 1 year ago
Hi @samir-souza,
Are you able to reproduce this from the main
branch?
Also could you provide a command line to reproduce it please? I dont observe it myself when running a text-classification example.
@michaelbenayoun Just tested with main and it is working well now. I'll close this ticket, given this issue is fixed. (FYI, I used the linked notebooks to run the experiments)
tested versions: optimum-neuron versions 0.0.8 and 0.0.9
I'm training a bert-base-uncased as a binary text classifier with spam/not spam dataset (Deysi/spam-detection-dataset). The training works perfectly on an trn1.2xlarge, however the evaluation step raises an exception which complains about the line:
input_names = inspect.signature(model.forward).parameters.keys() ValueError: invalid method signature
Notebooks used to reproduce the error:
01 data prep 02 model training
aws-neuronx-runtime-discovery 2.9 libneuronxla 0.5.391 neuron-cc 1.17.0.0+1810fd7ed neuronx-cc 2.8.0.25+a3ad0f342 neuronx-distributed 0.2.0 neuronx-hwm 2.8.0.3+2b7c6da39 torch-neuronx 1.13.1.1.9.0 torch-xla 1.13.1+torchneuron8 transformers-neuronx 0.5.58