turgut090 / transformers

Blog post
1 stars 0 forks source link

Input, partially corrupted/incompatible? #2

Open dirkwalther opened 1 year ago

dirkwalther commented 1 year ago

Hi thanks for the code. Depending on the subset of reviews, I get the following error. I suspect that there are some reviews that do not get embedded correctly. Could that be? Best wishes, Dirk

Epoch 1/5 2/25 [=>............................] - ETA: 16s - loss: 6.3396 - auc_17: 0.5000 Error in py_call_impl(callable, call_args$unnamed, call_args$named) : tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[1,47] = -2147483648 is not in [0, 50257) [[node model_14/tfgp_t2model_10/transformer/wte/Gather (defined at /transformers/modeling_tf_utils.py:1461) ]] [Op:__inference_train_function_474494]

Errors may have originated from an input operation. Input Source operations connected to node model_14/tfgp_t2model_10/transformer/wte/Gather: model_14/tfgp_t2model_10/transformer/Reshape (defined at /transformers/models/gpt2/modeling_tf_gpt2.py:300)

Function call stack: train_function

Run reticulate::py_last_error() for details.