RuntimeError: tensorflow/lite/kernels/reduce.cc:445 std::apply(optimized_ops::Mean<T, U>, args) was not true.tensorflow/lite/kernels/reduce.cc:445 std::apply(optimized_ops::Mean<T, U>, args) was not true.tensorflow/lite/kernels/reduce.cc:445 std::appl...
I've tried to reduce max_new_tokens to 223 and that fixes the error, but the resulting model is recognizing garbage now:
this this, this this, this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this this, this this this this this this this this this this this this this this this this this, this this this this this this this this this this, this this this this this this this this, this this this this this this this, this this this this this this, this this, this this, this this this this this, this this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this this, this, this, this, this this, this, this, this, this,
https://github.com/nyadla-sys/whisper.tflite/blob/main/models/generate_tflite_from_whisper.ipynb
TFLite model is created without errors, but on the last cell where tflite is validated signature runner throws an error:
I've tried to reduce max_new_tokens to 223 and that fixes the error, but the resulting model is recognizing garbage now: