Open mon95 opened 12 months ago
What's your version of tensorflow-text package? Is it a 2.9.x version? If not, could you please try to install it to a 2.9.x version? And also upgrade python to python 3.8 at least?
Thanks.
Thank you for looking into this!
Tensorflow_text is version 2.9.0 Tensorflow_transform is version 1.10.0 And, I tried upgrading the python version (now 3.9.18) and I still get the same error.
Any chance that the tensorflow_transform
usage is causing issues? The model contains transform layers which depend on the tensorflow_transform
package.
Describe the bug I'm seeing a
UnicodeDecodeError: 'ascii' codec can't decode byte 0xff in position 1024: ordinal not in range(128)
. The code in tf_utils.py (https://github.com/onnx/tensorflow-onnx/blob/main/tf2onnx/tf_utils.py#L57) seems to mark this as expected, but the fallback tonp.vectorize(lambda x: x.decode('UTF-8'))
also seems to fail with a similar errorUnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 1024: invalid start byte
Urgency N/A
System information
To Reproduce The model is a custom DCN v2 model built using libraries from the tensorflow ecosystem. This includes TFRS (recommender systems), TFR (ranking), TF Text, TF IO, and TF Transform. The model is saved using
tf.saved_model.save(..)
.Screenshots
Additional context
tensorflow_text
. In order to do this, I have a custom script (shared below) which invokestf2onnx.convert.main()
.I've tried switching my numpy version to 1.20 as mentioned in one of the github issues, but this doesn't seem to work either. Would appreciate your help with this!