Importing models into Spark NLP in TensorFlow and ONNX formats

[maziyarpanahi]

Assigning members to test importing models in TensorFlow and ONNX formats to Spark NLP. (please use the latest transformers and optimum libraries on Colab)

• TensorFlow

• ONNX

        > Hi @TerryLaw535

  To import T5 models (fine-tuned or already on HF) you can use one of these 2 notebooks:

  • TensorFlow: https://github.com/JohnSnowLabs/spark-nlp/blob/master/examples/python/transformers/HuggingFace%20in%20Spark%20NLP%20-%20T5.ipynb
  • ONNX: https://github.com/JohnSnowLabs/spark-nlp/blob/master/examples/python/transformers/onnx/HuggingFace_ONNX_in_Spark_NLP_T5.ipynb

  Depending on which one you have saved (exported) your T5 model, you can follow the instructions to import your model into Spark NLP. (I personally recommend first trying ONNX, it has a faster inference time)

hi maziyarpanahi, thanks for your resource, however, I tried different transformers, tensorflow versions but none of them worked, basically there are all kinds of errors. And the code doesn't work on colab correctly either. Could you please check it out? Thank you so much!

Originally posted by @Alexwangziyu in https://github.com/JohnSnowLabs/spark-nlp/issues/14215#issuecomment-2021936426