Closed maziyarpanahi closed 2 months ago
Hi @maziyarpanahi
I haven't been able to replicate the error. I tried in Google Colab with T4 but it is working for spark-np 5.2.0. Can you take a look at this notebook, reproduce the error and let me know
Hi @danilojsl
You forgot to load ONNX GPU build in start function: spark = sparknlp.start(gpu=True)
. Once the session is started with the GPU build of ONNX and TF, the ONNX models will fail with that error
Some extra information, I can use A100 GPUs without any issue. So this must be something with Colab itself, it is either missing something (lib) or it has them but a different versions. (usually older, so for GPU we usually do something in the Colab script-setup to fix those)
@danilojsl Let's find out what's missing and how to fix them, then we can modify the GPU installation for Colab accordingly:
Hi @maziyarpanahi
This issue is no longer presented with the latest update of ONNX in spark-nlp 5.4.0.
Thanks @danilojsl
Is there an existing issue for this?
Who can help?
@danilojsl
What are you working on?
Downloading and loading models on ONNX over GPU devices crashes. (at least on T4 on Colab)
Current Behavior
Crashes with:
Expected Behavior
Should work before upgrading to newer version of Spark NLP
Steps To Reproduce
!pip install spark-nlp pyspark
Spark NLP version and Apache Spark
Spark NLP version 5.2.0 Apache Spark version: 3.5.0
Type of Spark Application
Python Application
Java Version
11
Java Home Directory
No response
Setup and installation
No response
Operating System and Version
No response
Link to your project (if available)
No response
Additional Information
No response