JohnSnowLabs / spark-nlp

State of the Art Natural Language Processing
https://sparknlp.org/
Apache License 2.0
3.88k stars 711 forks source link

RuntimeError: Java gateway process exited before sending its port number #14443

Closed ska-ibees closed 1 week ago

ska-ibees commented 3 weeks ago

Is there an existing issue for this?

Who can help?

@maziyarpana

What are you working on?

https://github.com/JohnSnowLabs/spark-nlp/blob/master/examples/python/llama.cpp/PromptAssember_with_AutoGGUFModel.ipynb

Current Behavior

With latest 5.5.1 version unable to start spark session. Seems spark package for v 5.5.1 hasn't published yet.

Expected Behavior

Spark session should be started.

Steps To Reproduce

Run this colab: https://github.com/JohnSnowLabs/spark-nlp/blob/master/examples/python/llama.cpp/PromptAssember_with_AutoGGUFModel.ipynb

Spark NLP version and Apache Spark

SPARKNLP="5.5.1" PYSPARK="3.2.3"

Type of Spark Application

Python Application

Java Version

No response

Java Home Directory

No response

Setup and installation

No response

Operating System and Version

No response

Link to your project (if available)

No response

Additional Information

error:

RuntimeError Traceback (most recent call last) in <cell line: 4>() 2 3 # let's start Spark with Spark NLP with GPU enabled. If you don't have GPUs available remove this parameter. ----> 4 spark = sparknlp.start() 5 print(sparknlp.version())

6 frames /usr/local/lib/python3.10/dist-packages/pyspark/java_gateway.py in launch_gateway(conf, popen_kwargs) 106 107 if not os.path.isfile(conn_info_file): --> 108 raise RuntimeError("Java gateway process exited before sending its port number") 109 110 with open(conn_info_file, "rb") as info:

RuntimeError: Java gateway process exited before sending its port number

image

maziyarpanahi commented 2 weeks ago

Hi @ska-ibees

The command to publish the Maven artifacts failed unfortunately. The package is now available and published successfully on the Maven.

Could you please try again?

ska-ibees commented 1 week ago

Hi @maziyarpanahi Issue has been resolved. Thanks

maziyarpanahi commented 1 week ago

Hi @ska-ibees Thanks for confirming! 👍🏼