search

fugue-project / fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
https://fugue-tutorials.readthedocs.io/
Apache License 2.0
1.92k stars 94 forks source link

[BUG] Spark connect import issue on worker side #544

Closed goodwanghan closed 3 weeks ago

goodwanghan commented 3 weeks ago

Describe the bug On certain environment, importing spark connect here causes problems, and it is not an import error

Expected behavior Although worker side could import this file for doing nothing, we need to handle the error. So we should just relax the import error.