search

apache / incubator-graphar

An open source, standard data file format for graph data storage and retrieval.
https://graphar.apache.org/
Apache License 2.0
195 stars 40 forks source link

[Feat][Spark][PySpark] Introduce "SPARK_TESTING" environ variable into all spark tests #404

Closed SemyonSinchenko closed 3 months ago

SemyonSinchenko commented 3 months ago

Is your feature request related to a problem? Please describe. "SPARK_TESTING" variable, when it is set, may significantly increase the setUp of all Spark/PySpark tests. For example, when it set to "1", Spark UI initialization is disabled. A lot of other initializations are simplified too.

Describe the solution you'd like All Spark/PySpark tests (except becnhmarks) are running with SPARK_TESTING=1

Describe alternatives you've considered .

Additional context .