Open crypdick opened 3 years ago
First of all, thanks for these great hooks!
It would be nice if I could use this without PySpark, though. I use Ray for my sub-node parallelization, so PySpark is a pretty heavy unneeded package.
First of all, thanks for these great hooks!
It would be nice if I could use this without PySpark, though. I use Ray for my sub-node parallelization, so PySpark is a pretty heavy unneeded package.