coiled / benchmarks

BSD 3-Clause "New" or "Revised" License
28 stars 17 forks source link

Fix local pyspark for osx #1505

Closed fjetter closed 5 months ago

fjetter commented 5 months ago

This is a follow up from https://github.com/coiled/benchmarks/pull/1490 and supersedes https://github.com/coiled/benchmarks/pull/1492

It also changes the blocking call for spark from show to collect. Nothing changes really but we won't print the result. I think this is the closest there is to an ordinary compute