preview spark results using `tail` method

h2oai / db-benchmark

reproducible benchmark of database-like ops

https://h2oai.github.io/db-benchmark

Mozilla Public License 2.0

322 stars 85 forks source link

Closed jangorecki closed 4 years ago

jangorecki commented 4 years ago

tail method for spark is not a "won't fix" feature already, there is PR https://github.com/apache/spark/pull/26809 once released we should use this in data validation, similarly as we do for every other solution.

jangorecki commented 4 years ago

this method will be added in spark 3.0 which is not yet released