search

mrpowers-io / spark-fast-tests

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
https://mrpowers-io.github.io/spark-fast-tests/
MIT License
429 stars 77 forks source link

Compare Row Contents #109

Open mikenac opened 2 years ago

mikenac commented 2 years ago

I would love to see something that allows for the comparison of the data from a single row in one frame to the data from a single row in another frame. This is especially important when comparing very wide frames. For instance, comparing the string representation of 60 columns to find out what is different is very tedious.

wrschneider commented 1 year ago

Agree, the approach of printing the whole row doesn't work well with wide dataframes.

It's really hard to spot the one column that's different out of 60