search

twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.5k stars 706 forks source link

Actually fix exponential TypedPipe equality #1798

Closed johnynek closed 6 years ago

johnynek commented 6 years ago

We were actually not solving the exponential complexity problem on TypedPipe equality. With this, we have a test that it was exponentially slow, then fix it.

Without this, applying rules is exponentially slow, which is obviously no good.

non commented 6 years ago

This looks good to me. 👍

In the long run it would be nice for the timing/algorithmic complexity testing code to be pulled out in a more generic place so we could use it other places.