Fix sort_and_finalize_staged_data

man-group / ArcticDB

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.

http://arcticdb.io

Other

1.23k stars 79 forks source link

Fix sort_and_finalize_staged_data #1617

Closed willdealtry closed 2 weeks ago

willdealtry commented 3 weeks ago

sort_and_finalize_staged_data lost some tests in the transition to open-source, and so when it was broken by a processing pipeline factor this was not recognised. This PR fixes it and adds some elementary tests to check that it's doing what it's supposed to

DrNickClarke commented 2 weeks ago

I built this locally and ran it against the same tests that I used to report the bug. It works on that use case now.