Qbeast-io / qbeast-spark

Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
https://qbeast.io/qbeast-our-tech/
Apache License 2.0
216 stars 20 forks source link

Rollback and deprecate StringHistogramTransformation #459

Open osopardo1 opened 3 weeks ago

osopardo1 commented 3 weeks ago

We noticed some users have tables with StringHistogramTransformation, which was currently transformed into CDFQuantilesStringTransformation.

Although we can transform the Revision metadata in a new transaction, we should roll back the original class's code and maintain it to enable backward compatibility.

This is a priority before releasing any new version.

osopardo1 commented 1 week ago

I am picking this issue now because it's a high priority before releasing new artifacts and deploying it to existing users.