arangodb / rta-makedata

Apache License 2.0
1 stars 2 forks source link

Numerical VPack Sorting test #43

Closed MDAlFattah closed 1 month ago

MDAlFattah commented 1 month ago

Scope & Purpose

This PR adds a test for validating VPack numerical sorting in ArangoDB, specifically addressing sorting behavior for large numeric values across different versions.

Problem

Large numeric values were previously cast to doubles for comparison, leading to incorrect sorting and potential data corruption in RocksDB. The issue is fixed in versions 3.12.2 and 3.11.11, introducing a new comparator that requires migration for proper sorting.

Test Script

Insert Test Data: Add documents with large numeric values to test collections. Sorting Logic: Incorrect Sorting: Versions below 3.11.11 and versions in the range 3.12.0 to < 3.12.2. Correct Sorting: Versions 3.11.11 or newer and versions >= 3.12.2.

Upgrade & Migration: Upgrade ArangoDB, run the migration, and verify sorting changes. Final Check: Ensure correct sorting and data integrity after migration.

Checklist