Use ORDER BY ts_init in default sql query. Closes #1515
By default datafusion reads row groups out of order for large files. The test files use in CI are small and don't show this so it was missed. From discussion in https://github.com/apache/datafusion/issues/10572, there are two ways to fix this and using ORDER BY clause is the recommended way.
Type of change
[x] Bug fix (non-breaking change which fixes an issue)
How has this change been tested?
Tested with sample data to ensure ordering is maintained.
Pull Request
Use
ORDER BY ts_init
in default sql query. Closes #1515By default datafusion reads row groups out of order for large files. The test files use in CI are small and don't show this so it was missed. From discussion in https://github.com/apache/datafusion/issues/10572, there are two ways to fix this and using ORDER BY clause is the recommended way.
Type of change
How has this change been tested?
Tested with sample data to ensure ordering is maintained.