search

fstpackage / fsttable

An interface to fast on-disk data tables stored with the fst format
GNU Affero General Public License v3.0
27 stars 4 forks source link

Use logical marker to indicate an ordered row filter #31

Closed MarcusKlik closed 6 years ago

MarcusKlik commented 6 years ago

If a back-end can assume the row filter is ordered, it doesn't need to order the vector before starting a sequential read.

MarcusKlik commented 6 years ago

A row-selection of the form:

ft[Year > 2007, }

will not change the order of the selected rows. The proposed ordering flag will signal this. Any subsequent read of the selected rows (by the back-end) can be done sequentially.

MarcusKlik commented 6 years ago

row-ordering flag was added in 67fe33a