search

visualfabriq / bquery

A query and aggregation framework for Bcolz (W2013-01)
https://www.visualfabriq.com
BSD 3-Clause "New" or "Revised" License
56 stars 11 forks source link

Cythonize filtering in one-go #68

Closed CarstVaartjes closed 8 years ago

CarstVaartjes commented 8 years ago

Filters now go on a column-by-column basis. By going on a more row/tuple basis the logic can go to the next row as soon one of the filter parts gives back a False. This should improve performance and stop the (for users strange) effect that adding filters makes the performance slower instead of faster. Indexing should improve this further in the future, but for now this should improve things

CarstVaartjes commented 8 years ago

See #72, will test it a bit more

CarstVaartjes commented 8 years ago

and merged (with some caveats)