brimdata / zed

A novel data lake based on super-structured data
https://zed.brimdata.io/
BSD 3-Clause "New" or "Revised" License
1.34k stars 67 forks source link

Enable Boyer-Moore filtering for nested fields #5101

Closed nwt closed 3 months ago

nwt commented 3 months ago

Filter expressions of the form a.b=="s" and "s" in a.b don't benefit from the ZNG scanner's Boyer-Moore string search optimization because compiler/kernel.isFieldEqualOrIn (called by CompileBufferFilter) doesn't understand nested fields. Fix that.

Closes #3412.