tspurway / hustle

A column oriented, embarrassingly distributed relational event database.
Other
240 stars 36 forks source link

Use bitmap to speed up the h_count() #20

Closed ncloudioj closed 10 years ago

ncloudioj commented 10 years ago

Currently, h_count() doesn't take advantage of the count information from bitmap, instead it loads up all columns and counts them in the memory. That's not efficient and wasteful.

ncloudioj commented 10 years ago

With in-stage combiner and CountDB introduced in commit 66f0c7bbaa1ab1241282a8436ebd2c79fc36bbe2, h_count() doesn't suffer from this performance issue any more.