search

wlxiong / poly-ir-toolkit

Automatically exported from code.google.com/p/poly-ir-toolkit
0 stars 1 forks source link

Speed up decoding of positions. #11

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
In order to decode the positions, we first sum up the total frequencies for a 
chunk.
Instead, store the sums of the frequencies in the index for each chunk.

Original issue reported on code.google.com by Roman.Kh...@gmail.com on 26 Jan 2011 at 4:11

GoogleCodeExporter commented 9 years ago 
This would also be affected by issue 4; in that case, it should be noted that 
the frequency could be greater than the max number of positions allowed.

The sum of the frequencies doesn't need to be stored as a 4 byte integer, since 
it would be limited by CHUNK_SIZE * MAX_FREQUENCY_PROPERTIES.

Original comment by Roman.Kh...@gmail.com on 26 Jan 2011 at 4:16