search

ilovesoup / hyracks

Automatically exported from code.google.com/p/hyracks
Apache License 2.0
0 stars 0 forks source link

better memory/cache management in external sort and external groupby #32

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
Several possible improvements in external sort and external group-by operator:
1. read-ahead (prefetch) in merge phase when framelimit > num. of runs
2. use some extra buffers for pre-fetching
3. every alternate sorting level could be reversed, so as to increase file 
system cache's usage. But this improvement requires run files can be read 
reversely.

Original issue reported on code.google.com by buyingyi@gmail.com on 1 Aug 2011 at 11:33