search

muntasirraihan / hyracks

Automatically exported from code.google.com/p/hyracks
0 stars 0 forks source link

Review new aggregation algorithms #94

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago 
Purpose of code changes on this branch:
Merge back the latest aggregation algorithms. There are mainly three algorithms:
- improved external-hash (slot-based);
- original hybrid-hash
- pre-partitioning based hybrid-hash

When reviewing my code changes, please focus on:
all algorithms are in the folder 
/branches/fullstack_aggregation_merge_staging/hyracks/hyracks-dataflow-std/src/m
ain/java/edu/uci/ics/hyracks/dataflow/std/group.

After the review, I'll merge this branch into:
/fullstack_asterix_stabilization

@yingyi could you also help me review these changes? I did some changes on the 
aggregation function interface, which are related to algebricks and pregelix.

Original issue reported on code.google.com by jarod...@gmail.com on 12 Mar 2013 at 5:02

GoogleCodeExporter commented 8 years ago 
I just noticed that not every changes have been listed in the merging commit 
log. So here is the list of files you may want to focus on:

- for improved external hash:
hyracks/hyracks-dataflow-std/src/main/java/edu/uci/ics/hyracks/dataflow/std/grou
p/hashsort/HybridHashSortGroupHashTable.java
hyracks/hyracks-dataflow-std/src/main/java/edu/uci/ics/hyracks/dataflow/std/grou
p/hashsort/HybridHashSortGroupOperatorDescriptor.java
hyracks/hyracks-dataflow-std/src/main/java/edu/uci/ics/hyracks/dataflow/std/grou
p/hashsort/HybridHashSortGrouperBucketMerge.java
hyracks/hyracks-dataflow-std/src/main/java/edu/uci/ics/hyracks/dataflow/std/grou
p/hashsort/ReferenceEntryWithBucketID.java
hyracks/hyracks-dataflow-std/src/main/java/edu/uci/ics/hyracks/dataflow/std/grou
p/hashsort/ReferencedBucketBasedPriorityQueue.java

- original hybrid-hash and pre-partitioning hybrid-hash
all files in 
hyracks/hyracks-dataflow-std/src/main/java/edu/uci/ics/hyracks/dataflow/std/grou
p/hybridhash

- changes on the aggregator interface
algebricks/algebricks-runtime/src/main/java/edu/uci/ics/hyracks/algebricks/runti
me/operators/aggreg/NestedPlansAccumulatingAggregatorFactory.java
algebricks/algebricks-runtime/src/main/java/edu/uci/ics/hyracks/algebricks/runti
me/operators/aggreg/SerializableAggregatorDescriptorFactory.java
algebricks/algebricks-runtime/src/main/java/edu/uci/ics/hyracks/algebricks/runti
me/operators/aggreg/SimpleAlgebricksAccumulatingAggregatorFactory.java  
pregelix/pregelix-runtime/src/main/java/edu/uci/ics/pregelix/runtime/simpleagg/A
ccumulatingAggregatorFactory.java

Original comment by jarod...@gmail.com on 12 Mar 2013 at 5:44