stratosphere / stratosphere

Stratosphere is now Apache Flink.
https://github.com/apache/incubator-flink
Apache License 2.0
197 stars 84 forks source link

Compiler hints for new java api #605

Open rmetzger opened 10 years ago

fhueske commented 10 years ago

We need a very good integration of optimizer hints with the API. In production settings, SQL queries are very often hand-tuned. We should give the possibility to allow that for Stratosphere Jobs as well.

Hints include:

In addition we need a good plan visualization tool, but that's a separate issue.

rmetzger commented 10 years ago

How about a CompilerHint class?

CompilerHint hint = new CompilerHint();
hint.setOutputRatio(0.5);
hint.setPreservesOrder(true);
DataSet<String> a;
b = a.map(new SuperMapper(), hint);