uwescience / raco

Compilation and rule-based optimization framework for relational algebra. Raco is the language, optimization, and query translation layer for the Myria project.
Other
72 stars 19 forks source link

MyriaL support for SplitExpression and SequenceExpression #537

Closed senderista closed 7 years ago

senderista commented 7 years ago

These are currently the only built-in flatmap expressions in MyriaX, so can be supported in RACO without syntax support for MyriaL flatmap UDFs. Tested in MyriaWeb with the following queries:

R = load("https://s3-us-west-2.amazonaws.com/uwdb/sampleData/tab.txt",
csv(schema(index:int, intlist:string), delimiter="\t"));
store(R, flatmap_input, [index, intlist]);
S = scan("public:adhoc:flatmap_input");
T = [from S emit S.index, S.intlist, split(S.intlist, ",")];
store(T, flatmap_output, [$0, $1, $2]);
T = [from S emit S.index, S.intlist, sequence(S.index)];
store(T, sequence_output, [$0, $1, $2]);
coveralls commented 7 years ago

Coverage Status

Coverage decreased (-0.05%) to 91.829% when pulling 61340fcf11b61f2c6c34932234e0001ab064eccd on flatmap into 0231c0936bde9f68386a80fc9b9e96309b8d2091 on master.

shrjain commented 7 years ago

LGTM

coveralls commented 7 years ago

Coverage Status

Coverage decreased (-0.05%) to 91.829% when pulling 61340fcf11b61f2c6c34932234e0001ab064eccd on flatmap into 0231c0936bde9f68386a80fc9b9e96309b8d2091 on master.

coveralls commented 7 years ago

Coverage Status

Coverage decreased (-0.1%) to 91.756% when pulling 335c8ca8865e7eada14a216f0f13aad95a45648d on flatmap into 0231c0936bde9f68386a80fc9b9e96309b8d2091 on master.