search

metatron-app / metatron-discovery

Powerful & Easy way for big data discovery
https://metatron.app
Apache License 2.0
440 stars 110 forks source link

Limit rules that are not allowed in Spark Engine #2737

Open joohokim1 opened 4 years ago

joohokim1 commented 4 years ago

Is your feature request related to a problem? Please describe. When I apply a rule list containing some advanced rules like pivot, window, and so on, Preparation Spark Engine will produce an error and the error handling is not made well yet.

Describe the solution you'd like If the rule list has unimplemented rules, show a dialog that the rules are not implemented in Spark Engine.

Additional context If possible, I wish I can set the rules that are allowed or disallowed by the property file. If not, we might get a situation that we cannot use a rule that already has been implemented in Spark Engine, just because of mismatch of the binary version. Deployment is a very hard task always.

AnnieHwang commented 4 years ago

@joohokim1 @ksparknot Please check below. image

joohokim1 commented 4 years ago

@ksparknot @AnnieHwang This issue has been move to "To do" because I think we can support all rules soon enough. If implemention takes longer, I'll move this to "In progress" again. Sorry for bothering.