Open YANG-DB opened 1 month ago
I created a working PoC (proof of concept). The source code can be found https://github.com/eliatra/opensearch-spark/pull/3.
The usage of the commands looks as follows.
search source=people | is_present name;
search source=people | is_present age;
search source=people | is_present age, name;
Please let me know if such an approach meets your expectations.
BTW, the MR is not yet ready. Documentation and tests need to be created.
We need a final decision wether this should be a command or a function like asked in https://github.com/opensearch-project/opensearch-spark/issues/512#issuecomment-2331451920
ispresent
implemented as a function. @YANG-DB the MR is ready for review.
Example: search source=people | eval p=ispresent(age) | where ispresent(age);
Is your feature request related to a problem? Add
ispresent
command for PPL spark based execution driver .Since spark sql doesnt offer such expression a possible option would be:
WHERE
spark sql commandispresent
Do you have any additional context?