Is your feature request related to a problem?
We implemented SQL grammar validation in SQL Plugin(https://github.com/opensearch-project/sql/pull/3039). As it's heavily depends on the grammar file structure, there is no automatic way to update when we update Spark version.
Especially the function names are listed in the code, and we cannot detect even if new function is added in new Spark version.
What solution would you like?
We need a mechanism to thoroughly test the grammar validation logic with spark version.
What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.
Is your feature request related to a problem? We implemented SQL grammar validation in SQL Plugin(https://github.com/opensearch-project/sql/pull/3039). As it's heavily depends on the grammar file structure, there is no automatic way to update when we update Spark version. Especially the function names are listed in the code, and we cannot detect even if new function is added in new Spark version.
What solution would you like? We need a mechanism to thoroughly test the grammar validation logic with spark version.
What alternatives have you considered? A clear and concise description of any alternative solutions or features you've considered.
Do you have any additional context?