search

opensearch-project / sql

Query your data using familiar SQL or intuitive Piped Processing Language (PPL)
https://opensearch.org/docs/latest/search-plugins/sql/index/
Apache License 2.0
120 stars 139 forks source link

SQL ingestion and ops - standup #791

Open anirudha opened 2 years ago

anirudha commented 2 years ago

Is your feature request related to a problem? A clear and concise description of what the problem is, e.g. I'm always frustrated when [...]

What solution would you like? A clear and concise description of what you want to happen.

What alternatives have you considered? A clear and concise description of any alternative solutions or features you've considered.

Do you have any additional context? Add any other context or screenshots about the feature request here.

Yury-Fridlyand commented 1 year ago

Dec -1

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Spike on porting NESTED/REVERSE_NESTED queries from legacy engine. opensearch-project/sql#1111 @forestmvey@GumpacG In Progress     Implement parser changes for nested by using Highlight implementation as a reference    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067   Rework implementation to aid going forward with moving relevance functions to opensearch module.    
Update MULTI_MATCH to support legacy alternate syntax. @forestmvey In Review On upstream review - opensearch-project/sql#168 Address PR comments make upstream PR.      
Add/update date/time calculation functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132; Blocked by opensearch-project/sql#1047        
Fix/add date/time comparison functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#129; Blocked by opensearch-project/sql#1047        
Fix bug where multiplication in queries is treated as alias @GabeFernandez310 Paused PoC on team review for discussion opensearch-project/sql#128       Unknown - need to determine scope
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked        
Query context for built-in functions @MaxKsyunz In review opensearch-project/sql#1047   Merging conflicts      
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Add WILDCARDQUERY function opensearch-project/sql#1032 @GumpacG In review Upstream review opensearch-project/sql#1108   Address upstream PR comments    
Fix for opensearch-project/sql#650 @Yury-Fridlyand Paused On team review #154Waiting for 3.x branch        
Add Support For Legacy Query Functions @GabeFernandez310 In review opensearch-project/sql#1090 In review - opensearch-project/sql#1090, opensearch-project/sql#1103 Made PR upstream     Done - Waiting for reviews
Added escape character support in 3.x @MitchellGale-BitQuill In Progress Putting in 3.x branch because change is breaking.        
Add engine switch option @Yury-Fridlyand Paused On team review opensearch-project/sql#160; does not include ODBC       Stalled - this cannot go into public API
Add CBRT to the V2 engine @margarit-h Done Merged opensearch-project/sql#1081        
Fix for opensearch-project/sql#794 @Yury-Fridlyand In Progress WIP opensearch-project/sql#169 Related/dependent on opensearch-project/sql#1038   Rework according to PR comments    
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress     Found bug with misreported success Finish fix on bug  
Add Support For *_of_year functions @GabeFernandez310 In Progress All PRs are up internally Refactored Test Code. Addressed PR Feedback Make PR upstream once re-reviewing is done internally   Before end of sprint
Make now function constant within a DQL statement @MaxKsyunz Blocked Waiting from comments from other maintainers create a revised PR      
Pagination in v2 SQL engine @MaxKsyunz In Progress   Discussed specification and implementation consideration with AWS team Revise proposal based on feedback now function takes higher priority.  
Add CBRT to the PPL @margarit-h Merged opensearch-project/sql#1097   Address PR review feedback Address more feedback if available or get it merged.    
Add position() function to the V2 engine. @margarit-h In ProgressInternal PR: opensearch-project/sql#177   Address PR review comments, work on PPL support Continue working on adding PPL support    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Progress PoC available opensearch-project/sql#178 Make PoC Test it    
Yury-Fridlyand commented 1 year ago

Dec 1

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Create Nested POC. opensearch-project/sql#1111 @forestmvey@GumpacG In Progress   Implement nested in the parser. Implement nested in the core module    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067   Rework implementation to aid going forward with moving relevance functions to opensearch module.    
Update MULTI_MATCH to support legacy alternate syntax. @forestmvey In Review On upstream review - opensearch-project/sql#168 Address PR comments make upstream PR.      
Add/update date/time calculation functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132; Blocked by opensearch-project/sql#1047        
Fix/add date/time comparison functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#129; Blocked by opensearch-project/sql#1047        
Fix bug where multiplication in queries is treated as alias @GabeFernandez310 Paused PoC on team review for discussion opensearch-project/sql#128       Unknown - need to determine scope
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked        
Query context for built-in functions @MaxKsyunz In review opensearch-project/sql#1047   Merging conflicts      
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Add WILDCARDQUERY function opensearch-project/sql#1032 @GumpacG In review Upstream review opensearch-project/sql#1108 Addressed upstream PR comments      
Fix for opensearch-project/sql#650 @Yury-Fridlyand Paused On team review #154Waiting for 3.x branch        
Add Support For Legacy Query Functions @GabeFernandez310 In review opensearch-project/sql#1090 In review - opensearch-project/sql#1090, opensearch-project/sql#1103 Made PR upstream     Done - Waiting for reviews
Added escape character support in 3.x @MitchellGale-BitQuill In Progress Putting in 3.x branch because change is breaking.        
Fix for opensearch-project/sql#794 @Yury-Fridlyand In Progress WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038 Rework according to PR comments Rework according to PR comments    
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress     Working on fix for round, ceil, floor. testing aggregations. Adding fix for round, ceil, floor  
Add Support For *_of_year functions @GabeFernandez310 In review All PRs are up on upstream Made PRs Upstream Address any feedback on PRs   Done - Waiting for reviews
Make now function constant within a DQL statement @MaxKsyunz In review opensearch-project/sql#1047 Waiting from comments from other maintainers Address PR review feedback      
Pagination in v2 SQL engine @MaxKsyunz In Progress   Discussed specification and implementation consideration with AWS team Revise proposal based on feedback now function takes higher priority.  
Add position() function to the V2 engine. @margarit-h In Upstream Review Upstream PR: opensearch-project/sql#1121 Create an upstream PR, address PR review comments. Get the PR merged    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Progress PoC available opensearch-project/sql#178 Make PoC Test it    
Add position() function to the PPL @margarit-h In Internal Review Internal PR opensearch-project/sql#179 Finished Implementation, created a PR Address any feedback on the PR    
Add reverse() string function to SQL plugin @margarit-h In Progress   Review the requirements Start Implementing the solution    
Yury-Fridlyand commented 1 year ago

Nov 32

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Add WILDCARDQUERY function opensearch-project/sql#1032 @GumpacG In review Upstream review opensearch-project/sql#1108 Addressed upstream PR comments      
Add Support For Legacy Query Functions @GabeFernandez310 In review opensearch-project/sql#1090 In review - opensearch-project/sql#1090, opensearch-project/sql#1103 Made PR upstream     Merged Upstream
Add Support For *_of_year functions @GabeFernandez310 In review All PRs are up on upstream Made PRs Upstream Address any feedback on PRs   Done - Waiting for reviews
Add position() function to the V2 engine. @margarit-h In Upstream Review Upstream PR: opensearch-project/sql#1121 Address PR review comments. Get the PR merged    
Add position() function to the PPL @margarit-h In Internal Review Internal PR opensearch-project/sql#179 Finished Implementation, created a PR Address any feedback on the PR    
Add reverse() string function to SQL plugin @margarit-h In Progress   Start Implementing the solution Continue Implementing the solution    
Add/update date/time calculation functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132; Blocked by opensearch-project/sql#1047        
Added escape character support in 3.x @MitchellGale-BitQuill In Progress Putting in 3.x branch because change is breaking.        
Create Nested POC. opensearch-project/sql#1111 @forestmvey@GumpacG In Progress     Implement nested in the core module    
Fix bug where multiplication in queries is treated as alias @GabeFernandez310 Paused PoC on team review for discussion opensearch-project/sql#128       Unknown - need to determine scope
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Fix for opensearch-project/sql#650 @Yury-Fridlyand Paused On team review #154Waiting for 3.x branch        
Fix for opensearch-project/sql#794 @Yury-Fridlyand In Progress WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038 Rework according to PR comments Rework according to PR comments    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Progress PoC available opensearch-project/sql#178 Make PoC Test it    
Fix/add date/time comparison functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#129; Blocked by opensearch-project/sql#1047        
Investigate adding alternate syntax for match_query function @GabeFernandez310 In Progress   Investigated options for implementing alternate syntax. Made proof of concept for potential option. Further investigation and Proof Of Concepts for other options.    
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress     Working on fix for round, ceil, floor. testing aggregations. Add detailed findings for [BUG] Rounding functions don't work well with values > INT_MAXBUG to comment. Get PR up for fix for Ceil/Floor/Ceiling  
Make now function constant within a DQL statement @MaxKsyunz In review opensearch-project/sql#1047 Waiting from comments from other maintainers Address PR review feedback      
Pagination in v2 SQL engine @MaxKsyunz In Progress   Discussed specification and implementation consideration with AWS team Revise proposal based on feedback now function takes higher priority.  
Query context for built-in functions @MaxKsyunz In review opensearch-project/sql#1047   Merging conflicts      
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067   Rework implementation to aid going forward with moving relevance functions to opensearch module.    
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked        
Update MULTI_MATCH to support legacy alternate syntax. @forestmvey In Review On upstream review - opensearch-project/sql#168 Address PR comments make upstream PR.      
MitchellGale commented 1 year ago

December 5th, 2022


Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Create Nested POC. opensearch-project/sql#1111 @forestmvey@GumpacG In Progress   Implement nested in the core module Debug output DSL from SQL plugin to match V1 engine.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067 Out of office. Update PR based on comments.    
Update MULTI_MATCH to support legacy alternate syntax. @forestmvey In Review On upstream review - opensearch-project/sql#168 Out of office. Update PR based on comments.    
Add/update date/time calculation functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132; Blocked by opensearch-project/sql#1047        
Fix/add date/time comparison functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#129; Blocked by opensearch-project/sql#1047        
Fix bug where multiplication in queries is treated as alias @GabeFernandez310 Paused PoC on team review for discussion opensearch-project/sql#128       Unknown - need to determine scope
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked        
Query context for built-in functions @MaxKsyunz In review opensearch-project/sql#1047   Merging conflicts      
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Add WILDCARDQUERY function opensearch-project/sql#1032 @GumpacG In review Upstream review opensearch-project/sql#1108 Addressed upstream PR comments      
Fix for opensearch-project/sql#650 @Yury-Fridlyand Paused On team review #154Waiting for 3.x branch        
Add Support For Legacy Query Functions @GabeFernandez310 In review opensearch-project/sql#1090 In review - opensearch-project/sql#1090, opensearch-project/sql#1103 Made PR upstream     Merged Upstream
Added escape character support in 3.x @MitchellGale-BitQuill In Progress Putting in 3.x branch because change is breaking.        
Fix for opensearch-project/sql#794 @Yury-Fridlyand In Progress WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038 Rework according to PR comments Rework according to PR comments    
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress     Add detailed findings for [BUG] Rounding functions don't work well with values > INT_MAX · Issue opensearch-project/sql#1036 · opensearch-project/sql to comment. Get PR up for fix for Ceil/Floor/Ceiling Address PR comments. Start validation for TDVT driver  
Add Support For *_of_year functions @GabeFernandez310 In review All PRs are up on upstream Rebased to address merge conflicts Address any feedback on PRs   Done - Waiting for reviews
Make now function constant within a DQL statement @MaxKsyunz In review opensearch-project/sql#1047 Waiting from comments from other maintainers Address PR review feedback      
Pagination in v2 SQL engine @MaxKsyunz In Progress   Discussed specification and implementation consideration with AWS team Revise proposal based on feedback now function takes higher priority.  
Add position() function to the V2 engine. @margarit-h In Upstream Review Upstream PR: opensearch-project/sql#1121 Address PR review comments. Get the PR merged    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Progress PoC available opensearch-project/sql#178 Make PoC Test it    
Add position() function to the PPL @margarit-h In Internal Review Internal PR opensearch-project/sql#179 Finished Implementation, created a PR Address any feedback on the PR    
Add reverse() string function to SQL plugin @margarit-h In Progress   Continue Implementing the solution Add unit and integration tests, create a PR    
Investigate adding alternate syntax for match_query function @GabeFernandez310 In Progress   Investigated other PRs for reference to implement alternate syntax Implement alternate syntax and make draft PR for review and internal discussion    
MitchellGale commented 1 year ago

December 6th, 2022

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Create Nested POC. opensearch-project/sql#1111 @forestmvey@GumpacG In Progress   Debug output DSL from SQL plugin to match V1 engine. Continue POC development. Currently resolving logical plan for nested query.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067 Update PR based on comments. Plan way forward at sync-up.    
Update MULTI_MATCH to support legacy alternate syntax. @forestmvey Merged On upstream review - opensearch-project/sql#168 Update PR based on comments.      
Add/update date/time calculation functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132; Blocked by opensearch-project/sql#1047        
Fix/add date/time comparison functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#129; Blocked by opensearch-project/sql#1047        
Fix bug where multiplication in queries is treated as alias @GabeFernandez310 Paused PoC on team review for discussion opensearch-project/sql#128       Unknown - need to determine scope
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked        
Query context for built-in functions @MaxKsyunz In review opensearch-project/sql#1047   Merging conflicts      
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Add WILDCARDQUERY function opensearch-project/sql#1032 @GumpacG In review Upstream review opensearch-project/sql#1108 Addressed upstream PR comments      
Fix for opensearch-project/sql#650 @Yury-Fridlyand Paused On team review #154Waiting for 3.x branch        
Add Support For Legacy Query Functions @GabeFernandez310 In review opensearch-project/sql#1090 In review - opensearch-project/sql#1090, opensearch-project/sql#1103 Made PR upstream     Merged Upstream
Added escape character support in 3.x @MitchellGale-BitQuill In Progress Putting in 3.x branch because change is breaking.        
Fix for opensearch-project/sql#794 @Yury-Fridlyand In Progress WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038 Rework according to PR comments Rework according to PR comments    
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress     Add detailed findings for [BUG] Rounding functions don't work well with values > INT_MAX · Issue opensearch-project/sql#1036 · opensearch-project/sql to comment. Get PR up for fix for Ceil/Floor/Ceiling Address PR comments. Start validation for TDVT driver  
Add Support For *_of_year functions @GabeFernandez310 In review All PRs are up on upstream   Address any feedback on PRs   Merged Upstream
Make now function constant within a DQL statement @MaxKsyunz In review opensearch-project/sql#1047 Waiting from comments from other maintainers Address PR review feedback      
Pagination in v2 SQL engine @MaxKsyunz In Progress   Discussed specification and implementation consideration with AWS team Revise proposal based on feedback now function takes higher priority.  
Add position() function to the V2 engine. @margarit-h In Upstream Review Upstream PR: opensearch-project/sql#1121 Address PR review feedback, rebase resolve conflicts. Get the PR merged    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Progress PoC available opensearch-project/sql#178 Make PoC Test it    
Add position() function to the PPL @margarit-h In Internal Review Internal PR opensearch-project/sql#179 Address PR review feedback, rebase resolve conflicts. Address any feedback on the PR, merge.    
Add reverse() string function to SQL plugin @margarit-h In Progress   Add unit and integration tests. Continue adding unit and integration tests, create an internal PR.    
Investigate adding alternate syntax for match_query function @GabeFernandez310 In Progress Investigation is done. Execution on full implementation will be done in the future. Made PoC for review and internal discussion. Discuss   Done
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @Mitchell Gale In Progress     Rebasing off newest 2.x to bring changes to upstream    
acarbonetto commented 1 year ago

Status Report - Dec 7th, 2022

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. opensearch-project/sql#1111 @forestmvey; @GumpacG In Progress   Continue POC development. Currently resolving logical plan for nested query. Figure out plan for porting legacy code for building physical plan.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067 Plan way forward at sync-up. Plan implementation with team.    
Add/update date/time calculation functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132;        
Fix/add date/time comparison functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#129;        
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked        
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Add WILDCARDQUERY function opensearch-project/sql#1032 @GumpacG Merged Upstream review opensearch-project/sql#1108 Addressed upstream PR comments Split scope between 2.x and 3.x (breaking changes - opensearch-project/sql#1143)      
Fix for opensearch-project/sql#794 @Yury-Fridlyand In Progress WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038 Rework according to PR comments Rework according to PR comments    
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress     Add detailed findings for https://github.com/opensearch-project/sql/issues/1036 to comment. Get PR up for fix for Ceil/Floor/Ceiling Address PR comments. Start validation for TDVT driver  
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Discussed specification and implementation consideration with AWS team Revise proposal based on feedback now function takes higher priority.  
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Progress PoC available opensearch-project/sql#178 Make PoC Test it    
Add reverse() string function to SQL plugin @margarit-h In Progress Internal PR: opensearch-project/sql#183 Continued adding unit and integration tests, created an internal PR. Address any feedback on the PR.    
Investigate adding alternate syntax for match_query function @GabeFernandez310 In Progress   Refactored code to remove unnecessary changes and files. Started adding tests. Continue adding tests.    
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @Mitchell Gale In Progress     Rebasing off newest 2.x to bring changes to upstream    
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, opensearch-project/sql#339, opensearch-project/sql#432, opensearch-project/sql#1133) @acarbonetto Paused Internal PR opensearch-project/sql#142   Add IT tests to cover BUGs    

Issues Paused for 3.x/main branch:

MitchellGale commented 1 year ago

December 9th


Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. opensearch-project/sql#1111 @forestmvey; @GumpacG In Progress   POC development. POC development.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067 Re-work to use standard analyzer validation for qualified names of single-field relevance functions. PR on BitQuill repo. Address any new comments.    
Add/update date/time calculation functions @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132;        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand Unblocked, In Review On team review opensearch-project/sql#122        
Fix/add date/time comparison functions @Yury-Fridlyand Unblocked, In Progress On team review opensearch-project/sql#129;   Update implementation to use FunctionProperties    
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked        
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Add WILDCARDQUERY function opensearch-project/sql#1032 @GumpacG Merged          
Fix for opensearch-project/sql#794 @Yury-Fridlyand PoC In Review WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038        
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress     Add detailed findings for [BUG] Rounding functions don't work well with values > INT_MAX · Issue opensearch-project/sql#1036 · opensearch-project/sql to comment. Get PR up for fix for Ceil/Floor/Ceiling Address PR comments. Start validation for TDVT driver  
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Internal review Addressing feedback from internal review.    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Review PR opensearch-project/sql#178 Finish fix and tests      
Add reverse() string function to SQL plugin @margarit-h In Upstream Review PR: opensearch-project/sql#1154 Addressed more feedback on the PR, created an upstream PR. Get it merged    
Adding alternate syntax for match_query function @GabeFernandez310 In Progress   Fixed implementation for multi_match. Fixed IT tests. Made internal PR. Wait for internal reviews/feedback and address them.    
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @MitchellGale-BitQuill In Progress     Finished fix on tests. Made PR  
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, opensearch-project/sql#339, opensearch-project/sql#432, opensearch-project/sql#1133) @acarbonetto Paused Internal PR opensearch-project/sql#142   Add IT tests to cover BUGs    
Fix for opensearch-project/sql-jdbc#21 - JDBC @Yury-Fridlyand In Review PR: opensearch-project/sql#185 Finish fix and tests      
MitchellGale commented 1 year ago

December 12th, 2022

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. opensearch-project/sql#1111 @forestmvey; @GumpacG In Progress   POC development. Basic POC end to end for nested in SELECT statement.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067 PR on BitQuill repo. Address any new comments. Waiting on PR feedback.    
Add/update date/time calculation functions @Yury-Fridlyand Unblocked, In Review On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132; Updated to use FunctionProperties      
Fix/add date/time comparison functions @Yury-Fridlyand Unblocked, In Review On team review opensearch-project/sql#129; Update implementation and tests to use FunctionProperties      
Rework timestamp function @Yury-Fridlyand Blocked by opensearch-project/sql#1047 On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132, which is blocked   Update to use FunctionProperties    
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Fix for opensearch-project/sql#794 @Yury-Fridlyand PoC In Review WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038        
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress   Add detailed findings for [BUG] Rounding functions don't work well with values > INT_MAX · Issue opensearch-project/sql#1036 · opensearch-project/sql to comment. Get PR up for fix for Ceil/Floor/Ceiling Make issue for large values not being able to sum aggregate on OS.    
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Internal review Addressing feedback from internal review.    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Review PR opensearch-project/sql#178        
Add reverse() string function to SQL plugin @margarit-h In Upstream Review PR: opensearch-project/sql#1154 Addressed more feedback on the PR, created an upstream PR. Get it merged    
Adding alternate syntax for match_query function @GabeFernandez310 In Progress   Addressed some PR comments. Began addressing PR comments regarding required parser changes. Implement required changes. Wait for internal reviews/feedback and address them.    
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @MitchellGale-BitQuill In Progress     Made PR    
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, opensearch-project/sql#339, opensearch-project/sql#432, opensearch-project/sql#1133) @acarbonetto Paused Internal PR opensearch-project/sql#142   Add IT tests to cover BUGs    
Fix for opensearch-project/sql-jdbc#21 - JDBC @Yury-Fridlyand In Review PR: opensearch-project/sql#185        
Fix TRUNCATE function bug @margarit-h In Progress   Implement a solution Continue implement the solution add tests    
Yury-Fridlyand commented 1 year ago

Dec 13

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. opensearch-project/sql#1111 @forestmvey; @GumpacG In Progress   Basic POC end to end for nested in SELECT statement. Add nested aggregation to DSL in POC.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review opensearch-project/sql#1067 Waiting on PR feedback. Waiting on PR feedback.    
Add/update date/time calculation functions @Yury-Fridlyand Unblocked, In Review On team review opensearch-project/sql#122; opensearch-project/sql#131; opensearch-project/sql#132;        
Fix/add date/time comparison functions @Yury-Fridlyand Unblocked, In Review On team review opensearch-project/sql#129;        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review opensearch-project/sql#139; Depends on opensearch-project/sql#132 Updated to use FunctionProperties      
Fix aggregation for datetime types opensearch-project/sql#645 @Yury-Fridlyand In Review On upstream review opensearch-project/sql#1061        
Fix for opensearch-project/sql#794 @Yury-Fridlyand PoC In Review WIP opensearch-project/sql#169, #180Related/dependent on opensearch-project/sql#1038        
Investigation and scope of data correctness tickets @MitchellGale-BitQuill In Progress   Add detailed findings for [BUG] Rounding functions don't work well with values > INT_MAXBUG to comment. Get PR up for fix for Ceil/Floor/Ceiling Make issue for large values not being able to sum aggregate on OS.    
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Internal review Addressing feedback from internal review.    
Fix for opensearch-project/sql-jdbc#19 @Yury-Fridlyand In Review PR opensearch-project/sql#178        
Add reverse() string function to SQL plugin @margarit-h In Upstream Review PR: opensearch-project/sql#1154 Addressed more feedback on the PR, created an upstream PR. Get it merged    
Adding alternate syntax for match_query function @GabeFernandez310 In Progress PR: opensearch-project/sql#1166 Addressed all comments. Made PR upstream Wait for comments/feedback and address.    
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @MitchellGale-BitQuill In Progress     Made PR    
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, opensearch-project/sql#339, opensearch-project/sql#432, opensearch-project/sql#1133) @acarbonetto Paused Internal PR opensearch-project/sql#142   Add IT tests to cover BUGs    
Fix for opensearch-project/sql-jdbc#21 - JDBC @Yury-Fridlyand In Review PR: opensearch-project/sql#185        
Fix TRUNCATE function bug @margarit-h In Progress Internal PR: opensearch-project/sql#188 Continue implement the solution add tests Add integration tests, fix codecov failures    
acarbonetto commented 1 year ago

Status Update - December 14, 2022

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey; @GumpacG In Progress   Add nested aggregation to DSL in POC. Add nested aggregation to DSL in POC continued.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review #1067 Waiting on PR feedback. Waiting on PR feedback.    
Add/update date/time calculation functions @Yury-Fridlyand Unblocked, In Review On team review #122; #131; #132;        
Fix/add date/time comparison functions @Yury-Fridlyand Unblocked, In Review On team review #129;        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038   Address PR feedback    
Clean up code @MitchellGale-BitQuill In Progress Clean up related project code   Add more doctests    
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Addressing feedback from internal review. Review with maintainer team    
Proof of concept of pagination in v2 @MaxKsyunz In Progress     Initial development    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.   Done - Waiting for Reviews
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @MitchellGale-BitQuill In Progress          
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto Paused Internal PR #142   Add IT tests to cover BUGs    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review PR: #185 Update PR to include fix for #1003 too      
Fix TRUNCATE function bug @margarit-h In Internal review Internal PR: #188 Add integration tests, fix codecov failures Address PR review comments, add more tests    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Progress   Started implementation and tests for minute_of_day Continue with adding tests and implementation for all functions    
Fix ResultSet.getTime(index, calendar) returns null bug @Margarit Hakobyan In Progress     Start investigation  
Yury-Fridlyand commented 1 year ago

Dec 0xF

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Progress   Nothing. Add nested aggregation to DSL in POC continued.    
SQL-ODBC Repo Seperation, helping fix ODBC build workflow for YANG-DB. @forestmvey Complete   Support. Make fix and PR to YANG-DB SQL-ODBC Repo.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review #1067 Waiting on PR feedback. Waiting on PR feedback.    
Add/update date/time calculation functions @Yury-Fridlyand Unblocked, In Review On team review #122; #131; #132;        
Fix/add date/time comparison functions @Yury-Fridlyand Unblocked, In Review On team review #129;        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038   Address PR feedback    
Clean up code @MitchellGale-BitQuill In Progress Clean up related project code   Add more doctests    
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Addressing feedback from internal review. Review with maintainer team    
Proof of concept of pagination in v2 @MaxKsyunz In Progress     Initial development    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.   Done - Waiting for Reviews
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @MitchellGale-BitQuill In Progress          
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto Paused Internal PR #142   Add IT tests to cover BUGs    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review PR: #185 Update PR to include fix for #1003 too      
Fix TRUNCATE function bug @margarit-h In Internal review Internal PR: #188 Address PR review comments, add more tests Create upstream PR    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Progress   Implemented and made internal PR of minute_of_day. Implemented and created tests for day_of_week Add documentation for day_of_week, ensure all tests pass, and make PR. Work on other functions    
Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Progress   Investigate, start implementation Continue implementation    
Fix for #650 @Yury-Fridlyand In Review Upstream review #1181 Publish PR to upstream      
Yury-Fridlyand commented 1 year ago

Dec 0x10

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Progress   Add nested aggregation to DSL in POC continued. POC development and implementation discussion.    
SQL-ODBC Repo Seperation, helping fix ODBC build workflow for YANG-DB. @forestmvey Complete   Make fix and PR to YANG-DB SQL-ODBC Repo.      
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review #1067 Waiting on PR feedback. Waiting on upstream PR feedback.    
Add/update date/time calculation functions @Yury-Fridlyand Unblocked, In Review On team review #131; #132;        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Fix/add date/time comparison functions @Yury-Fridlyand Unblocked, In Review On team review #129;        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061   Discuss PR comments    
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038 Address PR feedback Fix test crashes    
Clean up code @MitchellGale-BitQuill In Progress Clean up related project code   Add more doctests    
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Addressing feedback from internal review. Review with maintainer team    
Proof of concept of pagination in v2 @MaxKsyunz In Progress     Initial development    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.   Done - Waiting for Reviews
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @MitchellGale-BitQuill In Review On team review #187   Publish PR to upstream    
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto Paused Internal PR #142   Add IT tests to cover BUGs    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review PR: #185        
Fix TRUNCATE function bug @margarit-h In Internal review Internal PR: #188 Address PR review comments, add more tests Create upstream PR    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Progress   Implemented and made internal PR of minute_of_day. Implemented and created tests for day_of_week Add documentation for day_of_week, ensure all tests pass, and make PR. Work on other functions    
Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Progress   Implement a solution Continue implementation    
Fix for #650 @Yury-Fridlyand In Review Upstream review #1181 Publish PR to upstream      
MitchellGale commented 1 year ago

Dec 19, 2022

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Progress   Add nested aggregation to DSL in POC continued. POC development and implementation discussion.    
SQL-ODBC Repo Seperation, helping fix ODBC build workflow for YANG-DB. @forestmvey Complete   Make fix and PR to YANG-DB SQL-ODBC Repo.      
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review #1067 Waiting on PR feedback. Waiting on upstream PR feedback.    
Add TIMEDIFF and DATEDIFF functions. @Yury-Fridlyand In Review On upstream review #1195   Publish on upstream    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Add functions ADDTIME and SUBTIME @Yury-Fridlyand In Review On upstream review #1194   Publish on upstream    
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196   Publish on upstream    
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061   Pause PR, because more review and discussion is required    
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038 Fix test crashes Fix test crashes    
Clean up code @MitchellGale-BitQuill In Progress Clean up related project code Add more doctests      
(design) Pagination in v2 SQL engine @MaxKsyunz In Progress   Addressing feedback from internal review. Review with maintainer team    
Proof of concept of pagination in v2 @MaxKsyunz In Progress     Initial development    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.   Done - Waiting for Reviews
Implementing UTC_TIME/DATE/TIMESTAMP to use new Now functionality @MitchellGale-BitQuill In Review Adding UTC_DATE, UTC_TIME, UTC_TIMESTAMP by MitchellGale-BitQuill · Pull Request #1193 · opensearch-project/sql Published PR to upstream      
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto Paused Internal PR #142   Add IT tests to cover BUGs    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review PR: #185 jdbc#39 Publish to upstream      
Fix TRUNCATE function bug @margarit-h In Internal review Internal PR: #188 Address PR review comments, add more tests Create upstream PR    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Progress   Implemented and made internal PR of made PRs for day_of_week, day_of_month, and hour_of_day functions. Continue with implementation and testing for remaining functions    
Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Progress   Implement a solution Continue implementation    
Fix for #650 @Yury-Fridlyand In Review Upstream review #1181 Publish PR to upstream      
Add PiTest to GHA workflow @MitchellGale-BitQuill In progress     Adding PiTest to GHA workflow through gradle.    
MitchellGale commented 1 year ago

Dec 20, 2022


Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Progress   Add nested aggregation to DSL in POC continued. POC development and implementation discussion.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review #1067 Waiting on PR feedback. Waiting on upstream PR feedback.    
Add TIMEDIFF and DATEDIFF functions. @Yury-Fridlyand In Review On upstream review #1195        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Add functions ADDTIME and SUBTIME @Yury-Fridlyand In Review On upstream review #1194        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038 Finish fixing IT      
Clean up code @MitchellGale-BitQuill In Progress Clean up related project code Add more doctests      
(design) Pagination in v2 SQL engine @MaxKsyunz Complete   Review with maintainer team      
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.    
(design) Planning for JOINs development @acarbonetto In Progress   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto Paused Internal PR #142   Add IT tests to cover BUGs    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review Upstream review jdbc#39        
Fix TRUNCATE function bug @margarit-h In Upstream review Internal PR: #1197 Create upstream PR Get IT Merged    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Progress   Implemented and made internal PR of made PRs for day_of_week, day_of_month, and hour_of_day functions. Continue with implementation and testing for remaining functions    
[JDBC] Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Progress   Continue implementation Continue implementation, fix/add tests    
SQL describe query with column filter changes response format (#650) @Yury-Fridlyand In Review Upstream review #1181        
Add PiTest to GHA workflow @MitchellGale-BitQuill In progress   Adding PiTest to GHA workflow through gradle.      
MitchellGale commented 1 year ago

December 21st 🎄

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Progress   Add nested aggregation to DSL in POC continued. POC development and implementation discussion.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review #1067 Waiting on PR feedback. Waiting on upstream PR feedback.    
Add TIMEDIFF and DATEDIFF functions. @Yury-Fridlyand In Review On upstream review #1195        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Add functions ADDTIME and SUBTIME @Yury-Fridlyand In Review On upstream review #1194        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038 Finish fixing IT      
Clean up code @MitchellGale-BitQuill In Progress Clean up related project code        
(design) Pagination in v2 SQL engine @MaxKsyunz Complete   Review with maintainer team      
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Added unit tests Add IT tests to cover BUGsRe-create branches pointing to main    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review Upstream review jdbc#39        
Fix TRUNCATE function bug @margarit-h In Upstream review Internal PR: #1197 Addressed PR review feedback Get IT Merged    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Progress   Implemented and made internal PR of made PRs for day_of_week, day_of_month, and hour_of_day functions. Continue with implementation and testing for remaining functions    
[JDBC] Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Progress   Continue implementation, fix/add tests Refactor, test, create an internal PR against sql-jdbc repo    
SQL describe query with column filter changes response format (#650) @Yury-Fridlyand In Review Upstream review #1181        
Add PiTest to GHA workflow @MitchellGale-BitQuill In progress     Finish changes, make upstream PR    
MitchellGale commented 1 year ago

December 22nd, 2022

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Progress   Add nested aggregation to DSL in POC continued. POC development and implementation discussion.    
relevance queries accept any qualified name as field parameter.#613 @forestmvey In Review On upstream review #1067 Waiting on PR feedback. Waiting on upstream PR feedback.    
Add TIMEDIFF and DATEDIFF functions. @Yury-Fridlyand In Review On upstream review #1195        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Add functions ADDTIME and SUBTIME @Yury-Fridlyand In Review On upstream review #1194        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038 Finish fixing IT      
Clean up code @MitchellGale-BitQuill   Clean up related project code   Finish cleaning up code    
(design) Pagination in v2 SQL engine @MaxKsyunz Complete   Review with maintainer team      
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Added unit tests Add IT tests to cover BUGsRe-create branches pointing to main    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review Upstream review jdbc#39        
Fix TRUNCATE function bug @margarit-h In Upstream review Internal PR: #1197 Addressed PR review feedback Get IT Merged    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Progress   Finished making all internal PRs. Addressed feedback. Address feedback on PRs. Create PRs upstream    
[JDBC] Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Internal review Internal PR #1 Refactor, test, create an internal PR against sql-jdbc repo Address PR review feedback    
SQL describe query with column filter changes response format (#650) @Yury-Fridlyand In Review Upstream review #1181        
Add PiTest to GHA workflow @MitchellGale-BitQuill In review   Finish changes, make upstream PR      
acarbonetto commented 1 year ago

Status Update January 4th, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Review On upstream RFC #1210 Addressed comments      
Fix alias in Nested fields POC #1111 @GumpacG In Progress   Created tests Investigate where to specify the alias    
Add TIMEDIFF and DATEDIFF functions. @Yury-Fridlyand In Review On upstream review #1195        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182 Resolve conflicts      
Add functions ADDTIME and SUBTIME @Yury-Fridlyand In Review On upstream review #1194        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038   Fix UT    
Clean up code @MitchellGale-BitQuill In Review Clean up related project code #198        
(design) Pagination in v2 SQL engine @MaxKsyunz Complete   Review with maintainer team      
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Re-create branches pointing to main Add IT tests to cover BUGs    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review Upstream review jdbc#39        
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Review Upstream review #1207. Internal review #199, #197, #196, #195, #194, #190 Addressed Comments, refactored tests. Continue addressing comments. Add more tests.    
[JDBC] Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Upstream review Upstream PR jdbc#41 Addressed PR review feedback, created an upstream PR Address PR review feedback    
SQL describe query with column filter changes response format (#650) @Yury-Fridlyand Completed PR #1181 Address PR feedback      
Add PiTest to GHA workflow @MitchellGale-BitQuill In review Upstream review #1204        
Support TIME type for *_of_year functions @GabeFernandez310 In Progress   Addressed Comments, refactored tests. Continue addressing comments. Add more tests.    
Update wiremock and jetty dependencies in JDBC @Yury-Fridlyand In review Team review jdbc#2 Publish changes    
acarbonetto commented 1 year ago

Status Update: January 5th, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Review On upstream RFC #1210 Addressed comments      
Fix alias in Nested fields POC #1111 @GumpacG In Progress   Investigated where to specify the alias Continue investigating where to specify the alias    
Add TIMEDIFF and DATEDIFF functions. @Yury-Fridlyand In Review On upstream review #1195        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Add functions ADDTIME and SUBTIME @Yury-Fridlyand In Review On upstream review #1194        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand Unblocked, In Review On team review #139; Depends on #132        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix for #794 @Yury-Fridlyand PoC In Review WIP #169, #180Related/dependent on #1038 Fix UT Complete code coverage (jacoco) and fix code style (checkstyle)    
Clean up code @MitchellGale-BitQuill In Review Clean up related project code #198        
(design) Pagination in v2 SQL engine @MaxKsyunz Complete   Review with maintainer team      
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
Adding alternate syntax for match_query function @GabeFernandez310 In Review PR: #1166 Waiting for reviews Wait for comments/feedback and address.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Re-create branches pointing to main Add IT tests to cover BUGs    
Fix for #923 and #1003 - JDBC @Yury-Fridlyand In Review Upstream review jdbc#39        
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Review   Addressed Comments, refactored tests. Continue addressing comments. Add more tests. Put up PRs. Wait for review from Amazon    
[JDBC] Fix ResultSet.getTime(index, calendar) returns null bug @margarit-h In Upstream review Upstream PR jdbc#41 Addressed PR review feedback, created an upstream PR Address PR review feedback    
SQL describe query with column filter changes response format (#650) @Yury-Fridlyand Completed PR #1181 Address PR feedback      
Add PiTest to GHA workflow @MitchellGale-BitQuill In review Upstream review #1204        
Support TIME type for *_of_year functions @GabeFernandez310 In Progress   Put PR upstream Wait for reviews from Amazon    
Update wiremock and jetty dependencies in JDBC @Yury-Fridlyand Completed Upstream review jdbc#46 Publish changes      
Update links in new repos @Yury-Fridlyand In review jdbc#3, odbc#1, cli#1      
acarbonetto commented 1 year ago

Status Review - Jan 9th, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Review On upstream RFC #1210 Addressed comments      
Fix alias in Nested fields POC #1111 @GumpacG In Review Team review #201        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182 Resolve merge conflicts Resolve merge conflicts - again    
Add functions ADDTIME and SUBTIME @Yury-Fridlyand Completed On upstream review #1194        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196   Rework according to PR comments    
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254 Publish PR to upstream      
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061 Performance measurements Discuss measurement results and rework the fix if required    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180   Team code walkthrough - demo    
Clean up code @MitchellGale-BitQuill In Review Clean up related project code #198        
(design) Pagination in v2 SQL engine @MaxKsyunz Complete   Review with maintainer team      
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Re-create branches pointing to main Add IT tests to cover BUGs    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 In Review   All PRs put up. Wait for reviews from Amazon and address comments    
Add PiTest to GHA workflow @MitchellGale-BitQuill In review Upstream review #1204        
Update links in new repos @Yury-Fridlyand In review Team review jdbc#3, odbc#1, cli#1   Publish to upstream    
Refactor concat() to support multiple string arguments @Margarit Hakobyan In Progress Internal draft PR #200 Implement the solution, address initial draft PR feedback Continue implementation, add tests    
Add time_format function @GabeFernandez310 In Progress   Starting implementing tests. Continue testing. Begin adding implementation    
Fix backport PRs #1236 and #1238 @GabeFernandez310 Completed   Created Hot Fix PR #1241 and backport PR #1245 (both merged). Fix 1238 and create backport PR    
acarbonetto commented 1 year ago

Status Review - Jan 11th, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
(design) Create Nested fields POC. #1111 @forestmvey @GumpacG In Review On upstream RFC #1210 Addressed comments      
Fix alias in Nested fields POC #1111 @GumpacG In Review Team review #201        
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182 Resolve merge conflicts      
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196 Performance measurements to the proposed change      
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254 Publish PR to upstream      
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061 Change PR base branch      
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 Team code walkthrough - demo some fixes    
Clean up code @MitchellGale-BitQuill In Review Clean up related project code #198        
(design) Pagination in v2 SQL engine @MaxKsyunz Complete   Review with maintainer team      
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Re-create branches pointing to main Add IT tests to cover BUGs    
Add support for day_of_week, day_of_month, hour_of_day, minute_of_day, minute_of_hour, second_of_minute(issue #722) @GabeFernandez310 Completed All PRs Merged Upstream   N/A    
Add PiTest to GHA workflow @MitchellGale-BitQuill In review Upstream review #1204        
Update links in new repos @Yury-Fridlyand In review Upstream review jdbc#56, odbc#30, cli#8   Publish to upstream    
Refactor concat() to support multiple string arguments @Margarit Hakobyan In Review Internal PR #200 Address PR review feedback, rebase, retest Create an upstream PR    
Add time_format function @GabeFernandez310 In Progress   Finished adding a base implementation. Added Tests Discuss misalignment found between date_format and time_format functions from MySQL. Add more test cases, integration tests, documentation.    
acarbonetto commented 1 year ago

Status Review January 12, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix alias in Nested fields POC #1111 @GumpacG In Review Team review #201        
Make nested fields in SELECT fall back to legacy #1277 @GumpacG In Progress     Create an exception and catch it in the fallback listener    
PoC on reverse_nested @Forest Vey In Progress     Ramping up on criteria    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182 Resolve merge conflicts      
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196 Performance measurements to the proposed change      
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254 Publish PR to upstream      
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061 Change PR base branch      
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 Team code walkthrough - demo some fixes    
Clean up code @Yury-Fridlyand In Review Clean up related project code #198        
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Test coverage complete, need to fix score function IT failure      
Add PiTest to GHA workflow @MitchellGale-BitQuill In review Upstream review #1204        
Update links in new repos @Yury-Fridlyand In review Upstream review jdbc#56, odbc#30, cli#8   Publish to upstream    
Refactor concat() to support multiple string arguments @Margarit Hakobyan In Upstream Review Upstream PR #1279 Created an upstream PR      
Add time_format function @GabeFernandez310 In Progress   Finished adding a base implementation. Added T#1279 Discuss misalignment found between date_format and time_format functions from MySQL. Add more test cases, integration tests, documentation.    
acarbonetto commented 1 year ago

Status Review - January 16th, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix alias in Nested fields POC #1111 @GumpacG In Review Team review #201        
Make nested fields in SELECT fall back to legacy #1277 @GumpacG In Progress   Implemented a solution Finding a cleaner solution    
PoC on nested aggregation @forestmvey In Progress   Beginning POC development. POC development continued.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196 Rework according to the proposed changes      
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 some fixes      
Clean up code @Yury-Fridlyand In Progress Clean up related project code #198   Groom datetime tests    
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Test coverage complete, need to fix score function IT failure      
Update links in new repos @Yury-Fridlyand In Review Upstream review jdbc#56, odbc#30, cli#8        
Refactor concat() to support multiple string arguments @margarit-h In Upstream Review Upstream PR #1279 Addressed upstream PR review feedback Wait for another review/merge    
Add time_format function @GabeFernandez310 In Progress   Made internal PR. Began addressing some comments/feedback. Continue addressing comments/feedback internally.    
Add "WHERE field BETWEEN .. AND ..." from legacy engine @Margarit Hakobyan Investigate     Investigate whether "WHERE field BETWEEN .. AND ..." runs on V1 or V2    
acarbonetto commented 1 year ago

Status Update - January 17, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix alias in Nested fields POC #1111 @GumpacG In Review Needs discussion for requirements #201        
Make nested fields in SELECT fall back to legacy #1277 @GumpacG In Review Needs discussion for requirements #205        
Create feature branch with legacy disabled to show progress for deprecation #1144 @GumpacG     Created github action Make Github action compile all results    
PoC on nested aggregation @forestmvey In Progress   POC development continued. Finding way to allow field aggregation and non-aggregation queries in V2 engine.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180        
Clean up code @Yury-Fridlyand In Review On team review #198 Groom datetime tests checkstyle and compiler warnings fix    
Proof of concept of pagination in v2 @MaxKsyunz In Progress   Initial development Investigating how index-management and asynchronous-search plugins use indices to store internal state.    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Test coverage complete, need to fix score function IT failure      
Update links in new repos @Yury-Fridlyand In Review Upstream review jdbc#56, odbc#30, cli#8        
Refactor concat() to support multiple string arguments @margarit-h In Upstream Review Upstream PR #1279 Addressed upstream PR review feedback Wait for another review/merge    
Add time_format function @GabeFernandez310 In Progress   Finished addressing all current PR comments Wait for internal approvals before creating upstream PR    
Fix IT tests so that they call the V2 Engine properly @Margarit Hakobyan In Progress   Investigation Start fixing IT tests so that they call the V2 Engine properly    
BUG: Fixing IT correctness tests for M1 Macs @acarbonetto In Progress   Found issue Raising github issue and PR on upstream    
Add date and time correctness tests @mattrwells In Progress   Investigated setup of correctness tests and test data Update correctness tests to use current test data and fix tests not running date and time functions    
acarbonetto commented 1 year ago

Status update - January 18, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix alias in Nested fields POC #1111 @GumpacG Pushed back Further development on Nested function may eliminate the need for this task        
Make nested fields in SELECT fall back to legacy #1277 @GumpacG Pushed back Further development on Nested function may eliminate the need for this task        
Create feature branch with legacy disabled to show progress for deprecation #1144 @GumpacG In Review On team review #206 Made Github action compile all results      
PoC on nested aggregation @forestmvey In Progress   Finding way to allow field aggregation and non-aggregation queries in V2 engine. Continuing development to find solution that works with aggregation and non-aggregation queries.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180        
Clean up code @Yury-Fridlyand In Review On team review #198 Groom datetime tests checkstyle and compiler warnings fix    
Proof of concept of pagination in v2 @MaxKsyunz Done   Completed proof-of-concept demo      
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Test coverage complete, need to fix score function IT failure      
Update links in new repos @Yury-Fridlyand In Review Upstream review jdbc#56, odbc#30, cli#8        
Refactor concat() to support multiple string arguments @margarit-h In Upstream Review Upstream PR #1279 Addressed upstream PR review feedback Wait for another review/merge    
Add time_format function @GabeFernandez310 In Progress   Finished addressing all current PR comments Wait for internal approvals before creating upstream PR    
Fix IT tests so that they call the V2 Engine properly @Margarit Hakobyan In Progress   Start fixing IT tests so that they call the V2 Engine properly Continue fixing IT tests so that they call the V2 Engine properly    
Add date and time correctness tests @mattrwells In Progress   Tested which functions work on which databases Update correctness tests to be able to exclude testing on a certain database    
acarbonetto commented 1 year ago

Status Update - January 18, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix alias in Nested fields POC #1111 @GumpacG Paused Further development on Nested function may eliminate the need for this task        
Make nested fields in SELECT fall back to legacy #1277 @GumpacG Paused Further development on Nested function may eliminate the need for this task        
Create feature branch with legacy disabled to show progress for deprecation #1144 @GumpacG In Review On team review #206 Made Github action compile all results      
PoC on nested aggregation @forestmvey In Progress   Finding way to allow field aggregation and non-aggregation queries in V2 engine. Continuing development to find solution that works with aggregation and non-aggregation queries.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180        
Clean up code @Yury-Fridlyand In Review On team review #198 Groom datetime tests checkstyle and compiler warnings fix    
Proof of concept of pagination in v2 @MaxKsyunz Done   Completed proof-of-concept demo      
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Test coverage complete, need to fix score function IT failure      
Update links in new repos @Yury-Fridlyand In Review Upstream review jdbc#56, odbc#30, cli#8        
Refactor concat() to support multiple string arguments @margarit-h In Upstream Review Upstream PR #1279 Addressed upstream PR review feedback Wait for another review/merge    
Add time_format function @GabeFernandez310 In Progress   Finished addressing all current PR comments Wait for internal approvals before creating upstream PR    
Fix IT tests so that they call the V2 Engine properly @Margarit Hakobyan In Progress   Start fixing IT tests so that they call the V2 Engine properly Continue fixing IT tests so that they call the V2 Engine properly    
Add date and time correctness tests @mattrwells In Progress   Tested which functions work on which databases Update correctness tests to be able to exclude testing on a certain database    
acarbonetto commented 1 year ago

Status Review - January 23, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix arrays of nested object in Nested fields POC #1111 @GumpacG In Progress   Created tests and investigated issue Come up with a solution    
Create feature branch with legacy disabled to show progress for deprecation #1144 @GumpacG Done Merged internally and waiting for a feature branch on upstream        
PoC on nested aggregation @forestmvey In Progress   Fixing NestedAggregationParser, MetricAggregationParser to map output response from Opensearch. Ensuring fix for NestedAggregation works alongside non-aggregation nested queries.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand Paused, maybe depends on #1196 ^ On upstream review #1254        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180        
Clean up code @Yury-Fridlyand In Review On team review #198 Complete fixes      
Pagination in v2 sql engine @MaxKsyunz In progress   Published POC draft PR for feedback.      
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Fixed _score IT failures and added IT testsFixed _score in GROUP BY Adding score function as a separate function since _score is dependent.    
Update links in new repos @Yury-Fridlyand In Review Upstream review jdbc#56, odbc#30, cli#8        
Refactor concat() to support multiple string arguments @margarit-h In Upstream Review Upstream PR #1279 Addressed upstream PR review feedback Wait for another review/merge    
Add time_format function @GabeFernandez310 In Progress   Finished addressing all current PR comments Wait for internal approvals before creating upstream PR    
Fix IT tests so that they call the V2 Engine properly @Margarit Hakobyan In Progress Draft PR #207 Refactor some integration tests in MathFunctionsIT and SQLFunctionsIT to run against V2 engine Continue reworking IT tests so that they call the V2 Engine    
Add date and time correctness tests @mattrwells In Progress   Begun updating correctness test system for database specific tests Continue updating correctness test system    
Move PiTest to a new workflow @Yury-Fridlyand Completed On upstream review #1285 Publish the fix Minor changes in workflows    
Add cursor IT with JDBC @Yury-Fridlyand In Progress On team review #208 Make a PoC to discuss required tests Add tests for unreleased JDBC    
Add get_format function @GabeFernandez310 In Progress   Added tests and began implementation Continue working on implementation    
OpenTelemetry Exporter investigation @MaxKsyunz In Progress   Updated opentelemetry-demo to use elasticsearch as data sink. Review elasticsearch exporter code to identify likely changes.    
acarbonetto commented 1 year ago

Status Update - January 24, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix arrays of nested object in Nested fields POC #1111 @GumpacG In Progress   Came up with a solution Continue implementing solution    
Create feature branch with legacy disabled to show progress for deprecation #1144 @GumpacG In Review On upstream review #1292        
PoC on nested aggregation @forestmvey In Progress   Ensuring fix for NestedAggregation works alongside non-aggregation nested queries. Code cleanup and make draft PR for review.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Fix/add date/time comparison functions @Yury-Fridlyand In Review On upstream review #1196        
Rework timestamp function @Yury-Fridlyand Paused, maybe depends on #1196 ^ On upstream review #1254        
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180        
Clean up code @Yury-Fridlyand In Review On team review #198 Complete fixes      
Pagination in v2 sql engine @MaxKsyunz In progress   Published POC draft PR for feedback.      
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Fixed _score IT failures and added IT testsFixed _score in GROUP BY Adding score function as a separate function since _score is dependent.    
Update links in new repos @Yury-Fridlyand In Review Upstream review jdbc#56, odbc#30, cli#8        
Refactor concat() to support multiple string arguments @margarit-h In Upstream Review Upstream PR #1279 Addressed upstream PR review feedback Address upstream PR review feedback    
Add time_format function @GabeFernandez310 In Progress   Finished addressing all current PR comments Wait for internal approvals before creating upstream PR    
Fix IT tests so that they call the V2 Engine properly @Margarit Hakobyan In Progress Draft PR #207 Refactor integration tests in DateFunctionsIT and QueryFunctionsIT to run against V2 engine Continue reworking IT tests so that they call the V2 Engine    
Add date and time correctness tests @mattrwells In Progress   Begun updating correctness test system for database specific tests Continue updating correctness test system    
Move PiTest to a new workflow @Yury-Fridlyand Completed On upstream review #1285 Publish the fix Minor changes in workflows    
Add cursor IT with JDBC @Yury-Fridlyand In Progress On team review #208 Make a PoC to discuss required tests Add tests for unreleased JDBC    
Add get_format function @GabeFernandez310 In Progress   Internal Draft PR made with failing checks on code coverage. Investigate and fix failing checks.    
OpenTelemetry Exporter investigation @MaxKsyunz In Progress   Updated opentelemtry-demo and opentelemetry-collector-contrib to work with opensearch.      
acarbonetto commented 1 year ago

Status Update - January 27, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Update links in new repos @Yury-Fridlyand In Review Upstream review odbc#30        
Rework timestamp function @Yury-Fridlyand Paused, maybe depends on #1196 ^ On upstream review #1254        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 Research how to avoid breaking changes Keep researching    
Refactor concat() to support multiple string arguments @margarit-h In Upstream Review Upstream PR #1279 approved, need to be merged.        
PoC on nested aggregation @forestmvey Done   Code cleanup and make draft PR for review.      
Pagination in v2 sql engine @MaxKsyunz In progress   Published POC draft PR for feedback.      
OpenTelemetry Exporter investigation @MaxKsyunz In Progress   Updated opentelemtry-demo and opentelemetry-collector-contrib to work with opensearch.      
Fix/add date/time comparison functions @Yury-Fridlyand Completed #1196, #1294        
Fix arrays of nested object in Nested fields POC #1111 @GumpacG@forestmvey In Progress   Continue implementing solution Test legacy engine output vs other databases to determine expected output.    
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Fix IT tests so that they call the V2 Engine properly @margarit-h In Progress Draft PR #207 Rework IT tests so that they call the V2 Engine Continue reworking IT tests so that they call the V2 Engine    
Create feature branch with legacy disabled to show progress for deprecation #1144 @GumpacG Done          
Clean up code @Yury-Fridlyand In Review On team review #198        
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Fixed _score IT failures and added IT testsFixed _score in GROUP BY Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Progress   Addressed PR comments. Finish addressing current PR comments. Wait for more internal reviews    
Add date and time correctness tests @mattrwells In Progress   Begun updating correctness test system for database specific tests Continue updating correctness test system    
Add cursor IT with JDBC @Yury-Fridlyand In Review On team review #208 Complete fixes      
Add get_format function @GabeFernandez310 In Progress   Addressed PR comments. Reworked implementation. Finish addressing current PR comments. Wait for more internal reviews    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
acarbonetto commented 1 year ago

Status Update - Jan 30, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix arrays of nested object in Nested fields POC #1111 @GumpacG@forestmvey In Progress   Discussed and cleaned up solution Create more tests for objects and multi_nested with arrays as they were fixed as a side effect of the solution.    
PoC on nested aggregation @forestmvey Done     Fix push down after rebase.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254 Updated after #1196 merge      
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 Fix to avoid breaking changes Address PR feedback    
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz In progress   Published POC draft PR for feedback.      
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Fixed _score IT failures and added IT testsFixed _score in GROUP BY Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review   Made Upstream PR. Addressed PR comments Wait for review    
Fix IT tests so that they call the V2 Engine properly @margarit-h In Progress Draft PR #207 Rework IT tests so that they call the V2 Engine Continue reworking IT tests so that they call the V2 Engine    
Add string correctness tests @mattrwells In Progress   Wrote correctness tests Continue correctness tests    
Add cursor IT with JDBC @Yury-Fridlyand In Review On team review #208        
Add get_format function @GabeFernandez310 In Upstream Review   Made Upstream PR Wait for review    
OpenTelemetry Exporter investigation @MaxKsyunz In Progress   Updated opentelemtry-demo and opentelemetry-collector-contrib to work with opensearch.      
acarbonetto commented 1 year ago

Status Update - January 31, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix arrays of nested object in Nested fields POC #1111 @GumpacG@forestmvey In Progress   Discussed and cleaned up solution Create more tests for objects and multi_nested with arrays as they were fixed as a side effect of the solution.    
PoC on nested aggregation @forestmvey Done     Fix push down after rebase.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254 Updated after #1196 merge      
Fix aggregation for datetime types #645 @Yury-Fridlyand In Review On upstream review #1061        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 Address PR feedback Address PR feedback    
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz In progress   Published POC draft PR for feedback.      
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Fixed _score IT failures and added IT testsFixed _score in GROUP BY Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301 Made Upstream PR. Addressed PR comments Wait for review    
Fix IT tests so that they call the V2 Engine properly @margarit-h In Progress Draft PR #207 Rework IT tests so that they call the V2 Engine Continue reworking IT tests so that they call the V2 Engine    
Add string correctness tests @mattrwells In Progress   Wrote correctness tests Continue correctness tests    
Add cursor IT with JDBC @Yury-Fridlyand In Review On team review #208        
Add get_format function @GabeFernandez310 In Upstream Review #1299 Made Upstream PR Wait for review    
OpenTelemetry Exporter investigation @MaxKsyunz In Progress   Updated opentelemtry-demo and opentelemetry-collector-contrib to work with opensearch.      
acarbonetto commented 1 year ago

Status Update - January 31, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix arrays of nested object in Nested fields POC #1111 @GumpacG@forestmvey In Review On team review #213 Added tests and created PR      
Making follow-up RFC for requested changes NESTED in function. @forestmvey@GumpacG In Progress   Begin addressing comments made under: [RFC] Implement Nested in the V2 Engine by GumpacG · Pull Request #1210 · opensearch-project/sql      
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254 Updated after #1196 merge      
Fix aggregation for datetime types #645 @Yury-Fridlyand Completed #1061, #1312        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 Address PR feedback Address PR feedback    
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz In progress   Published POC draft PR for feedback.      
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Fixed _score IT failures and added IT testsFixed _score in GROUP BY Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301 Received one approval. Wait for more review, or have it merged today. Failing build due to issues mentioned in #6009  
Fix IT tests so that they call the V2 Engine properly @margarit-h In Progress Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Add string correctness tests @mattrwells In Progress   Continued correctness tests Finished tests and submitted for reviews    
Add cursor IT with JDBC @Yury-Fridlyand In Review On team review #208   Address PR feedback    
Add get_format function @GabeFernandez310 In Upstream Review #1299   Wait for review Failing build due to issues mentioned in #6009  
OpenTelemetry Exporter investigation @MaxKsyunz In Progress   Updated opentelemtry-demo and opentelemetry-collector-contrib to work with opensearch.      
acarbonetto commented 1 year ago

Status Update - Feb 1, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix arrays of nested object in Nested fields POC #1111 @GumpacG@forestmvey In Review On team review #213 Added tests and created PR      
Making follow-up RFC for requested changes NESTED in function. @forestmvey@GumpacG In Progress   Begin addressing comments made under: [RFC] Implement Nested in the V2 Engine by GumpacG · Pull Request #1210 · opensearch-project/sql      
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254 Updated after #1196 merge      
Fix aggregation for datetime types #645 @Yury-Fridlyand Completed #1061, #1312        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On team review #180 Address PR feedback Address PR feedback    
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz Paused Paused due to OpenTelemetry work.        
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Fixed _score IT failures and added IT testsFixed _score in GROUP BY Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301   Wait for more review, or have it merged today. Failing build due to issues mentioned in #6009  
Fix IT tests so that they call the V2 Engine properly @margarit-h Blocked Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Add string correctness tests @mattrwells In Review   Finished tests and submitted for review Waiting for review    
Update EXPM1 from legacy engine @mattrwells In Progress   Begun looking into EXPM1 function Begin writting EXPM1 function    
Add cursor IT with JDBC @Yury-Fridlyand In Review On team review #208   Address PR feedback    
Add get_format function @GabeFernandez310 In Upstream Review #1299 Addressed PR Comments Wait for review Failing build due to issues mentioned in #6009  
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
[SPIKE] Add support for JSON output on the V2 engine @Margarit Hakobyan In Progress   Investigate ways of adding json output format support to the V2 engine. Start implementing a solution.    
acarbonetto commented 1 year ago

Status Update - Feb 2, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Fix arrays of nested object in Nested fields POC #1111 @GumpacG@forestmvey Done A PR to upstream once the Nested function POC has been updated        
Making follow-up RFC for requested changes NESTED in function.[RFC] Implement Nested in the V2 Engine by GumpacG · Pull Request #1210 · opensearch-project/sql @forestmvey@GumpacG In Progress   Updating AST with revisions to support future with with PartiQL. Updating nested aggregation queries to work with new AST.    
Update DATE_ADD/ADDDATE and DATE_SUB/SUBDATE functions. @Yury-Fridlyand In Review On upstream review #1182        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz In Progress     @Yury-Fridlyand ramping up    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Including score function without boost option - adding tests and IT Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301   Wait for more review, or have it merged today. Failing build due to issues mentioned in #6009  
Fix IT tests so that they call the V2 Engine properly @margarit-h Paused for #1317 Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Update EXPM1 from legacy engine @mattrwells In Progress Internal PR #215 Begun looking into EXPM1 function Begin writing EXPM1 function    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add get_format function @GabeFernandez310 In Upstream Review #1299 Addressed PR Comments Wait for review Failing build due to issues mentioned in #6009  
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
[SPIKE] Add support for JSON output on the V2 engine #1317 @margarit-h In Progress   Started implementing a solution. Continue implementing the solution.    
acarbonetto commented 1 year ago

Status Update - Feb 7, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Making follow-up RFC for requested changes NESTED in function.[RFC] Implement Nested in the V2 Engine by GumpacG · Pull Request #1210 · opensearch-project/sql @forestmvey@GumpacG In Progress   Created a specific nestedArgument in the parser and cleaned up code Further clean up code, update RFC, and demo    
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz In Progress WIP is on dev-pagination-v2_revB branch @Yury-Fridlyand ramping up @Yury-Fridlyand ramping up    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Including score function without boost option - adding tests and IT Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301. Has received sufficient reviews. Converted into a draft PR for now until build issues are fixed.   Wait for more review, or have it merged today. Failing build due to issues mentioned in #6009  
Fix IT tests so that they call the V2 Engine properly @margarit-h Paused for #1317 Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Update EXPM1 from legacy engine @mattrwells In Progress Internal PR #215 PR EXMP1 Addressing comments    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add get_format function @GabeFernandez310 In Upstream Review #1299. Has received sufficient reviews. Converted into a draft PR for now until build issues are fixed.     Failing build due to issues mentioned in #6009  
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
[SPIKE] Add support for JSON output on the V2 engine #1317 @margarit-h In Progress   Started implementing a solution. Continue implementing the solution.    
Add support for last_day, sec_to_time, str_to_date, time_to_sec, weekday, yearweek @GabeFernandez310 In Progress   Wrote tests and most of implementation for extract function Continue with tests and implementation for this and other functions    
acarbonetto commented 1 year ago

Status Update | Feb 08, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Making follow-up RFC for requested changes NESTED in function.[RFC] Implement Nested in the V2 Engine by GumpacG · Pull Request #1210 · opensearch-project/sql @forestmvey@GumpacG Waiting for feedback   Further clean up code, update RFC, and demo      
Implement nested query in WHERE clause @forestmvey In Progress   Nothing Beginning implementation.    
Create tests for nested function in the select clause @GumpacG In Progress     Add integration tests and some parser tests    
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz In Progress WIP is on dev-pagination-v2_revB branch @Yury-Fridlyand ramping up @Yury-Fridlyand ramping up    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Including score function without boost option - adding tests and IT Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301. Has received sufficient reviews.   Address Comments, Pull Changes From main, reopen PR    
Fix IT tests so that they call the V2 Engine properly @margarit-h Paused for #1317 Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Update EXPM1 from legacy engine @mattrwells In Review Internal PR #215 Addressed comments Finish addressing comments and complete PR    
Update MULTIPLY from legacy engine @mattrwells In Progress   Wrote MULTIPLY Add tests and documentation    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add get_format function @GabeFernandez310 In Upstream Review #1299. Has received sufficient reviews.   Address Comments, Pull Changes From main, reopen PR    
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
[SPIKE] Add support for JSON output on the V2 engine #1317 @margarit-h In Progress Internal PR for the Spike #217 Continued implementing the solution. Address PR review feedback.    
Add support for last_day, sec_to_time, str_to_date, time_to_sec, weekday, yearweek @GabeFernandez310 In Progress   Raised internal PR for extract function. Addressed comments on several PRs and worked to fix failing checks Continue with tests and implementation for this and other functions    
acarbonetto commented 1 year ago

status update | Feb 09, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Making follow-up RFC for requested changes NESTED in function.https://github.com/opensearch-project/sql/pull/1210 @forestmvey@GumpacG Waiting for feedback   Further clean up code, update RFC, and demo      
Implement nested query in WHERE clause @forestmvey In Progress   Beginning implementation. Investigating adding subquery to filter pushDown.    
Create tests for nested function in the select clause @GumpacG In Progress     Add integration tests and some parser tests    
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP is on dev-pagination-v2_revC branch WIP Demo at sync-up    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Including score function without boost option - adding tests and IT Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301. Has received sufficient reviews. Pull Changes From main Address Comments, reopen PR    
Fix IT tests so that they call the V2 Engine properly @margarit-h Paused for #1317 Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Update EXPM1 from legacy engine @mattrwells In Review Internal PR #215 Addressed comments Address more comments    
Update MULTIPLY from legacy engine @mattrwells In Progress   Started writing tests Finish writing tests    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add get_format function @GabeFernandez310 In Upstream Review #1299. Has received sufficient reviews. Pulled changes from main and reopened PR Wait for review    
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
[SPIKE] Add support for JSON output on the V2 engine #1317 @margarit-h In Progress Internal PR for the Spike #217 Address PR review feedback. Continue reworking the solution based on the PR review feedback.    
Add support for last_day, sec_to_time, str_to_date, time_to_sec, weekday, yearweek @GabeFernandez310 In Progress   Addressed PR comments on all PRs. Investigated other functions. Continue with tests and implementation for all functions.    
acarbonetto commented 1 year ago

Status Update | Feb 13, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Making follow-up RFC for requested changes NESTED in function.[RFC] Implement Nested in the V2 Engine by GumpacG · Pull Request #1210 · opensearch-project/sql @forestmvey@GumpacG Waiting for feedback          
Implement nested query in WHERE clause @forestmvey In Progress   Add support for adding to Filter DSL without a present Operator in the WHERE clause. Continue working on supporting nested in WHERE clause with new parameter.    
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests    
Create tests for nested function in the select clause @GumpacG In Review On internal review #222        
Rework timestamp function @Yury-Fridlyand In Review On upstream review #1254        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP is on dev-pagination-v2_revC branch Add error handling Add tests, make a demo    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Including score function without boost option - adding tests and IT Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301. Has received sufficient reviews.   Address Comments, reopen PR    
Fix IT tests so that they call the V2 Engine properly @margarit-h Paused for #1317 Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Update EXPM1 from legacy engine @mattrwells In Review Internal PR #215 Addressed comments Address more comments    
Update MULTIPLY from legacy engine @mattrwells In Progress   Started writing tests Finish writing tests    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315   Address PR feedback    
Add get_format function @GabeFernandez310 In Upstream Review #1299. Has received sufficient reviews.   Address Comments    
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
[SPIKE] Add support for JSON output on the V2 engine #1317 @margarit-h In Progress Internal PR for the Spike #217 Added an integration test, cleaned up the PR.      
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek @GabeFernandez310 In Progress   Raised Internal PR for WeekOfYear. Investigated cause of CI failure from upstream. Continue testing and Implementation. CI failure from upstream.  
Fix bug with returning NaN instead of null #1280 @GumpacG In Review Internal PR #225 Added tests Fix issue    
acarbonetto commented 1 year ago

Status Update | Feb 15, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Beginning to cleanup RFC and add tests.      
Implement nested query in WHERE clause @forestmvey In Review   Cleanup code, add tests, make draft PR. Address any PR feedback.    
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests    
Create tests for nested function in the select clause @GumpacG In Review On internal review #222        
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314   Address PR feedback    
Clean up code @Yury-Fridlyand In Review On upstream review #1310   Fix merge conflicts    
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 make a demo Add tests    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #142 Including score function without boost option - adding tests and IT Adding score function as a separate function since _score is dependent.    
Add time_format function @GabeFernandez310 In Upstream Review #1301. Has received sufficient reviews.   Wait for review. Address comments.    
Fix IT tests so that they call the V2 Engine properly @margarit-h Paused for #1317 Draft PR #207   Investigate ways of adding json output format support to the V2 engine.    
Update MULTIPLY from legacy engine @mattrwells In Progress   Wrote IT Tests Add byte and short to MULTIPLY function    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315 Address PR feedback      
Add get_format function @GabeFernandez310 In Upstream Review Merged Upstream       Done
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217   Investigate differences in output between V2 and Legacy (order, non-pushdown operations not included). Investigate how to run legacy IT when JSON is supported in V2.    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek @GabeFernandez310 In Progress   Addressed some PR comments. Started str_to_date. Continue testing and Implementation.    
Fix bug with returning NaN instead of null #1280 @GumpacG In Review Internal PR #225        
acarbonetto commented 1 year ago

Status Update | Feb 16, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments?
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Beginning to cleanup RFC and add tests. Refining implementation.  
Implement nested query in WHERE clause @forestmvey In Review   Address any PR feedback.    
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests  
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314   Address PR feedback  
Clean up code @Yury-Fridlyand In Review On upstream review #1310 Fix merge conflicts    
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 make a demo Add tests  
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.  
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #288 Demo’d to Amazon and internal team - added unit tests and doctests    
Update arithmetic functions from legacy engine @mattrwells In Progress   Added other arithmetic functions Add integration tests for arithmetic functions  
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315 Address PR feedback    
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.  
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217 Investigated and discussed differences between V2 and Legacy. Moving Legacy IT to new engine  
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek @GabeFernandez310 In Progress   Addressed some PR comments. Wrote tests and began implementation of str_to_date Continue testing and Implementation.  
acarbonetto commented 1 year ago

Status Update | Feb 22, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Refining implementation. code cleanup and testing for edge cases before adding tests.    
Implement nested query in WHERE clause @forestmvey In Review   Address any PR feedback.      
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #288 Demo’d to Amazon and internal team - added unit tests and doctests      
Update arithmetic functions from legacy engine @mattrwells In Progress   Added integration tests Make improvements to code    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315   Fix failing CI    
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217 Moving Legacy IT to new engine Force New engine to fallback to legacy for unsupported operations with json format.    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Progress   Wrote tests and most of implementation for str_to_date and to_seconds Continue testing and Implementation. Make PRs for currently in-progress functions.    
acarbonetto commented 1 year ago

Status Update | Feb 24, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   code cleanup and testing for edge cases before adding tests. Implementing flattening logic at operator level.    
Implement nested query in WHERE clause @forestmvey In Review   Address any PR feedback.      
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #288 Demo’d to Amazon and internal team - added unit tests and doctests      
Update arithmetic functions from legacy engine @mattrwells In Progress   Fixed running error Work on integration tests    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315   Fix failing CI    
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217 Made new engine fall back to legacy when alias is specified. Make new engine fall back to legacy when there is aggregation and filter included in the query.    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Progress   Made Internal PRs for str_to_date and to_seconds functions. Started tests for weekday function Continue testing and Implementation.  
acarbonetto commented 1 year ago

Status Update | Feb 28th, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Cleaning up code before adding test coverage. Add code coverage tests.    
Implement nested query in WHERE clause @forestmvey In Review   Address any PR feedback.      
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests Blocked by CI build issue  
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #288 Demo’d to Amazon and internal team - added unit tests and doctests      
Update arithmetic functions from legacy engine @mattrwells In Progress   Addressing comments Continue addressing comments    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315 Fix failing CI Fix failing CI Blocked by CI build issue  
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217 Added unit tests for fall back solution Refactor fall back solution to implement visit function structure    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Progress   Addressed PR feedback/comments Address any new comments. Add more tests as requested on some PRs. Blocked by CI build issue  
acarbonetto commented 1 year ago

Status Review | March 2nd, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Add code coverage tests. Add code coverage tests continued.    
Investigate failing ODBC driver MacOS build. @forestmvey In Progress   Begin investigation.      
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests Blocked by CI build issue  
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #288 Demo’d to Amazon and internal team - added unit tests and doctests      
Update arithmetic functions from legacy engine @mattrwells In Progress   Addressing comments Continue addressing comments    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315 Fix failing CI Fix failing CI Blocked by CI build issue  
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217Internal PR for legacy fall back #237 Add unit tests for refactored fall back logic Address PR comments    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Progress   Addressed PR feedback/comments Address any new comments. Add more tests as requested on some PRs. Blocked by CI build issue  
acarbonetto commented 1 year ago

Status Update | Mar 3rd, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Add code coverage tests continued. Add code coverage tests continued.    
Investigate failing ODBC driver MacOS build. @forestmvey In Progress   Begin investigation. Debug failing build.    
Get NESTED POC feature branch ready @GumpacG In Progress   Fixed unit tests Remove aggregation implementation and fix integration tests    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests Blocked by CI build issue  
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #288 Demo’d to Amazon and internal team - added unit tests and doctests      
Update arithmetic functions from legacy engine @mattrwells In Progress   Added parameter test Implement performance test    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315 Fix failing CI Fix failing CI Blocked by CI build issue  
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217Internal PR for legacy fall back #237 Address PR comments Continue to address PR comments and make GH Actions pass    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Progress   Reworked to_seconds formatters. Code walkthrough. Addressed PR feedback. Wait for Review. Address any new comments Blocked by CI build issue  
acarbonetto commented 1 year ago

Status Update - Mar 06, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Add code coverage tests continued. Add code coverage tests continued for jacoco.    
Investigate failing ODBC driver MacOS build. @forestmvey In Progress   Debug failing build. Figure out why libiodbc is now failing compilation for intel mac.    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Progress Internal PR #288 Demo’d to Amazon and internal team - added unit tests and doctests      
Update arithmetic functions from legacy engine @mattrwells In Progress   Reverted code improvements as the hit to performance was too big Clean up code and submit    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315 Fix failing CI Fix failing CI    
OpenTelemetry Exporter @MaxKsyunz In Progress   Created a branch with a separate component for the exporter and cleaned up the code. Adding support for trace schema from SSO.    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217Internal PR for legacy fall back #237 Address PR comments Continue to address PR comments and make GH Actions pass    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Progress   Addressed comments on all PRs. CI no longer failing. Will rebase and fix any remaining issues on all PRs.    
acarbonetto commented 1 year ago

Status Update | March 07, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Add code coverage tests continued. Add code coverage tests continued for jacoco.    
Investigate failing ODBC driver MacOS build. @forestmvey In Progress   Debug failing build. Figure out why libiodbc is now failing compilation for intel mac.    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Review Internal PR #288 Submitted code for review      
Update arithmetic functions from legacy engine @mattrwells In Review   Reverted code improvements as the hit to performance was too big Clean up code and submit    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315 Fix failing CI Fix failing CI    
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217Internal PR for legacy fall back #237 Addressing PR comments Continue to rework the solution to address PR comments and add unit tests    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Review   Fixed JaCoCo and other issues on 2 PRs. Rebase and fix any remaining issues on remaining PRs.    
acarbonetto commented 1 year ago

Status Update | Mar 13, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Code cleanup and make PR. Fixing bug where non-nested fields cannot be selected alongside nested.    
Investigate failing ODBC driver MacOS build. @forestmvey In Progress     Attempt specific versions for non keg-only libiodbc and unixodbc to fix build.    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Review Internal PR #288 Submitted code for review      
Add RINT to new engine @mattrwells In Review   Fix failing github actions Continue fixing failing github actions    
Add COSH to new engine @mattrwells In Progress   Fix failing github actions Continue fixing failing github actions    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217Internal PR for legacy fall back #237 Made all tests pass Clean up internal PR for the Spike #217    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Upstream Review     Wait for review and address any PR comments.    
acarbonetto commented 1 year ago

Status Update | Mar 15, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Fixing push down logic to allow project push down with nested push down. Continued resolving push down issue with project and nested plans.    
Investigate failing ODBC driver MacOS build. @forestmvey In Progress     De-prioritized over nested implementation.    
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Progress WIP, #226 Add unit tests More unit tests for the god of the unit tests    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Review Internal PR #288 Moved table metafields to OpenSearch module Code waiting for review    
Add RINT to new engine @mattrwells In Review   Fix failing github actions Continue fixing failing github actions    
Add COSH to new engine @mattrwells In Progress   Fix failing github actions Continue fixing failing github actions    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217Internal PR for legacy fall back #237 Made all tests pass Clean up internal PR for the Spike #217    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 In Upstream Review     Wait for review and address any PR comments.    
Add support for timestampadd function @GabeFernandez310 In Progress   Wrote tests. Implemented basic implementation. Fix and continue working on implementation.    
acarbonetto commented 1 year ago

Status Report | Mar 16, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Continued resolving push down issue with project and nested plans. Continued resolving push down issue with project and nested plans.    
Investigate failing ODBC driver MacOS build. @forestmvey In Progress   De-prioritized over nested implementation.      
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Review Team review #226 Final fixes Ready for review    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Review Internal PR #288 Moved table metafields to OpenSearch module Code waiting for review    
Add RINT to new engine @mattrwells In Review   Fix failing github actions Continue fixing failing github actions    
Add COSH to new engine @mattrwells In Progress   Fix failing github actions Continue fixing failing github actions    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add support for JSON output on the V2 engine #1317 @GumpacG In Progress Internal PR for the Spike #217Internal PR for legacy fall back #237 Clean up internal PR for the Spike #217 Address comments for Internal PR for the Spike #217    
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 Done Merged into main        
Add support for timestampadd function @GabeFernandez310 In Progress   Addressed all comments. Cleaned code and added tests. Address any new feedback and comments.    
Conduct datetime performance tests @mattrwells In Progress     conduct tests on current version    
Add support for timestampdiff function @GabeFernandez310 In Progress   Initial investigation Begin writing tests    
acarbonetto commented 1 year ago

Status Update | Mar 20, 2023

Topic Dev Status Comments What have you done yesterday? What are you going to do today? Any impediments? ETA
Implement first PR to nested feature branch for nested in SELECT clause. @forestmvey In Progress   Continued resolving push down issue with project and nested plans. Make internal PR.    
Add field.* functionality to nested function in SELECT clause. @GumpacG In Progress   Added integration tests Implement solution    
Investigate failing ODBC driver MacOS build. @forestmvey On-Hold   De-prioritized over nested implementation.      
Rework on OpenSearchDataType @Yury-Fridlyand In Review On upstream review #1314        
Clean up code @Yury-Fridlyand In Review On upstream review #1310        
Pagination in v2 sql engine @MaxKsyunz@Yury-Fridlyand In Review Team review #226 Final fixes Ready for review    
(design) Planning for JOINs development @acarbonetto Paused   Determine scope for JOINs development; writing test cases. Continue adding test cases to determine legacy scope.    
Allow metadata fields with _ (#639, #339, #432, #1133) @acarbonetto In Review Internal PR #288 Moved table metafields to OpenSearch module Code waiting for review    
Add RINT to new engine @mattrwells In Review   Fix failing github actions Continue fixing failing github actions    
Add COSH to new engine @mattrwells In Progress   Fix failing github actions Continue fixing failing github actions    
Add cursor IT with JDBC @Yury-Fridlyand In Review On upstream review #1315        
Add support for JSON output on the V2 engine #1317 @GumpacG In Review Internal PR for the Spike #217        
Add support for last_day, sec_to_time, str_to_date, weekofyear, time_to_sec, weekday, yearweek, to_seconds @GabeFernandez310 Done Merged into main        
Add support for timestampadd function @GabeFernandez310 In Upstream Review   Raised PR upstream Address any new feedback and comments.    
Conduct datetime performance tests @mattrwells In Progress     conduct tests on current version    
Add support for timestampdiff function @GabeFernandez310 In Progress   Finished writing tests and began implementation Continue implementation