vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

Implement JIT JSON schema generation and validation #363

Closed Kixiron closed 1 year ago

Kixiron commented 1 year ago

Addresses #349 and helps with #353 @mbudiu-vmw, makes debugging json validation much easier

codecov[bot] commented 1 year ago

Codecov Report

Merging #363 (e082d61) into main (f463b48) will decrease coverage by 0.46%. The diff coverage is 12.56%.

Additional details and impacted files [![Impacted file tree graph](https://codecov.io/gh/vmware/database-stream-processor/pull/363/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #363 +/- ## ========================================== - Coverage 72.23% 71.77% -0.46% ========================================== Files 233 233 Lines 48316 48638 +322 ========================================== + Hits 34903 34912 +9 - Misses 13413 13726 +313 ``` | [Impacted Files](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | Coverage Δ | | |---|---|---| | [crates/dataflow-jit/src/dataflow/nodes.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvZGF0YWZsb3cvbm9kZXMucnM=) | `57.14% <0.00%> (-1.69%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/exprs/select.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvZXhwcnMvc2VsZWN0LnJz) | `61.53% <0.00%> (ø)` | | | [crates/dataflow-jit/src/ir/function/flags.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvZnVuY3Rpb24vZmxhZ3MucnM=) | `36.61% <0.00%> (-12.44%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/nodes/join.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvam9pbi5ycw==) | `42.48% <0.00%> (ø)` | | | [crates/dataflow-jit/src/ir/nodes/subgraph.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvc3ViZ3JhcGgucnM=) | `62.50% <0.00%> (ø)` | | | [crates/dataflow-jit/src/ir/optimize/distinct.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvb3B0aW1pemUvZGlzdGluY3QucnM=) | `69.36% <0.00%> (-3.37%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/visit.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvdmlzaXQucnM=) | `17.54% <0.00%> (-0.43%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/nodes/aggregate.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvYWdncmVnYXRlLnJz) | `10.88% <0.59%> (-6.64%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/function/mod.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvZnVuY3Rpb24vbW9kLnJz) | `40.90% <2.70%> (-49.10%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/graph.rs](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvZ3JhcGgucnM=) | `92.38% <5.26%> (-2.41%)` | :arrow_down: | | ... and [20 more](https://codecov.io/gh/vmware/database-stream-processor/pull/363?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | | ... and [2 files with indirect coverage changes](https://codecov.io/gh/vmware/database-stream-processor/pull/363/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)