vmware-archive / database-stream-processor

Streaming and Incremental Computation Framework
Other
225 stars 20 forks source link

CSV ingestion for the JIT #400

Closed Kixiron closed 1 year ago

Kixiron commented 1 year ago

Implements JIT-compiled CSV data ingestion

codecov[bot] commented 1 year ago

Codecov Report

Merging #400 (9cf9ebe) into main (34ea1f3) will increase coverage by 0.22%. The diff coverage is 66.55%.

Additional details and impacted files [![Impacted file tree graph](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400/graphs/tree.svg?width=650&height=150&src=pr&token=0wZcmD11gt&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) ```diff @@ Coverage Diff @@ ## main #400 +/- ## ========================================== + Coverage 73.85% 74.07% +0.22% ========================================== Files 238 239 +1 Lines 51586 53510 +1924 ========================================== + Hits 38097 39636 +1539 - Misses 13489 13874 +385 ``` | [Impacted Files](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | Coverage Δ | | |---|---|---| | [crates/dataflow-jit/src/codegen/layout\_cache.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvY29kZWdlbi9sYXlvdXRfY2FjaGUucnM=) | `63.93% <0.00%> (-28.93%)` | :arrow_down: | | [crates/dataflow-jit/src/codegen/vtable/cmp.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvY29kZWdlbi92dGFibGUvY21wLnJz) | `100.00% <ø> (ø)` | | | [crates/dataflow-jit/src/codegen/vtable/debug.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvY29kZWdlbi92dGFibGUvZGVidWcucnM=) | `100.00% <ø> (ø)` | | | [crates/dataflow-jit/src/codegen/vtable/mod.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvY29kZWdlbi92dGFibGUvbW9kLnJz) | `92.17% <ø> (ø)` | | | [crates/dataflow-jit/src/dataflow/nodes.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvZGF0YWZsb3cvbm9kZXMucnM=) | `59.45% <0.00%> (-1.66%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/nodes/index.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvaW5kZXgucnM=) | `53.51% <0.00%> (-18.75%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/nodes/mod.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvbm9kZXMvbW9kLnJz) | `49.00% <ø> (ø)` | | | [crates/dataflow-jit/src/ir/optimize/distinct.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvb3B0aW1pemUvZGlzdGluY3QucnM=) | `66.12% <0.00%> (-3.03%)` | :arrow_down: | | [crates/dataflow-jit/src/ir/validate.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvdmFsaWRhdGUucnM=) | `29.45% <0.00%> (+0.30%)` | :arrow_up: | | [crates/dataflow-jit/src/ir/visit.rs](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware#diff-Y3JhdGVzL2RhdGFmbG93LWppdC9zcmMvaXIvdmlzaXQucnM=) | `19.25% <0.00%> (-0.87%)` | :arrow_down: | | ... and [55 more](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware) | | ... and [3 files with indirect coverage changes](https://app.codecov.io/gh/vmware/database-stream-processor/pull/400/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=vmware)