flow-php / flow

Flow PHP - data processing framework
https://flow-php.com
MIT License
404 stars 23 forks source link

Added join expressions to dsl #1039

Closed norberttech closed 2 months ago

norberttech commented 2 months ago

Change Log

Added

  • join expressions to DSL

Fixed

Changed

Removed

Deprecated

Security


Description

github-actions[bot] commented 2 months ago

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors ```shell +-----------------------+-------------------+------+-----+------------------+------------------+----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-----------------------+-------------------+------+-----+------------------+------------------+----------------+ | AvroExtractorBench | bench_extract_10k | 1 | 3 | 35.288mb +0.02% | 855.869ms +0.85% | ±0.56% +9.84% | | CSVExtractorBench | bench_extract_10k | 1 | 3 | 5.008mb +0.15% | 343.674ms +0.26% | ±0.27% +10.81% | | JsonExtractorBench | bench_extract_10k | 1 | 3 | 5.163mb +0.15% | 1.070s +0.18% | ±0.91% -53.71% | | ParquetExtractorBench | bench_extract_10k | 1 | 3 | 135.829mb +0.01% | 924.142ms +2.17% | ±0.34% -69.11% | | TextExtractorBench | bench_extract_10k | 1 | 3 | 4.918mb +0.16% | 35.654ms +0.28% | ±0.52% +9.60% | | XmlExtractorBench | bench_extract_10k | 1 | 3 | 4.924mb +0.16% | 436.318ms -1.00% | ±0.47% -67.55% | +-----------------------+-------------------+------+-----+------------------+------------------+----------------+ ```
Transformers ```shell +-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+ | RenameEntryTransformerBench | bench_transform_10k_rows | 1 | 3 | 116.229mb +0.01% | 60.089ms -0.63% | ±1.69% +102.63% | +-----------------------------+--------------------------+------+-----+------------------+-----------------+-----------------+ ```
Loaders ```shell +--------------------+----------------+------+-----+------------------+------------------+-----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +--------------------+----------------+------+-----+------------------+------------------+-----------------+ | AvroLoaderBench | bench_load_10k | 1 | 3 | 96.674mb +0.01% | 452.448ms -2.34% | ±0.52% -69.50% | | CSVLoaderBench | bench_load_10k | 1 | 3 | 55.149mb +0.02% | 69.954ms +0.67% | ±0.78% -9.62% | | JsonLoaderBench | bench_load_10k | 1 | 3 | 107.582mb +0.01% | 50.347ms -2.08% | ±0.80% +24.30% | | ParquetLoaderBench | bench_load_10k | 1 | 3 | 226.997mb +0.00% | 1.417s -0.33% | ±1.79% +263.01% | | TextLoaderBench | bench_load_10k | 1 | 3 | 17.966mb +0.04% | 39.795ms -0.35% | ±0.44% -33.24% | +--------------------+----------------+------+-----+------------------+------------------+-----------------+ ```
Building Blocks ```shell +-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+ | RowsBench | bench_chunk_10_on_10k | 2 | 3 | 87.050mb +0.01% | 3.724ms +15.08% | ±2.20% +138.67% | | RowsBench | bench_diff_left_1k_on_10k | 2 | 3 | 102.648mb +0.01% | 190.759ms +2.67% | ±0.50% +36.85% | | RowsBench | bench_diff_right_1k_on_10k | 2 | 3 | 85.368mb +0.01% | 18.920ms +1.05% | ±1.42% +355.69% | | RowsBench | bench_drop_1k_on_10k | 2 | 3 | 88.290mb +0.01% | 1.861ms +7.87% | ±3.37% +2.24% | | RowsBench | bench_drop_right_1k_on_10k | 2 | 3 | 88.290mb +0.01% | 1.874ms -4.79% | ±2.62% +26.18% | | RowsBench | bench_entries_on_10k | 2 | 3 | 85.402mb +0.01% | 2.803ms +0.73% | ±2.69% +9.00% | | RowsBench | bench_filter_on_10k | 2 | 3 | 85.931mb +0.01% | 16.351ms -6.62% | ±1.03% +153.89% | | RowsBench | bench_find_on_10k | 2 | 3 | 85.931mb +0.01% | 16.399ms -4.98% | ±0.85% -19.04% | | RowsBench | bench_find_one_on_10k | 10 | 3 | 83.835mb +0.01% | 1.994μs +17.29% | ±2.40% +0.00% | | RowsBench | bench_first_on_10k | 10 | 3 | 83.835mb +0.01% | 0.400μs +33.33% | ±0.00% +0.00% | | RowsBench | bench_flat_map_on_1k | 2 | 3 | 93.185mb +0.01% | 12.588ms -0.44% | ±1.44% +333.69% | | RowsBench | bench_map_on_10k | 2 | 3 | 122.556mb +0.01% | 61.424ms -2.41% | ±0.46% -63.61% | | RowsBench | bench_merge_1k_on_10k | 2 | 3 | 86.451mb +0.01% | 1.549ms +8.57% | ±2.70% +229.60% | | RowsBench | bench_partition_by_on_10k | 2 | 3 | 89.798mb +0.01% | 65.092ms -0.19% | ±1.27% -17.23% | | RowsBench | bench_remove_on_10k | 2 | 3 | 88.552mb +0.01% | 3.830ms -8.13% | ±1.86% -24.57% | | RowsBench | bench_sort_asc_on_1k | 2 | 3 | 83.913mb +0.09% | 39.902ms -0.94% | ±1.16% -43.14% | | RowsBench | bench_sort_by_on_1k | 2 | 3 | 83.914mb +0.09% | 39.896ms -1.32% | ±0.83% +34.54% | | RowsBench | bench_sort_desc_on_1k | 2 | 3 | 83.913mb +0.09% | 40.778ms -0.45% | ±2.33% +472.27% | | RowsBench | bench_sort_entries_on_1k | 2 | 3 | 86.277mb +0.01% | 7.361ms +0.58% | ±0.97% +40.97% | | RowsBench | bench_sort_on_1k | 2 | 3 | 83.835mb +0.01% | 28.969ms +0.84% | ±3.46% +201.22% | | RowsBench | bench_take_1k_on_10k | 10 | 3 | 83.835mb +0.01% | 13.379μs +0.50% | ±0.93% +31.63% | | RowsBench | bench_take_right_1k_on_10k | 10 | 3 | 83.835mb +0.01% | 15.930μs +0.69% | ±1.47% +85.45% | | RowsBench | bench_unique_on_1k | 2 | 3 | 102.650mb +0.01% | 195.417ms +2.72% | ±0.99% -22.05% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 116.727mb +0.01% | 512.922ms +1.42% | ±0.96% -36.34% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 60.206mb +0.01% | 260.413ms +1.57% | ±0.13% -85.90% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 15.140mb +0.05% | 54.767ms +0.24% | ±0.42% -11.77% | | TypeDetectorBench | bench_type_detector | 1 | 3 | 59.961mb +0.01% | 429.912ms +0.32% | ±0.50% +2.89% | | TypeDetectorBench | bench_type_detector | 1 | 3 | 14.500mb +0.05% | 84.451ms -0.39% | ±0.60% -41.59% | +-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+ ```