flow-php / flow

Flow PHP - data processing framework
https://flow-php.com
MIT License
491 stars 28 forks source link

Added command to convert files through cli #1247

Closed norberttech closed 1 month ago

norberttech commented 1 month ago

Change Log

Added

  • command to convert files through cli

Fixed

Changed

  • CLI command options now comes with a --output / --input prefix

Removed

Deprecated

Security


Description

github-actions[bot] commented 1 month ago

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors ```shell +-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+ | CSVExtractorBench | bench_extract_10k | 1 | 3 | 4.616mb +0.04% | 514.685ms +0.05% | ±0.21% +141.53% | | JsonExtractorBench | bench_extract_10k | 1 | 3 | 4.704mb +0.04% | 1.092s +0.47% | ±1.49% +75.63% | | ParquetExtractorBench | bench_extract_10k | 1 | 3 | 29.160mb +0.01% | 442.023ms +0.35% | ±0.66% -58.56% | | TextExtractorBench | bench_extract_10k | 1 | 3 | 4.345mb +0.04% | 33.757ms +0.91% | ±0.70% +81.17% | | XmlExtractorBench | bench_extract_10k | 1 | 3 | 4.326mb +0.04% | 646.880ms -0.39% | ±1.16% +7.80% | +-----------------------+-------------------+------+-----+-----------------+------------------+-----------------+ ```
Transformers ```shell +-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+ | RenameEntryTransformerBench | bench_transform_10k_rows | 1 | 3 | 116.620mb +0.00% | 60.391ms -2.28% | ±0.82% +33.89% | +-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+ ```
Loaders ```shell +--------------------+----------------+------+-----+------------------+------------------+----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +--------------------+----------------+------+-----+------------------+------------------+----------------+ | CSVLoaderBench | bench_load_10k | 1 | 3 | 54.814mb +0.00% | 139.366ms +0.00% | ±0.71% -6.77% | | JsonLoaderBench | bench_load_10k | 1 | 3 | 90.397mb +0.00% | 117.183ms -1.89% | ±0.83% +1.71% | | ParquetLoaderBench | bench_load_10k | 1 | 3 | 124.451mb +0.00% | 1.238s -1.23% | ±0.29% +64.46% | | TextLoaderBench | bench_load_10k | 1 | 3 | 17.536mb +0.01% | 44.247ms -0.59% | ±0.15% -93.72% | +--------------------+----------------+------+-----+------------------+------------------+----------------+ ```
Building Blocks ```shell +-------------------------+----------------------------+------+-----+------------------+------------------+-------------------------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-------------------------+----------------------------+------+-----+------------------+------------------+-------------------------------+ | RowsBench | bench_chunk_10_on_10k | 2 | 3 | 87.368mb +0.00% | 3.624ms -2.87% | ±0.78% -68.14% | | RowsBench | bench_diff_left_1k_on_10k | 2 | 3 | 102.972mb +0.00% | 188.157ms -1.07% | ±1.50% +228.46% | | RowsBench | bench_diff_right_1k_on_10k | 2 | 3 | 85.692mb +0.00% | 18.770ms -1.91% | ±1.10% +146.66% | | RowsBench | bench_drop_1k_on_10k | 2 | 3 | 88.608mb +0.00% | 1.777ms -16.83% | ±2.96% -7.92% | | RowsBench | bench_drop_right_1k_on_10k | 2 | 3 | 88.608mb +0.00% | 1.733ms -18.15% | ±1.90% -25.35% | | RowsBench | bench_entries_on_10k | 2 | 3 | 85.720mb +0.00% | 2.891ms -3.45% | ±1.15% -58.81% | | RowsBench | bench_filter_on_10k | 2 | 3 | 86.249mb +0.00% | 15.760ms +2.01% | ±1.65% +46.10% | | RowsBench | bench_find_on_10k | 2 | 3 | 86.249mb +0.00% | 15.349ms +1.68% | ±0.33% -80.65% | | RowsBench | bench_find_one_on_10k | 10 | 3 | 84.153mb +0.00% | 1.706μs -10.21% | ±2.72% +23271534957306000.00% | | RowsBench | bench_first_on_10k | 10 | 3 | 84.153mb +0.00% | 0.400μs 0.00% | ±0.00% 0.00% | | RowsBench | bench_flat_map_on_1k | 2 | 3 | 93.503mb +0.00% | 12.778ms -1.96% | ±1.38% +6.71% | | RowsBench | bench_map_on_10k | 2 | 3 | 122.874mb +0.00% | 61.781ms -3.56% | ±1.16% +104.04% | | RowsBench | bench_merge_1k_on_10k | 2 | 3 | 86.769mb +0.00% | 1.635ms -6.99% | ±3.39% +91.99% | | RowsBench | bench_partition_by_on_10k | 2 | 3 | 90.121mb +0.00% | 64.938ms -1.07% | ±0.65% -48.22% | | RowsBench | bench_remove_on_10k | 2 | 3 | 88.870mb +0.00% | 4.452ms +0.79% | ±3.16% +217.91% | | RowsBench | bench_sort_asc_on_1k | 2 | 3 | 84.302mb +0.00% | 40.291ms -3.19% | ±1.24% -41.76% | | RowsBench | bench_sort_by_on_1k | 2 | 3 | 84.303mb +0.00% | 40.108ms -2.83% | ±3.24% +96.39% | | RowsBench | bench_sort_desc_on_1k | 2 | 3 | 84.302mb +0.00% | 40.565ms -3.04% | ±1.53% +184.77% | | RowsBench | bench_sort_entries_on_1k | 2 | 3 | 86.595mb +0.00% | 7.441ms +1.37% | ±1.73% -39.21% | | RowsBench | bench_sort_on_1k | 2 | 3 | 84.153mb +0.00% | 29.490ms -0.76% | ±1.49% +36.52% | | RowsBench | bench_take_1k_on_10k | 10 | 3 | 84.153mb +0.00% | 13.949μs -1.22% | ±2.66% +119.79% | | RowsBench | bench_take_right_1k_on_10k | 10 | 3 | 84.153mb +0.00% | 16.359μs -1.78% | ±1.51% -39.66% | | RowsBench | bench_unique_on_1k | 2 | 3 | 102.973mb +0.00% | 192.456ms -0.48% | ±0.52% -57.07% | | TypeDetectorBench | bench_type_detector | 1 | 3 | 53.194mb +0.00% | 401.312ms +0.62% | ±0.89% -34.70% | | TypeDetectorBench | bench_type_detector | 1 | 3 | 13.460mb +0.01% | 81.685ms +2.14% | ±1.72% +339.57% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 107.457mb +0.00% | 484.794ms -0.25% | ±1.55% +219.63% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 55.815mb +0.00% | 246.490ms +0.61% | ±2.02% +295.27% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 14.653mb +0.01% | 54.062ms +3.93% | ±0.25% -80.02% | +-------------------------+----------------------------+------+-----+------------------+------------------+-------------------------------+ ```