flow-php / flow

Flow PHP - data processing framework
https://flow-php.com
MIT License
404 stars 23 forks source link

Added Base64 serializer #1037

Closed norberttech closed 3 months ago

norberttech commented 3 months ago

Change Log

Added

  • Added Base64 serializer

Fixed

Changed

  • Compressing serializer is not longer using base64 inside

Removed

Deprecated

Security


Description

github-actions[bot] commented 3 months ago

Flow PHP - Benchmarks

Results of the benchmarks from this PR are compared with the results from 1.x branch.

Extractors ```shell +-----------------------+-------------------+------+-----+------------------+------------------+-----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-----------------------+-------------------+------+-----+------------------+------------------+-----------------+ | AvroExtractorBench | bench_extract_10k | 1 | 3 | 35.284mb +0.01% | 855.938ms +0.44% | ±0.71% -2.02% | | CSVExtractorBench | bench_extract_10k | 1 | 3 | 5.005mb +0.07% | 341.810ms -0.09% | ±0.89% +358.99% | | JsonExtractorBench | bench_extract_10k | 1 | 3 | 5.159mb +0.07% | 1.071s +0.33% | ±0.29% -34.67% | | ParquetExtractorBench | bench_extract_10k | 1 | 3 | 135.826mb +0.00% | 918.473ms -0.15% | ±0.63% -20.24% | | TextExtractorBench | bench_extract_10k | 1 | 3 | 4.915mb +0.07% | 35.828ms +0.41% | ±0.85% +172.07% | | XmlExtractorBench | bench_extract_10k | 1 | 3 | 4.920mb +0.07% | 431.744ms -0.50% | ±0.14% -60.65% | +-----------------------+-------------------+------+-----+------------------+------------------+-----------------+ ```
Transformers ```shell +-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+ | RenameEntryTransformerBench | bench_transform_10k_rows | 1 | 3 | 116.226mb +0.00% | 59.824ms -1.43% | ±0.96% +2.16% | +-----------------------------+--------------------------+------+-----+------------------+-----------------+---------------+ ```
Loaders ```shell +--------------------+----------------+------+-----+------------------+------------------+-----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +--------------------+----------------+------+-----+------------------+------------------+-----------------+ | AvroLoaderBench | bench_load_10k | 1 | 3 | 96.670mb +0.00% | 459.950ms -0.27% | ±1.12% +234.44% | | CSVLoaderBench | bench_load_10k | 1 | 3 | 55.146mb +0.01% | 71.099ms +1.85% | ±0.59% -81.28% | | JsonLoaderBench | bench_load_10k | 1 | 3 | 107.579mb +0.00% | 50.902ms -0.61% | ±0.70% +9.35% | | ParquetLoaderBench | bench_load_10k | 1 | 3 | 226.994mb +0.00% | 1.417s -1.49% | ±0.31% -61.75% | | TextLoaderBench | bench_load_10k | 1 | 3 | 17.962mb +0.02% | 40.681ms -0.97% | ±0.53% -46.72% | +--------------------+----------------+------+-----+------------------+------------------+-----------------+ ```
Building Blocks ```shell +-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+ | benchmark | subject | revs | its | mem_peak | mode | rstdev | +-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+ | RowsBench | bench_chunk_10_on_10k | 2 | 3 | 87.050mb +0.00% | 3.542ms +8.49% | ±2.55% +172.19% | | RowsBench | bench_diff_left_1k_on_10k | 2 | 3 | 102.648mb +0.00% | 186.650ms -0.86% | ±0.63% +72.29% | | RowsBench | bench_diff_right_1k_on_10k | 2 | 3 | 85.368mb +0.00% | 18.939ms +2.18% | ±1.11% +780.46% | | RowsBench | bench_drop_1k_on_10k | 2 | 3 | 88.290mb +0.00% | 1.868ms -0.50% | ±3.08% +15.91% | | RowsBench | bench_drop_right_1k_on_10k | 2 | 3 | 88.290mb +0.00% | 1.824ms -0.29% | ±2.64% +18.61% | | RowsBench | bench_entries_on_10k | 2 | 3 | 85.402mb +0.00% | 2.618ms -0.85% | ±0.55% -77.24% | | RowsBench | bench_filter_on_10k | 2 | 3 | 85.931mb +0.00% | 16.594ms -4.92% | ±1.39% -17.99% | | RowsBench | bench_find_on_10k | 2 | 3 | 85.931mb +0.00% | 16.542ms -3.93% | ±1.67% +201.32% | | RowsBench | bench_find_one_on_10k | 10 | 3 | 83.835mb +0.00% | 1.794μs -0.34% | ±2.67% +0.00% | | RowsBench | bench_first_on_10k | 10 | 3 | 83.835mb +0.00% | 0.400μs +33.33% | ±0.00% +0.00% | | RowsBench | bench_flat_map_on_1k | 2 | 3 | 93.185mb +0.00% | 12.545ms +0.17% | ±0.40% -37.92% | | RowsBench | bench_map_on_10k | 2 | 3 | 122.556mb +0.00% | 61.354ms -1.78% | ±0.88% +56.15% | | RowsBench | bench_merge_1k_on_10k | 2 | 3 | 86.451mb +0.00% | 1.330ms -19.87% | ±2.77% +286.19% | | RowsBench | bench_partition_by_on_10k | 2 | 3 | 89.798mb +0.00% | 64.757ms -3.11% | ±0.35% +450.89% | | RowsBench | bench_remove_on_10k | 2 | 3 | 88.552mb +0.00% | 3.920ms -8.55% | ±3.15% +107.38% | | RowsBench | bench_sort_asc_on_1k | 2 | 3 | 83.913mb +0.00% | 40.515ms +0.72% | ±1.41% +233.66% | | RowsBench | bench_sort_by_on_1k | 2 | 3 | 83.914mb +0.00% | 39.599ms -2.90% | ±1.72% +101.89% | | RowsBench | bench_sort_desc_on_1k | 2 | 3 | 83.913mb +0.00% | 40.507ms -1.42% | ±0.80% +5.28% | | RowsBench | bench_sort_entries_on_1k | 2 | 3 | 86.276mb +0.00% | 7.312ms -1.75% | ±3.23% +108.58% | | RowsBench | bench_sort_on_1k | 2 | 3 | 83.835mb +0.00% | 29.291ms -1.66% | ±0.49% -81.39% | | RowsBench | bench_take_1k_on_10k | 10 | 3 | 83.835mb +0.00% | 13.479μs -0.74% | ±0.92% +0.74% | | RowsBench | bench_take_right_1k_on_10k | 10 | 3 | 83.835mb +0.00% | 15.866μs -0.83% | ±1.29% -41.30% | | RowsBench | bench_unique_on_1k | 2 | 3 | 102.649mb +0.00% | 191.892ms +0.30% | ±0.19% -59.01% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 116.727mb +0.00% | 517.195ms +0.52% | ±0.98% -26.45% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 60.205mb +0.00% | 257.103ms -1.01% | ±1.44% +195.50% | | NativeEntryFactoryBench | bench_entry_factory | 1 | 3 | 15.140mb +0.00% | 53.470ms -6.18% | ±1.37% -31.35% | | TypeDetectorBench | bench_type_detector | 1 | 3 | 59.960mb +0.00% | 434.132ms -0.00% | ±0.25% -30.90% | | TypeDetectorBench | bench_type_detector | 1 | 3 | 14.499mb +0.00% | 86.407ms -0.78% | ±2.35% +84.82% | +-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+ ```