CSV options detection

[norberttech]

Change Log

Added

• CSV options detection

Fixed

Changed

Removed

Deprecated

Security

---

Description

[github-actions]

Flow PHP - Benchmarks

^{_{Results of the benchmarks from this PR are compared with the results from 1.x branch.}}

Extractors

+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| benchmark             | subject           | revs | its | mem_peak         | mode             | rstdev          |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+
| AvroExtractorBench    | bench_extract_10k | 1    | 3   | 35.129mb +0.00%  | 749.023ms -0.36% | ±0.27% -66.14%  |
| CSVExtractorBench     | bench_extract_10k | 1    | 3   | 4.783mb +0.72%   | 344.430ms +0.95% | ±0.33% +295.30% |
| JsonExtractorBench    | bench_extract_10k | 1    | 3   | 4.877mb +0.08%   | 969.015ms -1.57% | ±0.17% -50.47%  |
| ParquetExtractorBench | bench_extract_10k | 1    | 3   | 239.582mb +0.00% | 1.143s -1.89%    | ±1.46% -38.76%  |
| TextExtractorBench    | bench_extract_10k | 1    | 3   | 4.662mb +0.09%   | 54.237ms -1.42%  | ±0.74% +15.41%  |
| XmlExtractorBench     | bench_extract_10k | 1    | 3   | 4.664mb +0.09%   | 454.359ms -1.39% | ±1.32% +56.46%  |
+-----------------------+-------------------+------+-----+------------------+------------------+-----------------+

Transformers

+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| benchmark                   | subject                  | revs | its | mem_peak         | mode            | rstdev         |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+
| RenameEntryTransformerBench | bench_transform_10k_rows | 1    | 3   | 110.376mb +0.00% | 64.776ms -0.99% | ±1.08% +27.28% |
+-----------------------------+--------------------------+------+-----+------------------+-----------------+----------------+

Loaders

+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| benchmark          | subject        | revs | its | mem_peak         | mode             | rstdev          |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+
| AvroLoaderBench    | bench_load_10k | 1    | 3   | 94.740mb +0.00%  | 456.157ms -0.42% | ±0.46% -74.13%  |
| CSVLoaderBench     | bench_load_10k | 1    | 3   | 54.821mb +0.05%  | 74.644ms +3.09%  | ±1.55% +191.25% |
| JsonLoaderBench    | bench_load_10k | 1    | 3   | 105.333mb +0.00% | 57.329ms -5.12%  | ±0.92% +50.00%  |
| ParquetLoaderBench | bench_load_10k | 1    | 3   | 320.544mb +0.00% | 1.259s -2.79%    | ±0.27% -2.86%   |
| TextLoaderBench    | bench_load_10k | 1    | 3   | 17.704mb +0.02%  | 40.438ms -3.08%  | ±1.14% +299.33% |
+--------------------+----------------+------+-----+------------------+------------------+-----------------+

Building Blocks

+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| benchmark               | subject                    | revs | its | mem_peak         | mode             | rstdev          |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 115.992mb +0.00% | 392.645ms -1.03% | ±0.38% +389.61% |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 59.710mb +0.01%  | 197.160ms -2.92% | ±0.79% +71.79%  |
| NativeEntryFactoryBench | bench_entry_factory        | 1    | 3   | 14.835mb +0.03%  | 41.049ms -4.88%  | ±1.76% +178.08% |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 59.398mb +0.01%  | 325.389ms -2.94% | ±0.22% -58.10%  |
| TypeDetectorBench       | bench_type_detector        | 1    | 3   | 14.321mb +0.03%  | 64.897ms -3.73%  | ±0.49% -76.97%  |
| RowsBench               | bench_chunk_10_on_10k      | 2    | 3   | 76.456mb +0.01%  | 3.357ms -11.52%  | ±2.92% -9.55%   |
| RowsBench               | bench_diff_left_1k_on_10k  | 2    | 3   | 96.249mb +0.00%  | 182.645ms -1.70% | ±0.79% -76.27%  |
| RowsBench               | bench_diff_right_1k_on_10k | 2    | 3   | 74.775mb +0.01%  | 18.495ms -0.35%  | ±0.48% -57.71%  |
| RowsBench               | bench_drop_1k_on_10k       | 2    | 3   | 77.696mb +0.01%  | 1.677ms -16.61%  | ±3.04% +127.38% |
| RowsBench               | bench_drop_right_1k_on_10k | 2    | 3   | 77.696mb +0.01%  | 1.616ms -19.33%  | ±2.63% -3.64%   |
| RowsBench               | bench_entries_on_10k       | 2    | 3   | 74.808mb +0.01%  | 2.732ms -12.54%  | ±3.08% +55.76%  |
| RowsBench               | bench_filter_on_10k        | 2    | 3   | 75.337mb +0.01%  | 14.438ms -4.50%  | ±1.55% +87.72%  |
| RowsBench               | bench_find_on_10k          | 2    | 3   | 75.337mb +0.01%  | 14.229ms -5.47%  | ±0.82% -34.80%  |
| RowsBench               | bench_find_one_on_10k      | 10   | 3   | 73.240mb +0.01%  | 1.806μs -9.97%   | ±2.57% +10.91%  |
| RowsBench               | bench_first_on_10k         | 10   | 3   | 73.240mb +0.01%  | 0.400μs 0.00%    | ±0.00% 0.00%    |
| RowsBench               | bench_flat_map_on_1k       | 2    | 3   | 86.796mb +0.00%  | 12.553ms -13.74% | ±0.26% -91.76%  |
| RowsBench               | bench_map_on_10k           | 2    | 3   | 116.156mb +0.00% | 63.096ms -3.47%  | ±0.37% -8.41%   |
| RowsBench               | bench_merge_1k_on_10k      | 2    | 3   | 75.857mb +0.01%  | 1.177ms -28.67%  | ±2.56% +507.89% |
| RowsBench               | bench_partition_by_on_10k  | 2    | 3   | 79.204mb +0.01%  | 57.032ms -7.21%  | ±2.82% +216.52% |
| RowsBench               | bench_remove_on_10k        | 2    | 3   | 77.958mb +0.01%  | 3.826ms -10.68%  | ±3.40% +25.56%  |
| RowsBench               | bench_sort_asc_on_1k       | 2    | 3   | 73.385mb +0.01%  | 40.140ms -0.93%  | ±0.66% -71.65%  |
| RowsBench               | bench_sort_by_on_1k        | 2    | 3   | 73.386mb +0.01%  | 40.193ms -1.38%  | ±0.47% -78.08%  |
| RowsBench               | bench_sort_desc_on_1k      | 2    | 3   | 73.385mb +0.01%  | 41.015ms +0.12%  | ±1.42% -16.07%  |
| RowsBench               | bench_sort_entries_on_1k   | 2    | 3   | 75.682mb +0.01%  | 7.312ms -3.05%   | ±1.66% +64.28%  |
| RowsBench               | bench_sort_on_1k           | 2    | 3   | 73.240mb +0.01%  | 28.876ms -1.31%  | ±3.15% +302.09% |
| RowsBench               | bench_take_1k_on_10k       | 10   | 3   | 73.240mb +0.01%  | 13.466μs -0.24%  | ±1.52% -41.55%  |
| RowsBench               | bench_take_right_1k_on_10k | 10   | 3   | 73.240mb +0.01%  | 15.894μs +1.23%  | ±0.30% -71.44%  |
| RowsBench               | bench_unique_on_1k         | 2    | 3   | 96.250mb +0.00%  | 185.861ms -0.59% | ±2.15% +158.62% |
+-------------------------+----------------------------+------+-----+------------------+------------------+-----------------+