fix(internals): ensure that CTEs are emitted in topological order #9726

cpcloud · 2024-07-30T18:58:30Z

Description of changes

This PR fixes an issue reported at least twice on Zulip:

Here
most recently, and
here
a while back.

The issue was that we weren't emitting CTEs (common table expressions) in topological order,
because our find API on Nodes didn't order its output topologically.

This meant that sometimes nodes would be in topological order because that's
the way the query was constructed but in the case of queries with a graph
structure (more than one shared dependent) child nodes would be emitted before parents.

I added a flag, ordered to the find method to address the specific use case
and then passed ordered=True at the call site.

I'll run the benchmarks locally to make sure this doesn't introduce a huge
performance regression, since the sort will happen on every call to translate
even if there end up being no found CTEs.

Issues closed

None that are open on GitHub, just those discussed on Zulip.

…order

… CTEs

cpcloud · 2024-07-30T19:23:08Z

I don't see anything concerning here, eyeballing each benchmark

There are some apparent slowdowns with expression equality on the order of 20%, but since the ordered code path is never hit (confirmed by sticking an assert False under the ordered branch) I don't think it's a concern for this PR.

------------------------------------------------------------------------------------- benchmark 'test_big_eq_expr': 2 tests -------------------------------------------------------------------------------------
Name (time in ns)                        Min                   Max                Mean             StdDev              Median                IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_big_eq_expr (0001_7e6b3ca)     462.4000 (1.0)      1,821.4501 (1.0)      496.0745 (1.0)      23.5011 (1.0)      490.9500 (1.0)      10.4999 (1.05)     2839;5991        2.0158 (1.0)       95511          20
test_big_eq_expr (NOW)              580.9998 (1.26)     6,533.0023 (3.59)     609.3856 (1.23)     69.3362 (2.95)     610.9985 (1.24)     10.0008 (1.0)      1072;6607        1.6410 (0.81)     184809           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_big_expression_compile': 2 tests --------------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_big_expression_compile (0001_7e6b3ca)     230.3018 (1.0)      334.9985 (1.12)     251.4645 (1.0)      46.6977 (1.42)     230.7627 (1.0)      26.6337 (1.0)           1;1  3.9767 (1.0)           5           1
test_big_expression_compile (NOW)              238.3403 (1.03)     300.4332 (1.0)      262.5800 (1.04)     32.7799 (1.0)      238.8987 (1.04)     58.8182 (2.21)          2;0  3.8084 (0.96)          5           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_big_join_compile': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                            Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_big_join_compile (0001_7e6b3ca)     17.4475 (1.0)      17.4475 (1.0)      17.4475 (1.0)      0.0000 (1.0)      17.4475 (1.0)      0.0000 (1.0)           0;0  57.3149 (1.0)           1           1
test_big_join_compile (NOW)              17.4929 (1.00)     17.4929 (1.00)     17.4929 (1.00)     0.0000 (1.0)      17.4929 (1.00)     0.0000 (1.0)           0;0  57.1660 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_big_join_expr': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                        Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_big_join_expr (0001_7e6b3ca)     1.8894 (1.0)      2.4658 (1.0)      1.9644 (1.0)      0.0530 (1.0)      1.9590 (1.0)      0.0200 (1.59)        28;42  509.0704 (1.0)         477           1
test_big_join_expr (NOW)              1.9483 (1.03)     2.6037 (1.06)     1.9893 (1.01)     0.0914 (1.73)     1.9698 (1.01)     0.0126 (1.0)         13;56  502.7014 (0.99)        480           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_builtins[hash-large]': 2 tests ------------------------------------------------------------------------------------
Name (time in ns)                                 Min                   Max                Mean             StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_builtins[hash-large] (0001_7e6b3ca)     342.6501 (1.0)      1,394.1501 (1.08)     358.7522 (1.0)      18.2756 (1.0)      356.6500 (1.0)      4.5500 (1.0)      2495;7286        2.7874 (1.0)      133263          20
test_builtins[hash-large] (NOW)              357.1500 (1.04)     1,291.9500 (1.0)      372.2344 (1.04)     18.4384 (1.01)     369.7000 (1.04)     6.5500 (1.44)     1811;2033        2.6865 (0.96)     125550          20
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_builtins[hash-medium]': 2 tests --------------------------------------------------------------------------------------
Name (time in ns)                                  Min                   Max                Mean             StdDev              Median                IQR              Outliers  OPS (Mops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_builtins[hash-medium] (0001_7e6b3ca)     420.9978 (1.19)     7,314.0000 (5.12)     471.8747 (1.28)     92.1076 (5.44)     451.0002 (1.24)     10.0008 (2.22)    13773;19168        2.1192 (0.78)     189394           1
test_builtins[hash-medium] (NOW)              354.6500 (1.0)      1,428.2001 (1.0)      368.5926 (1.0)      16.9468 (1.0)      364.1999 (1.0)       4.5000 (1.0)      8515;22290        2.7130 (1.0)      126503          20
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_builtins[hash-small]': 2 tests ------------------------------------------------------------------------------------
Name (time in ns)                                 Min                   Max                Mean             StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_builtins[hash-small] (0001_7e6b3ca)     334.6000 (1.0)      1,303.0000 (1.0)      351.7103 (1.0)      17.5445 (1.17)     348.6501 (1.0)      7.4999 (2.11)     3185;4080        2.8432 (1.0)      128124          20
test_builtins[hash-small] (NOW)              353.1501 (1.06)     1,453.7500 (1.12)     363.8022 (1.03)     15.0503 (1.0)      361.7000 (1.04)     3.5501 (1.0)     1855;10241        2.7487 (0.97)     130481          20
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_builtins[str-large]': 2 tests -------------------------------------------------------------------------------------
Name (time in us)                                  Min                   Max                  Mean            StdDev                Median               IQR            Outliers       OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_builtins[str-large] (0001_7e6b3ca)       991.9730 (1.0)      1,060.0530 (1.0)      1,002.4708 (1.0)      5.4147 (1.0)      1,001.4760 (1.0)      4.5240 (1.0)        110;37  997.5353 (1.0)         836           1
test_builtins[str-large] (NOW)              1,005.6600 (1.01)     1,070.5530 (1.01)     1,014.7388 (1.01)     7.7403 (1.43)     1,012.4530 (1.01)     6.0620 (1.34)        26;15  985.4753 (0.99)        213           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_builtins[str-medium]': 2 tests ------------------------------------------------------------------------------------
Name (time in us)                                 Min                   Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_builtins[str-medium] (0001_7e6b3ca)     379.0200 (1.01)     1,004.4070 (2.22)     395.1631 (1.02)     16.2399 (2.54)     393.7870 (1.02)     6.0060 (1.0)         45;81        2.5306 (0.98)       1991           1
test_builtins[str-medium] (NOW)              373.9100 (1.0)        453.1300 (1.0)      385.6688 (1.0)       6.3825 (1.0)      384.8910 (1.0)      9.9722 (1.66)       730;11        2.5929 (1.0)        2093           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_builtins[str-small]': 2 tests ---------------------------------------------------------------------------------
Name (time in us)                               Min                Max               Mean            StdDev             Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_builtins[str-small] (0001_7e6b3ca)     66.0950 (1.02)     96.0620 (1.0)      68.7146 (1.00)     1.7616 (1.0)      68.3200 (1.0)      1.1430 (1.0)       966;844       14.5529 (1.00)       9074           1
test_builtins[str-small] (NOW)              64.7130 (1.0)      98.0160 (1.02)     68.6541 (1.0)      2.3206 (1.32)     68.8810 (1.01)     2.7760 (2.43)     2361;433       14.5658 (1.0)        7258           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_column_access[attr]': 2 tests ---------------------------------------------------------------------------------
Name (time in us)                               Min                Max               Mean            StdDev             Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_column_access[attr] (0001_7e6b3ca)     15.4690 (1.0)      32.8330 (1.13)     16.4562 (1.0)      0.7549 (1.0)      16.3610 (1.0)      0.2500 (1.24)     957;1869       60.7674 (1.0)       26280           1
test_column_access[attr] (NOW)              16.0510 (1.04)     29.1560 (1.0)      16.7420 (1.02)     0.8544 (1.13)     16.5920 (1.01)     0.2010 (1.0)      823;1269       59.7299 (0.98)      22384           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_column_access[int]': 2 tests --------------------------------------------------------------------------------
Name (time in us)                              Min                Max               Mean            StdDev             Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_column_access[int] (0001_7e6b3ca)     41.2190 (1.09)     69.5620 (1.22)     43.5201 (1.12)     2.2705 (1.68)     43.0020 (1.11)     0.7610 (1.15)      367;454       22.9779 (0.90)       5677           1
test_column_access[int] (NOW)              37.6720 (1.0)      56.9890 (1.0)      38.9961 (1.0)      1.3483 (1.0)      38.7440 (1.0)      0.6610 (1.0)       877;960       25.6436 (1.0)       14411           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_column_access[str]': 2 tests --------------------------------------------------------------------------------
Name (time in us)                              Min                Max               Mean            StdDev             Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_column_access[str] (0001_7e6b3ca)     15.9300 (1.0)      31.7500 (1.13)     16.7527 (1.0)      1.1965 (1.73)     16.4710 (1.0)      0.3200 (1.45)     539;2134       59.6920 (1.0)       16248           1
test_column_access[str] (NOW)              16.2410 (1.02)     28.2030 (1.0)      16.9515 (1.01)     0.6936 (1.0)      16.8420 (1.02)     0.2210 (1.0)       512;857       58.9918 (0.99)      18311           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile[large-bigquery]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-bigquery] (0001_7e6b3ca)     25.3777 (1.02)      26.3817 (1.0)      25.8344 (1.0)       0.3848 (1.0)      25.8099 (1.0)      0.7431 (1.0)          18;0  38.7080 (1.0)          39           1
test_compile[large-bigquery] (NOW)              24.8908 (1.0)      119.8519 (4.54)     28.5435 (1.10)     15.6664 (40.72)    25.9295 (1.00)     1.1936 (1.61)          1;1  35.0342 (0.91)         36           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-clickhouse]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-clickhouse] (0001_7e6b3ca)     19.1555 (1.0)      19.9313 (1.01)     19.7040 (1.01)     0.1648 (2.55)     19.7342 (1.01)     0.1354 (1.47)         11;4  50.7511 (0.99)         49           1
test_compile[large-clickhouse] (NOW)              19.4198 (1.01)     19.6776 (1.0)      19.5387 (1.0)      0.0647 (1.0)      19.5188 (1.0)      0.0924 (1.0)          16;0  51.1805 (1.0)          50           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-datafusion]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-datafusion] (0001_7e6b3ca)     20.1655 (1.0)      25.1468 (1.0)      21.3013 (1.0)      0.7995 (1.0)      21.1226 (1.0)      0.6515 (1.04)          6;2  46.9455 (1.0)          44           1
test_compile[large-datafusion] (NOW)              20.6896 (1.03)     76.7407 (3.05)     22.7413 (1.07)     8.1458 (10.19)    21.4195 (1.01)     0.6292 (1.0)           1;1  43.9729 (0.94)         46           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-druid]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-druid] (0001_7e6b3ca)     19.0298 (1.00)     19.5300 (1.0)      19.3769 (1.00)     0.1503 (1.0)      19.4445 (1.01)     0.1109 (1.0)         11;10  51.6078 (1.00)         51           1
test_compile[large-druid] (NOW)              18.9538 (1.0)      20.3911 (1.04)     19.3419 (1.0)      0.2485 (1.65)     19.2830 (1.0)      0.1536 (1.39)          5;4  51.7012 (1.0)          50           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-duckdb]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                 Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-duckdb] (0001_7e6b3ca)     18.9659 (1.0)      19.4189 (1.0)      19.1284 (1.0)      0.1074 (1.0)      19.1014 (1.0)      0.1294 (1.32)         14;3  52.2782 (1.0)          52           1
test_compile[large-duckdb] (NOW)              19.6713 (1.04)     81.1842 (4.18)     21.2125 (1.11)     8.6556 (80.62)    20.0119 (1.05)     0.0977 (1.0)          1;10  47.1420 (0.90)         50           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-exasol]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                 Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-exasol] (0001_7e6b3ca)     19.7421 (1.04)     23.4157 (1.13)     19.9817 (1.01)     0.6442 (1.60)     19.8392 (1.0)      0.0770 (1.0)           3;4  50.0457 (0.99)         49           1
test_compile[large-exasol] (NOW)              19.0453 (1.0)      20.7739 (1.0)      19.8673 (1.0)      0.4023 (1.0)      20.0242 (1.01)     0.5833 (7.58)         13;0  50.3340 (1.0)          50           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-flink]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-flink] (0001_7e6b3ca)     20.7236 (1.0)      21.4495 (1.0)      20.9955 (1.0)      0.1410 (1.73)     20.9690 (1.0)      0.2060 (3.00)         13;1  47.6293 (1.0)          47           1
test_compile[large-flink] (NOW)              21.6674 (1.05)     22.1148 (1.03)     21.9872 (1.05)     0.0815 (1.0)      21.9984 (1.05)     0.0687 (1.0)           8;5  45.4810 (0.95)         45           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-impala]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                 Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-impala] (0001_7e6b3ca)     19.4907 (1.0)      20.5046 (1.0)      19.8424 (1.0)      0.2160 (1.0)      19.8997 (1.0)      0.3389 (2.34)         16;1  50.3972 (1.0)          49           1
test_compile[large-impala] (NOW)              19.6825 (1.01)     21.3800 (1.04)     20.4099 (1.03)     0.3093 (1.43)     20.4279 (1.03)     0.1447 (1.0)         12;13  48.9958 (0.97)         48           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-mssql]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-mssql] (0001_7e6b3ca)     20.9258 (1.00)     21.4592 (1.0)      21.0762 (1.0)      0.1785 (1.0)      20.9810 (1.0)      0.1902 (1.0)          11;1  47.4468 (1.0)          47           1
test_compile[large-mssql] (NOW)              20.8748 (1.0)      21.8853 (1.02)     21.2136 (1.01)     0.2773 (1.55)     21.1006 (1.01)     0.3778 (1.99)         12;0  47.1396 (0.99)         45           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-mysql]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-mysql] (0001_7e6b3ca)     19.4536 (1.0)      20.7220 (1.04)     19.7535 (1.00)     0.2126 (2.09)     19.7360 (1.00)     0.1466 (1.0)          10;3  50.6241 (1.00)         50           1
test_compile[large-mysql] (NOW)              19.5171 (1.00)     19.9878 (1.0)      19.6706 (1.0)      0.1017 (1.0)      19.6697 (1.0)      0.1562 (1.07)         14;1  50.8373 (1.0)          46           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile[large-oracle]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-oracle] (0001_7e6b3ca)     19.8049 (1.01)     171.1754 (5.63)     23.0827 (1.16)     21.3800 (13.38)    19.9564 (1.01)     0.0902 (1.64)          1;6  43.3225 (0.86)         50           1
test_compile[large-oracle] (NOW)              19.5641 (1.0)       30.3888 (1.0)      19.9161 (1.0)       1.5974 (1.0)      19.6657 (1.0)      0.0551 (1.0)           1;3  50.2106 (1.0)          45           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-postgres]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-postgres] (0001_7e6b3ca)     19.4458 (1.0)      20.4696 (1.03)     19.7227 (1.0)      0.1823 (2.84)     19.6959 (1.0)      0.1192 (1.18)          6;4  50.7031 (1.0)          50           1
test_compile[large-postgres] (NOW)              19.5975 (1.01)     19.8751 (1.0)      19.7505 (1.00)     0.0643 (1.0)      19.7439 (1.00)     0.1007 (1.0)          15;0  50.6317 (1.00)         51           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-pyspark]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                  Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-pyspark] (0001_7e6b3ca)     19.4611 (1.0)      20.0380 (1.0)      19.6322 (1.0)      0.1209 (1.57)     19.6066 (1.0)      0.1356 (2.01)         10;3  50.9368 (1.0)          51           1
test_compile[large-pyspark] (NOW)              20.2496 (1.04)     20.6991 (1.03)     20.3696 (1.04)     0.0769 (1.0)      20.3584 (1.04)     0.0675 (1.0)           5;2  49.0927 (0.96)         47           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-risingwave]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-risingwave] (0001_7e6b3ca)     19.0605 (1.0)      23.3589 (1.14)     19.5584 (1.0)      0.7402 (4.44)     19.2555 (1.0)      0.5281 (6.55)          3;2  51.1289 (1.0)          51           1
test_compile[large-risingwave] (NOW)              19.4925 (1.02)     20.4805 (1.0)      19.8359 (1.01)     0.1665 (1.0)      19.8325 (1.03)     0.0806 (1.0)         10;10  50.4136 (0.99)         50           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-snowflake]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-snowflake] (0001_7e6b3ca)     20.7447 (1.0)      21.3597 (1.0)      20.9272 (1.0)      0.1358 (1.0)      20.9092 (1.0)      0.1919 (3.46)         18;1  47.7847 (1.0)          47           1
test_compile[large-snowflake] (NOW)              21.1084 (1.02)     22.3634 (1.05)     21.2339 (1.01)     0.1850 (1.36)     21.2056 (1.01)     0.0555 (1.0)           1;1  47.0946 (0.99)         41           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-sqlite]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                 Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-sqlite] (0001_7e6b3ca)     19.4888 (1.0)      21.3350 (1.04)     19.9501 (1.0)      0.4853 (7.05)     19.7724 (1.0)      0.6112 (8.85)          9;1  50.1252 (1.0)          48           1
test_compile[large-sqlite] (NOW)              19.9935 (1.03)     20.4828 (1.0)      20.2115 (1.01)     0.0688 (1.0)      20.2088 (1.02)     0.0691 (1.0)           9;2  49.4769 (0.99)         48           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[large-trino]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[large-trino] (0001_7e6b3ca)     21.0587 (1.01)     22.3036 (1.05)     21.2534 (1.01)     0.1771 (2.22)     21.2256 (1.01)     0.1199 (1.12)          4;1  47.0512 (0.99)         47           1
test_compile[large-trino] (NOW)              20.8277 (1.0)      21.2407 (1.0)      20.9797 (1.0)      0.0798 (1.0)      20.9729 (1.0)      0.1072 (1.0)          15;1  47.6650 (1.0)          48           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[medium-bigquery]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-bigquery] (0001_7e6b3ca)     12.1079 (1.0)      12.7942 (1.0)      12.3204 (1.0)      0.2724 (1.0)      12.1584 (1.0)      0.4266 (1.03)          2;0  81.1660 (1.0)           8           1
test_compile[medium-bigquery] (NOW)              12.4062 (1.02)     13.4103 (1.05)     12.7715 (1.04)     0.3239 (1.19)     12.6131 (1.04)     0.4156 (1.0)          19;0  78.2996 (0.96)         75           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-clickhouse]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-clickhouse] (0001_7e6b3ca)     8.5751 (1.0)      9.0578 (1.0)      8.7023 (1.0)      0.1007 (1.20)     8.6726 (1.0)      0.0559 (1.23)        14;11  114.9126 (1.0)         114           1
test_compile[medium-clickhouse] (NOW)              8.6723 (1.01)     9.1237 (1.01)     8.7979 (1.01)     0.0840 (1.0)      8.7820 (1.01)     0.0454 (1.0)         13;11  113.6639 (0.99)        112           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-datafusion]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                     Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-datafusion] (0001_7e6b3ca)     8.3429 (1.0)      13.7329 (1.51)     8.9430 (1.04)     0.7538 (7.95)     8.7085 (1.01)     0.2799 (7.80)          8;9  111.8192 (0.97)        114           1
test_compile[medium-datafusion] (NOW)              8.5376 (1.02)      9.1119 (1.0)      8.6394 (1.0)      0.0948 (1.0)      8.6201 (1.0)      0.0359 (1.0)         12;14  115.7487 (1.0)         104           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-druid]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-druid] (0001_7e6b3ca)     8.4509 (1.01)      8.9410 (1.0)      8.5841 (1.0)      0.0911 (1.0)      8.5708 (1.0)      0.0438 (1.0)         17;14  116.4942 (1.0)         112           1
test_compile[medium-druid] (NOW)              8.4028 (1.0)      10.8621 (1.21)     8.6751 (1.01)     0.3662 (4.02)     8.6236 (1.01)     0.1445 (3.30)         5;13  115.2720 (0.99)        110           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-duckdb]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                 Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-duckdb] (0001_7e6b3ca)     8.4376 (1.0)      10.0909 (1.0)      8.6217 (1.0)      0.2068 (1.0)      8.5654 (1.0)      0.1562 (1.0)           7;5  115.9867 (1.0)          98           1
test_compile[medium-duckdb] (NOW)              8.4658 (1.00)     12.3398 (1.22)     8.7540 (1.02)     0.4344 (2.10)     8.6112 (1.01)     0.2072 (1.33)         9;10  114.2335 (0.98)        109           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-exasol]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-exasol] (0001_7e6b3ca)     8.7354 (1.01)     9.1252 (1.01)     8.8013 (1.01)     0.0848 (1.0)      8.7763 (1.01)     0.0257 (1.0)           8;8  113.6200 (0.99)        104           1
test_compile[medium-exasol] (NOW)              8.6430 (1.0)      9.0793 (1.0)      8.7263 (1.0)      0.0884 (1.04)     8.6949 (1.0)      0.0574 (2.24)          9;9  114.5958 (1.0)         112           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-flink]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-flink] (0001_7e6b3ca)     9.5277 (1.0)      12.8664 (1.0)      9.7131 (1.0)      0.4075 (1.0)      9.6332 (1.0)      0.0697 (1.18)         2;12  102.9536 (1.0)         101           1
test_compile[medium-flink] (NOW)              9.6628 (1.01)     13.6111 (1.06)     9.9167 (1.02)     0.4595 (1.13)     9.8084 (1.02)     0.0592 (1.0)          2;22  100.8400 (0.98)         99           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile[medium-impala]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max              Mean             StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-impala] (0001_7e6b3ca)     8.7040 (1.03)       9.9791 (1.0)      8.8106 (1.0)       0.1523 (1.0)      8.7775 (1.02)     0.0499 (1.0)           8;8  113.4994 (1.0)          95           1
test_compile[medium-impala] (NOW)              8.4405 (1.0)      129.4990 (12.98)    9.7142 (1.10)     11.4735 (75.35)    8.5735 (1.0)      0.1144 (2.29)         1;11  102.9417 (0.91)        111           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-mssql]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-mssql] (0001_7e6b3ca)     9.6401 (1.0)      13.2329 (1.27)     9.9589 (1.00)     0.4796 (2.47)     9.8249 (1.0)      0.1157 (2.12)         6;18  100.4127 (1.00)         98           1
test_compile[medium-mssql] (NOW)              9.7706 (1.01)     10.4279 (1.0)      9.9192 (1.0)      0.1938 (1.0)      9.8379 (1.00)     0.0545 (1.0)         16;16  100.8143 (1.0)          99           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_compile[medium-mysql]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-mysql] (0001_7e6b3ca)     8.4483 (1.0)      9.0745 (1.00)     8.7172 (1.0)      0.1026 (1.27)     8.7025 (1.0)      0.0542 (1.0)         14;14  114.7162 (1.0)         112           1
test_compile[medium-mysql] (NOW)              8.6761 (1.03)     9.0637 (1.0)      8.7752 (1.01)     0.0806 (1.0)      8.7561 (1.01)     0.0630 (1.16)         15;9  113.9575 (0.99)        112           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-oracle]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-oracle] (0001_7e6b3ca)     8.5565 (1.0)      9.3659 (1.01)     8.8434 (1.0)      0.1231 (1.31)     8.8207 (1.0)      0.0630 (1.80)        14;14  113.0790 (1.0)         109           1
test_compile[medium-oracle] (NOW)              8.8579 (1.04)     9.2781 (1.0)      8.9415 (1.01)     0.0939 (1.0)      8.9147 (1.01)     0.0349 (1.0)           9;9  111.8376 (0.99)        110           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-postgres]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                   Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-postgres] (0001_7e6b3ca)     8.5015 (1.0)      11.6888 (1.30)     8.7642 (1.01)     0.3915 (4.81)     8.6851 (1.01)     0.0476 (1.50)         4;16  114.1007 (0.99)        111           1
test_compile[medium-postgres] (NOW)              8.5551 (1.01)      8.9606 (1.0)      8.6370 (1.0)      0.0814 (1.0)      8.6214 (1.0)      0.0318 (1.0)          10;9  115.7805 (1.0)         112           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_compile[medium-pyspark]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-pyspark] (0001_7e6b3ca)     8.5438 (1.0)      9.2519 (1.01)     8.6493 (1.0)      0.1103 (1.27)     8.6215 (1.0)      0.0637 (1.74)        11;11  115.6157 (1.0)         112           1
test_compile[medium-pyspark] (NOW)              8.7277 (1.02)     9.1375 (1.0)      8.8042 (1.02)     0.0870 (1.0)      8.7788 (1.02)     0.0367 (1.0)           9;9  113.5822 (0.98)        106           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-risingwave]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                     Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-risingwave] (0001_7e6b3ca)     8.4528 (1.0)      12.0628 (1.32)     8.7987 (1.0)      0.5445 (5.39)     8.6836 (1.0)      0.2065 (3.96)         5;11  113.6536 (1.0)         110           1
test_compile[medium-risingwave] (NOW)              8.6174 (1.02)      9.1206 (1.0)      8.8135 (1.00)     0.1010 (1.0)      8.8104 (1.01)     0.0521 (1.0)         23;23  113.4622 (1.00)        111           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-snowflake]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                    Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-snowflake] (0001_7e6b3ca)     9.3394 (1.0)       9.9496 (1.0)      9.5817 (1.0)      0.1135 (1.36)     9.5597 (1.0)      0.0901 (2.93)        22;10  104.3656 (1.0)         102           1
test_compile[medium-snowflake] (NOW)              9.6553 (1.03)     10.0276 (1.01)     9.7313 (1.02)     0.0836 (1.0)      9.7118 (1.02)     0.0307 (1.0)           8;8  102.7609 (0.98)         93           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-sqlite]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                 Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-sqlite] (0001_7e6b3ca)     8.2414 (1.0)       8.6906 (1.0)      8.3457 (1.0)      0.0921 (1.0)      8.3232 (1.0)      0.0865 (1.0)          17;9  119.8215 (1.0)         114           1
test_compile[medium-sqlite] (NOW)              8.4991 (1.03)     83.7711 (9.64)     9.4705 (1.13)     7.0262 (76.26)    8.7208 (1.05)     0.1820 (2.11)         1;12  105.5913 (0.88)        114           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_compile[medium-trino]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[medium-trino] (0001_7e6b3ca)     9.0166 (1.0)       9.4614 (1.0)      9.1717 (1.0)      0.1040 (1.0)      9.1809 (1.0)      0.1562 (1.0)          12;1  109.0312 (1.0)          35           1
test_compile[medium-trino] (NOW)              9.1446 (1.01)     10.4011 (1.10)     9.5592 (1.04)     0.2111 (2.03)     9.5217 (1.04)     0.2806 (1.80)         19;2  104.6110 (0.96)         94           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-bigquery]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                    Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-bigquery] (0001_7e6b3ca)     423.9150 (1.01)     660.8750 (1.03)     442.3057 (1.0)      28.3632 (1.0)      433.9940 (1.0)      7.1865 (1.0)         81;98        2.2609 (1.0)        1009           1
test_compile[small-bigquery] (NOW)              419.1660 (1.0)      642.7800 (1.0)      447.1150 (1.01)     28.9233 (1.02)     439.3140 (1.01)     9.7230 (1.35)      116;130        2.2366 (0.99)       1491           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_compile[small-clickhouse]': 2 tests ------------------------------------------------------------------------------------
Name (time in us)                                      Min                   Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-clickhouse] (0001_7e6b3ca)     248.6930 (1.0)        396.5330 (1.0)      258.3768 (1.0)      11.0051 (1.0)      256.5620 (1.0)      7.2785 (1.05)        99;70        3.8703 (1.0)        3232           1
test_compile[small-clickhouse] (NOW)              252.8910 (1.02)     1,074.2890 (2.71)     262.7491 (1.02)     18.4509 (1.68)     261.0955 (1.02)     6.9330 (1.0)         39;68        3.8059 (0.98)       2750           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_compile[small-datafusion]': 2 tests ------------------------------------------------------------------------------------
Name (time in us)                                      Min                   Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-datafusion] (0001_7e6b3ca)     253.2510 (1.0)        383.3080 (1.0)      261.5829 (1.0)      10.4432 (1.0)      260.0740 (1.0)      5.6800 (1.06)        62;68        3.8229 (1.0)        2238           1
test_compile[small-datafusion] (NOW)              262.2870 (1.04)     1,020.3380 (2.66)     271.2570 (1.04)     18.1755 (1.74)     268.4300 (1.03)     5.3700 (1.0)        47;112        3.6865 (0.96)       2774           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-druid]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                 Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-druid] (0001_7e6b3ca)     250.9060 (1.0)      719.4560 (1.61)     262.0503 (1.0)      17.6998 (1.54)     258.2000 (1.0)      5.7860 (1.0)       113;163        3.8161 (1.0)        3060           1
test_compile[small-druid] (NOW)              265.3440 (1.06)     445.5360 (1.0)      272.5178 (1.04)     11.5171 (1.0)      270.0030 (1.05)     5.9735 (1.03)        35;40        3.6695 (0.96)       2073           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-duckdb]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                  Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-duckdb] (0001_7e6b3ca)     253.4510 (1.0)      716.5000 (1.67)     263.6037 (1.0)      18.9399 (1.82)     261.5010 (1.0)      8.7970 (1.62)        36;63        3.7936 (1.0)        2242           1
test_compile[small-duckdb] (NOW)              269.2510 (1.06)     428.7340 (1.0)      275.8311 (1.05)     10.3793 (1.0)      273.4600 (1.05)     5.4310 (1.0)         52;52        3.6254 (0.96)       3126           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-exasol]': 2 tests ------------------------------------------------------------------------------------
Name (time in us)                                  Min                 Max                Mean             StdDev              Median                IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-exasol] (0001_7e6b3ca)     268.3890 (1.0)      541.7990 (1.11)     289.4136 (1.03)     23.1342 (1.95)     286.4540 (1.03)     13.3150 (2.37)      112;114        3.4553 (0.97)       3014           1
test_compile[small-exasol] (NOW)              271.9660 (1.01)     488.5680 (1.0)      280.3985 (1.0)      11.8880 (1.0)      278.8040 (1.0)       5.6150 (1.0)         64;94        3.5664 (1.0)        2420           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-flink]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                 Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-flink] (0001_7e6b3ca)     306.4610 (1.0)      431.5490 (1.00)     316.8630 (1.0)       9.9871 (1.0)      315.2390 (1.0)      6.3070 (1.03)        74;57        3.1559 (1.0)        2083           1
test_compile[small-flink] (NOW)              314.0860 (1.02)     430.9880 (1.0)      322.2556 (1.02)     10.5608 (1.06)     320.0170 (1.02)     6.1362 (1.0)         38;37        3.1031 (0.98)       1903           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-impala]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                  Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-impala] (0001_7e6b3ca)     263.4300 (1.0)      445.1150 (1.0)      273.3701 (1.0)      11.8659 (1.0)      271.6760 (1.0)      5.5410 (1.01)        70;94        3.6580 (1.0)        2916           1
test_compile[small-impala] (NOW)              271.3250 (1.03)     708.9260 (1.59)     281.1692 (1.03)     14.5474 (1.23)     279.3755 (1.03)     5.5100 (1.0)         21;29        3.5566 (0.97)       1546           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-mssql]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                 Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-mssql] (0001_7e6b3ca)     293.3570 (1.0)      420.7690 (1.0)      301.1911 (1.0)      10.1216 (1.0)      299.5635 (1.0)      5.3500 (1.0)         44;50        3.3202 (1.0)        2154           1
test_compile[small-mssql] (NOW)              302.2030 (1.03)     939.0620 (2.23)     310.6607 (1.03)     16.1386 (1.59)     307.8350 (1.03)     6.3010 (1.18)        39;67        3.2189 (0.97)       2654           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-mysql]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                 Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-mysql] (0001_7e6b3ca)     274.2510 (1.0)      479.5300 (1.0)      282.9483 (1.0)      10.4809 (1.0)      280.7385 (1.0)      6.1010 (1.01)        25;24        3.5342 (1.0)        1846           1
test_compile[small-mysql] (NOW)              283.3680 (1.03)     521.5810 (1.09)     291.9370 (1.03)     11.1167 (1.06)     289.5500 (1.03)     6.0270 (1.0)         40;40        3.4254 (0.97)       2912           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-oracle]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                  Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-oracle] (0001_7e6b3ca)     264.2720 (1.0)      658.8610 (1.45)     273.4986 (1.0)      13.4693 (1.14)     271.9865 (1.0)      7.1085 (1.21)        30;36        3.6563 (1.0)        1640           1
test_compile[small-oracle] (NOW)              275.6030 (1.04)     453.7410 (1.0)      285.3711 (1.04)     11.8561 (1.0)      283.1480 (1.04)     5.8878 (1.0)        92;103        3.5042 (0.96)       2691           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-postgres]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                    Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-postgres] (0001_7e6b3ca)     265.3940 (1.0)      668.0380 (1.42)     277.0183 (1.0)      18.3179 (1.11)     272.2870 (1.0)      6.8880 (1.11)       83;158        3.6099 (1.0)        1831           1
test_compile[small-postgres] (NOW)              271.4050 (1.02)     469.1310 (1.0)      285.1162 (1.03)     16.5715 (1.0)      282.3960 (1.04)     6.2120 (1.0)        85;124        3.5073 (0.97)       2894           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-pyspark]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                   Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-pyspark] (0001_7e6b3ca)     266.1950 (1.0)      399.7690 (1.0)      283.1539 (1.01)     12.3912 (1.20)     282.1160 (1.02)     9.4680 (1.98)       303;52        3.5316 (0.99)       2967           1
test_compile[small-pyspark] (NOW)              272.3970 (1.02)     440.8070 (1.10)     279.0687 (1.0)      10.3500 (1.0)      276.8860 (1.0)      4.7850 (1.0)         44;55        3.5833 (1.0)        2821           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-risingwave]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                      Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-risingwave] (0001_7e6b3ca)     257.8100 (1.0)      427.6220 (1.0)      270.7473 (1.0)      11.6362 (1.07)     268.6800 (1.0)      6.9380 (1.26)       129;93        3.6935 (1.0)        3096           1
test_compile[small-risingwave] (NOW)              274.2300 (1.06)     429.8260 (1.01)     282.2446 (1.04)     10.8624 (1.0)      280.4330 (1.04)     5.5235 (1.0)        97;141        3.5430 (0.96)       2909           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-snowflake]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                     Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-snowflake] (0001_7e6b3ca)     327.4920 (1.0)      600.1300 (1.13)     339.9173 (1.0)      19.4047 (1.0)      335.3570 (1.0)      7.2405 (1.12)        87;96        2.9419 (1.0)        2275           1
test_compile[small-snowflake] (NOW)              332.4720 (1.02)     528.9440 (1.0)      347.8618 (1.02)     20.5616 (1.06)     343.4830 (1.02)     6.4922 (1.0)         83;96        2.8747 (0.98)       2121           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_compile[small-sqlite]': 2 tests ------------------------------------------------------------------------------------
Name (time in us)                                  Min                   Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-sqlite] (0001_7e6b3ca)     256.1160 (1.0)        658.0590 (1.0)      272.3512 (1.02)     20.1650 (1.0)      266.6110 (1.01)     7.4240 (1.34)      104;144        3.6717 (0.98)       2210           1
test_compile[small-sqlite] (NOW)              259.8940 (1.01)     1,179.9800 (1.79)     268.0299 (1.0)      26.5483 (1.32)     265.0030 (1.0)      5.5353 (1.0)         26;83        3.7309 (1.0)        2067           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_compile[small-trino]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                 Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile[small-trino] (0001_7e6b3ca)     328.3530 (1.0)      769.3210 (1.02)     348.0944 (1.03)     24.2231 (1.15)     343.6830 (1.03)     9.5130 (1.69)        69;77        2.8728 (0.97)       1607           1
test_compile[small-trino] (NOW)              328.3830 (1.00)     753.9010 (1.0)      338.4751 (1.0)      21.0360 (1.0)      333.3430 (1.0)      5.6435 (1.0)         88;96        2.9544 (1.0)        2237           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[bigquery]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[bigquery] (0001_7e6b3ca)     19.2452 (1.0)      28.6714 (1.37)     20.1085 (1.0)      1.2699 (5.51)     19.8982 (1.0)      0.5055 (1.47)          1;2  49.7303 (1.0)          51           1
test_compile_with_drops[bigquery] (NOW)              19.8515 (1.03)     20.9176 (1.0)      20.1248 (1.00)     0.2304 (1.0)      20.0432 (1.01)     0.3438 (1.0)          15;1  49.6899 (1.00)         50           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile_with_drops[clickhouse]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                          Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[clickhouse] (0001_7e6b3ca)     16.6099 (1.03)      16.7754 (1.0)      16.6843 (1.0)       0.0334 (1.0)      16.6819 (1.02)     0.0459 (1.0)          18;0  59.9366 (1.0)          58           1
test_compile_with_drops[clickhouse] (NOW)              16.0980 (1.0)      463.3761 (27.62)    23.7004 (1.42)     57.2331 (>1000.0)  16.3714 (1.0)      0.1394 (3.04)          1;2  42.1934 (0.70)         61           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile_with_drops[datafusion]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                          Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[datafusion] (0001_7e6b3ca)     16.4090 (1.0)      126.2725 (7.33)     18.4192 (1.10)     14.2838 (80.52)    16.5323 (1.0)      0.1616 (1.0)           1;1  54.2911 (0.91)         59           1
test_compile_with_drops[datafusion] (NOW)              16.5315 (1.01)      17.2170 (1.0)      16.7940 (1.0)       0.1774 (1.0)      16.7589 (1.01)     0.2143 (1.33)         20;1  59.5452 (1.0)          60           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[druid]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[druid] (0001_7e6b3ca)     16.5046 (1.01)     17.9199 (1.03)     16.8025 (1.01)     0.2203 (1.33)     16.7381 (1.01)     0.2178 (1.36)          6;2  59.5151 (0.99)         58           1
test_compile_with_drops[druid] (NOW)              16.4070 (1.0)      17.4386 (1.0)      16.5796 (1.0)      0.1653 (1.0)      16.5190 (1.0)      0.1602 (1.0)           8;2  60.3150 (1.0)          59           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[duckdb]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[duckdb] (0001_7e6b3ca)     15.2421 (1.0)      61.3481 (3.77)     16.2362 (1.01)     5.8299 (63.08)    15.4042 (1.0)      0.1363 (1.10)         1;10  61.5907 (0.99)         62           1
test_compile_with_drops[duckdb] (NOW)              15.8825 (1.04)     16.2941 (1.0)      16.1282 (1.0)      0.0924 (1.0)      16.1387 (1.05)     0.1243 (1.0)          21;1  62.0033 (1.0)          62           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile_with_drops[exasol]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[exasol] (0001_7e6b3ca)     16.0263 (1.0)       16.7245 (1.0)      16.3599 (1.0)       0.1701 (1.0)      16.3791 (1.0)      0.2310 (1.0)          20;0  61.1252 (1.0)          60           1
test_compile_with_drops[exasol] (NOW)              16.4133 (1.02)     154.5866 (9.24)     19.4934 (1.19)     17.9182 (105.36)   16.9773 (1.04)     0.3553 (1.54)          1;3  51.2993 (0.84)         59           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[flink]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[flink] (0001_7e6b3ca)     17.9090 (1.0)      18.6681 (1.0)      18.2934 (1.0)       0.1714 (1.0)      18.2562 (1.0)      0.2281 (2.03)         17;0  54.6645 (1.0)          54           1
test_compile_with_drops[flink] (NOW)              18.0096 (1.01)     91.9507 (4.93)     19.8811 (1.09)     10.1920 (59.45)    18.4787 (1.01)     0.1125 (1.0)          1;18  50.2991 (0.92)         52           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[impala]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[impala] (0001_7e6b3ca)     17.0221 (1.02)     17.4924 (1.0)      17.1849 (1.0)      0.1532 (1.0)      17.1102 (1.0)      0.2804 (1.10)         16;0  58.1906 (1.0)          58           1
test_compile_with_drops[impala] (NOW)              16.7530 (1.0)      22.3808 (1.28)     17.3305 (1.01)     0.7354 (4.80)     17.1811 (1.00)     0.2550 (1.0)           3;4  57.7017 (0.99)         58           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[mssql]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[mssql] (0001_7e6b3ca)     17.1083 (1.0)      64.5246 (3.47)     18.0788 (1.00)     6.2630 (40.35)    17.2169 (1.0)      0.1893 (1.0)           1;1  55.3135 (1.00)         57           1
test_compile_with_drops[mssql] (NOW)              17.8287 (1.04)     18.5700 (1.0)      18.0035 (1.0)      0.1552 (1.0)      17.9457 (1.04)     0.2092 (1.11)         15;1  55.5448 (1.0)          54           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[mysql]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[mysql] (0001_7e6b3ca)     16.3956 (1.0)      17.0425 (1.0)      16.5575 (1.0)      0.1460 (1.0)      16.4904 (1.0)      0.2150 (1.0)          17;1  60.3956 (1.0)          60           1
test_compile_with_drops[mysql] (NOW)              16.9261 (1.03)     73.1207 (4.29)     18.2879 (1.10)     7.3970 (50.67)    17.2523 (1.05)     0.2952 (1.37)          1;3  54.6810 (0.91)         57           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[oracle]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[oracle] (0001_7e6b3ca)     16.7201 (1.0)      17.2217 (1.0)      16.8667 (1.0)      0.1170 (1.0)      16.8453 (1.0)      0.1835 (1.15)         21;0  59.2886 (1.0)          60           1
test_compile_with_drops[oracle] (NOW)              16.9491 (1.01)     19.4620 (1.13)     17.1372 (1.02)     0.3293 (2.82)     17.0602 (1.01)     0.1598 (1.0)           1;1  58.3526 (0.98)         58           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[postgres]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[postgres] (0001_7e6b3ca)     16.4247 (1.03)     17.0974 (1.03)     16.7866 (1.04)     0.1824 (1.33)     16.8072 (1.04)     0.1579 (1.0)          21;7  59.5712 (0.96)         59           1
test_compile_with_drops[postgres] (NOW)              15.9953 (1.0)      16.5250 (1.0)      16.1749 (1.0)      0.1371 (1.0)      16.1260 (1.0)      0.1971 (1.25)         18;0  61.8241 (1.0)          62           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile_with_drops[pyspark]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[pyspark] (0001_7e6b3ca)     16.8063 (1.01)     105.0563 (6.10)     18.5959 (1.10)     11.5537 (88.17)    17.0136 (1.01)     0.2487 (1.30)          1;3  53.7752 (0.91)         58           1
test_compile_with_drops[pyspark] (NOW)              16.6765 (1.0)       17.2201 (1.0)      16.8479 (1.0)       0.1310 (1.0)      16.8050 (1.0)      0.1908 (1.0)          17;0  59.3545 (1.0)          56           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile_with_drops[risingwave]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                          Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[risingwave] (0001_7e6b3ca)     16.8013 (1.0)      153.3648 (7.84)     19.3414 (1.13)     17.9071 (50.09)    16.9655 (1.0)      0.1574 (1.0)           1;1  51.7027 (0.88)         58           1
test_compile_with_drops[risingwave] (NOW)              16.9027 (1.01)      19.5569 (1.0)      17.0968 (1.0)       0.3575 (1.0)      16.9793 (1.00)     0.2736 (1.74)          1;1  58.4905 (1.0)          59           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_compile_with_drops[snowflake]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                         Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[snowflake] (0001_7e6b3ca)     16.5922 (1.0)      136.5458 (7.69)     18.7629 (1.07)     15.4638 (161.24)   16.7444 (1.0)      0.1293 (1.82)          1;3  53.2966 (0.94)         60           1
test_compile_with_drops[snowflake] (NOW)              17.2622 (1.04)      17.7450 (1.0)      17.5979 (1.0)       0.0959 (1.0)      17.6202 (1.05)     0.0710 (1.0)           9;5  56.8251 (1.0)          57           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[sqlite]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[sqlite] (0001_7e6b3ca)     16.2633 (1.0)      17.0205 (1.0)      16.7327 (1.0)      0.1384 (1.0)      16.7133 (1.0)      0.1099 (1.0)          16;6  59.7632 (1.0)          59           1
test_compile_with_drops[sqlite] (NOW)              16.9180 (1.04)     24.0245 (1.41)     17.1949 (1.03)     0.9115 (6.58)     17.0483 (1.02)     0.1520 (1.38)          1;1  58.1569 (0.97)         59           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_compile_with_drops[trino]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_compile_with_drops[trino] (0001_7e6b3ca)     17.9678 (1.00)     18.4799 (1.00)     18.1609 (1.0)      0.1591 (1.41)     18.1048 (1.0)      0.2735 (1.71)         18;0  55.0634 (1.0)          55           1
test_compile_with_drops[trino] (NOW)              17.9663 (1.0)      18.4230 (1.0)      18.1722 (1.00)     0.1131 (1.0)      18.1305 (1.00)     0.1600 (1.0)          18;0  55.0292 (1.00)         55           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_complex_datatype_builtins[hash]': 2 tests -----------------------------------------------------------------------------------
Name (time in ns)                                            Min                 Max                Mean            StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_complex_datatype_builtins[hash] (0001_7e6b3ca)     141.6600 (1.01)     390.7500 (1.0)      147.8477 (1.03)     6.9837 (1.39)     146.8800 (1.03)     2.6000 (1.13)     1874;2148        6.7637 (0.97)      66230         100
test_complex_datatype_builtins[hash] (NOW)              140.4700 (1.0)      424.1100 (1.09)     143.3294 (1.0)      5.0153 (1.0)      142.2700 (1.0)      2.3000 (1.0)      2012;2134        6.9769 (1.0)       66186         100
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_complex_datatype_builtins[str]': 2 tests -------------------------------------------------------------------------------
Name (time in us)                                         Min                Max              Mean            StdDev            Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_complex_datatype_builtins[str] (0001_7e6b3ca)     5.9520 (1.0)      55.2950 (1.58)     6.1860 (1.0)      0.3915 (1.26)     6.1320 (1.0)      0.1310 (2.57)      550;720      161.6566 (1.0)       46795           1
test_complex_datatype_builtins[str] (NOW)              6.3220 (1.06)     34.9170 (1.0)      6.4771 (1.05)     0.3107 (1.0)      6.4520 (1.05)     0.0510 (1.0)      589;1246      154.3896 (0.96)      52505           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_complex_datatype_parse': 2 tests ---------------------------------------------------------------------------------
Name (time in ns)                                  Min                 Max               Mean            StdDev             Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_complex_datatype_parse (0001_7e6b3ca)     56.4100 (1.0)      338.2400 (1.34)     58.9252 (1.0)      3.3320 (1.10)     58.6100 (1.0)      0.7000 (1.75)     3556;4865       16.9707 (1.0)      165235         100
test_complex_datatype_parse (NOW)              57.3100 (1.02)     251.4800 (1.0)      59.3867 (1.01)     3.0353 (1.0)      59.1100 (1.01)     0.4000 (1.0)     2168;14823       16.8388 (0.99)     159694         100
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_construction[large]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                               Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_construction[large] (0001_7e6b3ca)     10.6650 (1.03)     11.5318 (1.09)     10.9639 (1.06)     0.1804 (5.17)     10.9540 (1.06)     0.1233 (5.50)         19;9  91.2083 (0.95)         84           1
test_construction[large] (NOW)              10.3200 (1.0)      10.5316 (1.0)      10.3855 (1.0)      0.0349 (1.0)      10.3811 (1.0)      0.0224 (1.0)          18;9  96.2877 (1.0)          93           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_construction[medium]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                               Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_construction[medium] (0001_7e6b3ca)     8.3903 (1.01)      8.8206 (1.0)      8.4879 (1.0)      0.0622 (1.0)      8.4708 (1.0)      0.0690 (1.0)          32;3  117.8142 (1.0)         111           1
test_construction[medium] (NOW)              8.3076 (1.0)      10.6608 (1.21)     8.6373 (1.02)     0.3827 (6.15)     8.5184 (1.01)     0.1614 (2.34)        12;15  115.7772 (0.98)        116           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_construction[small]': 2 tests ---------------------------------------------------------------------------------
Name (time in us)                               Min                 Max               Mean            StdDev             Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_construction[small] (0001_7e6b3ca)     83.4080 (1.0)      100.9620 (1.0)      85.1241 (1.0)      1.6942 (1.0)      84.6100 (1.0)      0.5100 (1.0)       671;795       11.7476 (1.0)        6623           1
test_construction[small] (NOW)              83.4790 (1.00)     119.9980 (1.19)     85.8376 (1.01)     2.0402 (1.20)     85.1920 (1.01)     1.7135 (3.36)      651;585       11.6499 (0.99)       5660           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_dedup_schema': 2 tests --------------------------------------------------------------------------------
Name (time in us)                        Min                Max               Mean            StdDev             Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_dedup_schema (0001_7e6b3ca)     15.3590 (1.00)     27.1220 (1.0)      16.5379 (1.03)     2.4661 (1.08)     15.7800 (1.01)     0.6838 (2.44)          2;3       60.4671 (0.98)         29           1
test_dedup_schema (NOW)              15.3000 (1.0)      27.6020 (1.02)     16.1309 (1.0)      2.2848 (1.0)      15.5600 (1.0)      0.2802 (1.0)           2;4       61.9927 (1.0)          29           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------------- benchmark 'test_dedup_schema_failure_mode': 2 tests ---------------------------------------------------------------------------------------
Name (time in us)                                      Min                     Max                  Mean                 StdDev              Median                IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_dedup_schema_failure_mode (0001_7e6b3ca)     752.3880 (1.0)      149,018.9420 (1.22)     9,140.4199 (1.04)     31,359.6799 (1.08)     856.4760 (1.0)      76.3920 (1.13)        55;57  109.4042 (0.96)        841           1
test_dedup_schema_failure_mode (NOW)              771.9860 (1.03)     121,703.0440 (1.0)      8,765.1180 (1.0)      28,929.0756 (1.0)      863.5400 (1.01)     67.6710 (1.0)         50;56  114.0886 (1.0)         719           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------- benchmark 'test_duckdb_timestamp_conversion': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_duckdb_timestamp_conversion (0001_7e6b3ca)     1.1332 (1.02)     1.1806 (1.03)     1.1496 (1.02)     0.0191 (1.30)     1.1481 (1.02)     0.0249 (1.51)          1;0  0.8698 (0.98)          5           1
test_duckdb_timestamp_conversion (NOW)              1.1121 (1.0)      1.1496 (1.0)      1.1249 (1.0)      0.0147 (1.0)      1.1201 (1.0)      0.0165 (1.0)           1;0  0.8890 (1.0)           5           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------- benchmark 'test_duckdb_to_pyarrow': 2 tests ----------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_duckdb_to_pyarrow (0001_7e6b3ca)     1.1898 (1.0)      1.2253 (1.0)      1.2073 (1.0)      0.0149 (1.20)     1.2034 (1.0)      0.0252 (1.12)          2;0  0.8283 (1.0)           5           1
test_duckdb_to_pyarrow (NOW)              1.2027 (1.01)     1.2283 (1.00)     1.2177 (1.01)     0.0124 (1.0)      1.2243 (1.02)     0.0225 (1.0)           1;0  0.8212 (0.99)          5           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_eq_datatypes[complex]': 2 tests -----------------------------------------------------------------------------------
Name (time in ns)                                  Min                 Max                Mean            StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_eq_datatypes[complex] (0001_7e6b3ca)     171.1200 (1.01)     317.5000 (1.0)      180.8843 (1.02)     5.0396 (1.0)      179.9400 (1.02)     1.5000 (1.0)      1841;2419        5.5284 (0.98)      53516         100
test_eq_datatypes[complex] (NOW)              169.3300 (1.0)      353.7700 (1.11)     177.5456 (1.0)      6.5476 (1.30)     176.4400 (1.0)      2.1100 (1.41)     2328;2752        5.6324 (1.0)       54753         100
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_eq_datatypes[singletons]': 2 tests -----------------------------------------------------------------------------------
Name (time in ns)                                     Min                 Max                Mean             StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_eq_datatypes[singletons] (0001_7e6b3ca)     136.3500 (1.0)      516.3800 (1.0)      142.6832 (1.0)       5.5383 (1.0)      141.1700 (1.0)      4.4000 (1.0)      3948;1692        7.0085 (1.0)       67714         100
test_eq_datatypes[singletons] (NOW)              136.4600 (1.00)     557.1600 (1.08)     147.2420 (1.03)     13.3909 (2.42)     144.1800 (1.02)     4.7100 (1.07)     4070;4920        6.7915 (0.97)      68269         100
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_execute[cast_to_dates]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                  Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[cast_to_dates] (0001_7e6b3ca)     29.6202 (1.0)      31.8928 (1.01)     30.7440 (1.0)      0.6477 (2.40)     30.7790 (1.0)      1.0175 (2.38)         12;0  32.5267 (1.0)          32           1
test_execute[cast_to_dates] (NOW)              30.6194 (1.03)     31.5323 (1.0)      30.9698 (1.01)     0.2697 (1.0)      30.9638 (1.01)     0.4273 (1.0)          11;0  32.2895 (0.99)         32           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_execute[cast_to_dates_from_strings]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                               Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[cast_to_dates_from_strings] (0001_7e6b3ca)     31.1914 (1.0)      32.9061 (1.0)      32.0848 (1.0)      0.3898 (1.93)     31.9838 (1.0)      0.5256 (1.90)          7;0  31.1674 (1.0)          30           1
test_execute[cast_to_dates_from_strings] (NOW)              32.5817 (1.04)     33.4140 (1.02)     32.9375 (1.03)     0.2021 (1.0)      32.9377 (1.03)     0.2760 (1.0)          10;0  30.3606 (0.97)         30           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_execute[high_card_group_by]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[high_card_group_by] (0001_7e6b3ca)     4.0930 (1.0)      5.5788 (1.0)      4.4159 (1.00)     0.3176 (1.0)      4.2766 (1.00)     0.2864 (1.18)        30;19  226.4534 (1.00)        179           1
test_execute[high_card_group_by] (NOW)              4.0948 (1.00)     5.7573 (1.03)     4.4142 (1.0)      0.3241 (1.02)     4.2693 (1.0)      0.2435 (1.0)         29;26  226.5415 (1.0)         180           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_execute[high_card_grouped_rolling]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                              Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[high_card_grouped_rolling] (0001_7e6b3ca)     10.5168 (1.0)      140.7039 (10.64)    12.8334 (1.13)     15.3988 (26.70)    10.8862 (1.0)      0.4127 (1.0)           1;5  77.9216 (0.88)         71           1
test_execute[high_card_grouped_rolling] (NOW)              10.5643 (1.00)      13.2208 (1.0)      11.3133 (1.0)       0.5767 (1.0)      11.1206 (1.02)     0.5950 (1.44)         15;3  88.3915 (1.0)          65           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_execute[low_card_grouped_rolling]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[low_card_grouped_rolling] (0001_7e6b3ca)     11.0410 (1.00)     14.4742 (1.03)     11.7052 (1.02)     0.5742 (1.07)     11.6032 (1.02)     0.6017 (1.41)         11;4  85.4321 (0.98)         67           1
test_execute[low_card_grouped_rolling] (NOW)              11.0261 (1.0)      14.0527 (1.0)      11.5138 (1.0)      0.5390 (1.0)      11.3204 (1.0)      0.4258 (1.0)          10;5  86.8522 (1.0)          65           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_execute[multikey_group_by_with_mutate]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                                                 Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[multikey_group_by_with_mutate] (0001_7e6b3ca)     5.7692 (1.00)     7.0718 (1.05)     6.0336 (1.00)     0.1916 (1.0)      5.9853 (1.02)     0.1599 (1.0)         27;10  165.7395 (1.00)        139           1
test_execute[multikey_group_by_with_mutate] (NOW)              5.7488 (1.0)      6.7485 (1.0)      6.0086 (1.0)      0.2709 (1.41)     5.8892 (1.0)      0.4311 (2.70)         23;0  166.4287 (1.0)         118           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_execute[multikey_sort]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                  Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[multikey_sort] (0001_7e6b3ca)     23.7419 (1.0)      35.7027 (1.0)      29.4019 (1.0)      4.1112 (1.09)     29.0569 (1.0)      8.0659 (1.27)         13;0  34.0115 (1.0)          29           1
test_execute[multikey_sort] (NOW)              24.0555 (1.01)     36.4009 (1.02)     30.2762 (1.03)     3.7807 (1.0)      31.7991 (1.09)     6.3426 (1.0)          10;0  33.0292 (0.97)         29           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_execute[multikey_sort_projection]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                            Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[multikey_sort_projection] (0001_7e6b3ca)     7.6808 (1.0)      10.4864 (1.0)      8.4242 (1.0)      0.7838 (1.0)      8.0982 (1.0)      0.9519 (1.0)          19;2  118.7060 (1.0)         101           1
test_execute[multikey_sort_projection] (NOW)              7.8919 (1.03)     11.3961 (1.09)     8.6827 (1.03)     0.7886 (1.01)     8.3594 (1.03)     0.9527 (1.00)         18;3  115.1715 (0.97)         98           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_execute[simple_sort]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[simple_sort] (0001_7e6b3ca)     23.7549 (1.00)     36.8542 (1.06)     29.9199 (1.05)     4.4145 (1.57)     31.9332 (1.11)     7.9471 (1.83)         10;0  33.4225 (0.95)         27           1
test_execute[simple_sort] (NOW)              23.6382 (1.0)      34.7361 (1.0)      28.5411 (1.0)      2.8086 (1.0)      28.6920 (1.0)      4.3400 (1.0)          11;0  35.0372 (1.0)          30           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_execute[simple_sort_projection]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                          Min                 Max              Mean             StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_execute[simple_sort_projection] (0001_7e6b3ca)     5.3622 (1.0)        8.0670 (1.0)      5.9957 (1.0)       0.5689 (1.0)      5.8161 (1.0)      0.5076 (1.0)         23;13  166.7857 (1.0)         140           1
test_execute[simple_sort_projection] (NOW)              6.4011 (1.19)     171.1989 (21.22)    9.0404 (1.51)     15.5697 (27.37)    7.0733 (1.22)     1.5897 (3.13)          1;1  110.6151 (0.66)        111           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_ibis_duckdb_to_pyarrow': 2 tests ---------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_ibis_duckdb_to_pyarrow (0001_7e6b3ca)     1.1905 (1.0)      1.2213 (1.0)      1.2011 (1.0)      0.0123 (1.11)     1.2004 (1.0)      0.0145 (1.0)           1;0  0.8326 (1.0)           5           1
test_ibis_duckdb_to_pyarrow (NOW)              1.1940 (1.00)     1.2228 (1.00)     1.2065 (1.00)     0.0111 (1.0)      1.2077 (1.01)     0.0150 (1.04)          2;0  0.8289 (1.00)          5           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_insert_duckdb[no_overwrite]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_insert_duckdb[no_overwrite] (0001_7e6b3ca)     10.9512 (1.01)     15.1710 (1.0)      11.6949 (1.0)      0.7313 (1.0)      11.5495 (1.0)      0.8037 (1.23)          7;2  85.5070 (1.0)          60           1
test_insert_duckdb[no_overwrite] (NOW)              10.8650 (1.0)      19.3971 (1.28)     11.7541 (1.01)     1.0372 (1.42)     11.5762 (1.00)     0.6526 (1.0)           4;3  85.0770 (0.99)         71           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_insert_duckdb[overwrite]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_insert_duckdb[overwrite] (0001_7e6b3ca)     11.3550 (1.0)      16.7812 (1.00)     12.3077 (1.0)      0.9438 (1.0)      12.1261 (1.0)      0.9242 (1.13)          6;3  81.2499 (1.0)          68           1
test_insert_duckdb[overwrite] (NOW)              11.6420 (1.03)     16.7150 (1.0)      12.8678 (1.05)     1.0269 (1.09)     12.6549 (1.04)     0.8165 (1.0)          15;5  77.7134 (0.96)         68           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_large_expr_equals': 2 tests -------------------------------------------------------------------------------------
Name (time in ns)                              Min                   Max                Mean             StdDev              Median                IQR            Outliers  OPS (Mops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_large_expr_equals (0001_7e6b3ca)     485.4499 (1.0)      1,323.5000 (1.0)      499.3691 (1.0)      19.1589 (1.0)      496.4000 (1.0)       4.5502 (1.0)     1797;5049        2.0025 (1.0)       86267          20
test_large_expr_equals (NOW)              580.9998 (1.20)     6,432.0011 (4.86)     608.8391 (1.22)     80.3888 (4.20)     601.9982 (1.21)     10.0008 (2.20)     924;3415        1.6425 (0.82)     171498           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_large_union_compile[10000]': 2 tests ---------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_large_union_compile[10000] (0001_7e6b3ca)     8.9038 (1.0)      9.0332 (1.0)      8.9499 (1.0)      0.0505 (1.0)      8.9367 (1.0)      0.0600 (1.0)           1;0  0.1117 (1.0)           5           1
test_large_union_compile[10000] (NOW)              9.0421 (1.02)     9.4096 (1.04)     9.2328 (1.03)     0.1304 (2.58)     9.2349 (1.03)     0.1115 (1.86)          2;0  0.1083 (0.97)          5           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_large_union_compile[1000]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_large_union_compile[1000] (0001_7e6b3ca)     872.3578 (1.01)     927.8765 (1.04)     897.6269 (1.02)     20.3684 (2.10)     898.1360 (1.02)     23.9756 (2.35)          2;0  1.1140 (0.98)          5           1
test_large_union_compile[1000] (NOW)              862.5618 (1.0)      889.4114 (1.0)      877.1679 (1.0)       9.7007 (1.0)      877.4660 (1.0)      10.2227 (1.0)           2;0  1.1400 (1.0)           5           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_large_union_construct[10000]': 2 tests --------------------------------------------------------------------------------
Name (time in ms)                                         Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_large_union_construct[10000] (0001_7e6b3ca)     808.0645 (1.0)      882.3510 (1.07)     825.6291 (1.01)     31.8098 (8.20)     813.6527 (1.0)      21.7021 (3.67)          1;1  1.2112 (0.99)          5           1
test_large_union_construct[10000] (NOW)              815.3145 (1.01)     825.1495 (1.0)      820.7674 (1.0)       3.8809 (1.0)      821.5881 (1.01)      5.9123 (1.0)           2;0  1.2184 (1.0)           5           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_large_union_construct[1000]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_large_union_construct[1000] (0001_7e6b3ca)     80.5934 (1.01)     85.7669 (1.06)     83.1310 (1.03)     2.0046 (7.10)     84.0706 (1.05)     3.7013 (9.13)          7;0  12.0292 (0.97)         13           1
test_large_union_construct[1000] (NOW)              79.9537 (1.0)      80.8619 (1.0)      80.4082 (1.0)      0.2823 (1.0)      80.4444 (1.0)      0.4054 (1.0)           4;0  12.4365 (1.0)          13           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_memtable_register': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                            Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_memtable_register (0001_7e6b3ca)     2.3414 (1.0)      3.9963 (1.28)     2.9341 (1.07)     0.6954 (2.97)     2.5611 (1.0)      1.0051 (3.24)          1;0  340.8249 (0.94)          5           1
test_memtable_register (NOW)              2.5527 (1.09)     3.1200 (1.0)      2.7455 (1.0)      0.2340 (1.0)      2.6253 (1.03)     0.3103 (1.0)           1;0  364.2281 (1.0)           5           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_multiple_joins[1-10]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_multiple_joins[1-10] (0001_7e6b3ca)     29.2181 (1.04)     29.8201 (1.0)      29.4753 (1.02)     0.2212 (1.0)      29.4735 (1.02)     0.2395 (1.67)          2;0  33.9268 (0.98)          5           1
test_multiple_joins[1-10] (NOW)              28.2059 (1.0)      30.8413 (1.03)     28.9911 (1.0)      0.3797 (1.72)     28.9610 (1.0)      0.1433 (1.0)           3;3  34.4933 (1.0)          35           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_multiple_joins[1-1]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                              Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_multiple_joins[1-1] (0001_7e6b3ca)     2.1812 (1.05)     2.2556 (1.0)      2.2125 (1.02)     0.0103 (1.0)      2.2134 (1.02)     0.0104 (1.0)         92;26  451.9810 (0.98)        385           1
test_multiple_joins[1-1] (NOW)              2.0829 (1.0)      2.7703 (1.23)     2.1732 (1.0)      0.0508 (4.96)     2.1760 (1.0)      0.0457 (4.41)         53;3  460.1458 (1.0)         433           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_multiple_joins[10-10]': 2 tests --------------------------------------------------------------------------------
Name (time in ms)                                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_multiple_joins[10-10] (0001_7e6b3ca)     134.4478 (1.01)     135.2392 (1.0)      134.9848 (1.00)     0.2589 (1.0)      135.0306 (1.01)     0.2855 (1.0)           1;1  7.4082 (1.00)          8           1
test_multiple_joins[10-10] (NOW)              133.2542 (1.0)      136.5399 (1.01)     134.4153 (1.0)      1.0518 (4.06)     134.0242 (1.0)      1.0030 (3.51)          2;1  7.4396 (1.0)           8           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_multiple_joins[10-1]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_multiple_joins[10-1] (0001_7e6b3ca)     7.6144 (1.0)      9.7117 (1.00)     7.8628 (1.0)      0.2154 (1.0)      7.8179 (1.0)      0.0656 (1.0)          8;16  127.1815 (1.0)         125           1
test_multiple_joins[10-1] (NOW)              7.6613 (1.01)     9.6892 (1.0)      7.9197 (1.01)     0.2239 (1.04)     7.9556 (1.02)     0.2205 (3.36)         18;3  126.2676 (0.99)        121           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_multiple_joins[100-10]': 2 tests ---------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_multiple_joins[100-10] (0001_7e6b3ca)     1.2448 (1.01)     1.3361 (1.00)     1.3143 (1.00)     0.0391 (1.0)      1.3300 (1.0)      0.0305 (1.0)           1;1  0.7609 (1.00)          5           1
test_multiple_joins[100-10] (NOW)              1.2267 (1.0)      1.3353 (1.0)      1.3108 (1.0)      0.0471 (1.20)     1.3322 (1.00)     0.0323 (1.06)          1;1  0.7629 (1.0)           5           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_multiple_joins[100-1]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                 Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_multiple_joins[100-1] (0001_7e6b3ca)     61.5542 (1.0)      64.1758 (1.0)      62.0988 (1.0)      0.7125 (1.0)      61.8368 (1.0)      0.3583 (1.0)           2;2  16.1034 (1.0)          17           1
test_multiple_joins[100-1] (NOW)              61.6177 (1.00)     71.5238 (1.11)     63.9037 (1.03)     2.3848 (3.35)     63.4989 (1.03)     1.5423 (4.30)          2;2  15.6486 (0.97)         16           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_op_argnames': 2 tests -----------------------------------------------------------------------------------
Name (time in ns)                        Min                 Max                Mean            StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_op_argnames (0001_7e6b3ca)     165.6100 (1.0)      309.4800 (1.0)      170.4881 (1.0)      6.9509 (1.0)      169.0200 (1.0)      2.1000 (1.0)      1738;3868        5.8655 (1.0)       59482         100
test_op_argnames (NOW)              167.0200 (1.01)     390.8400 (1.26)     178.4390 (1.05)     7.9720 (1.15)     177.0400 (1.05)     3.3000 (1.57)     2398;2473        5.6042 (0.96)      59341         100
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_op_args': 2 tests -----------------------------------------------------------------------------------
Name (time in ns)                    Min                 Max                Mean            StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_op_args (0001_7e6b3ca)     153.7900 (1.0)      404.1700 (1.49)     158.7909 (1.0)      5.1135 (1.0)      158.2000 (1.0)      3.4000 (1.79)     1843;1723        6.2976 (1.0)       62186         100
test_op_args (NOW)              162.2100 (1.05)     271.3200 (1.0)      167.5288 (1.06)     6.0691 (1.19)     166.5100 (1.05)     1.9000 (1.0)      1271;1357        5.9691 (0.95)      35306         100
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_parse_many_duckdb_types': 2 tests --------------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_parse_many_duckdb_types (0001_7e6b3ca)     223.2947 (1.00)     228.6916 (1.0)      227.1589 (1.0)      2.2190 (1.0)      228.1124 (1.0)      2.1398 (1.0)           1;0  4.4022 (1.0)           5           1
test_parse_many_duckdb_types (NOW)              222.4037 (1.0)      230.9832 (1.01)     227.5382 (1.00)     4.3918 (1.98)     230.3251 (1.01)     8.0075 (3.74)          2;0  4.3949 (1.00)          5           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_repr_huge_union': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                          Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_repr_huge_union (0001_7e6b3ca)     2.7729 (1.0)      2.9066 (1.0)      2.8278 (1.0)      0.0223 (2.04)     2.8257 (1.0)      0.0261 (2.07)         81;8  353.6368 (1.0)         294           1
test_repr_huge_union (NOW)              2.8890 (1.04)     2.9674 (1.02)     2.9112 (1.03)     0.0109 (1.0)      2.9104 (1.03)     0.0126 (1.0)          70;8  343.5039 (0.97)        284           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_repr_join': 2 tests -------------------------------------------------------------------------------------
Name (time in ns)                      Min                   Max                Mean             StdDev              Median                IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_repr_join (0001_7e6b3ca)     469.9978 (1.43)     6,131.9988 (3.68)     510.8001 (1.49)     80.3548 (3.92)     501.0006 (1.47)     29.9988 (5.00)     2613;2763        1.9577 (0.67)     164420           1
test_repr_join (NOW)              328.6000 (1.0)      1,665.1335 (1.0)      343.2753 (1.0)      20.4878 (1.0)      340.6666 (1.0)       6.0000 (1.0)      3583;6240        2.9131 (1.0)      195734          15
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_repr_tpc_h02': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_repr_tpc_h02 (0001_7e6b3ca)     1.2264 (1.00)     1.7018 (1.0)      1.2468 (1.0)      0.0274 (1.0)      1.2438 (1.0)      0.0127 (1.0)          7;11  802.0443 (1.0)         334           1
test_repr_tpc_h02 (NOW)              1.2205 (1.0)      1.9741 (1.16)     1.2710 (1.02)     0.0721 (2.63)     1.2575 (1.01)     0.0298 (2.34)        19;23  786.7814 (0.98)        365           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_selectors[10000]': 2 tests -----------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_selectors[10000] (0001_7e6b3ca)     913.4205 (1.0)      1,052.4296 (1.02)     1,021.3127 (1.02)     60.3743 (1.32)     1,047.5603 (1.03)     37.3038 (1.0)           1;1  0.9791 (0.98)          5           1
test_selectors[10000] (NOW)              923.1770 (1.01)     1,036.7340 (1.0)      1,001.6789 (1.0)      45.7938 (1.0)      1,020.6310 (1.0)      47.8807 (1.28)          1;0  0.9983 (1.0)           5           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_selectors[1000]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                           Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_selectors[1000] (0001_7e6b3ca)     87.5250 (1.0)      210.1841 (1.0)      98.3377 (1.0)      35.2245 (1.0)      88.2315 (1.0)      0.6868 (2.24)          1;1  10.1690 (1.0)          12           1
test_selectors[1000] (NOW)              88.5505 (1.01)     219.0791 (1.04)     99.8343 (1.02)     37.5536 (1.07)     89.0506 (1.01)     0.3068 (1.0)           1;2  10.0166 (0.99)         12           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_snowflake_medium_sized_to_pandas': 2 tests -----------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_snowflake_medium_sized_to_pandas (0001_7e6b3ca)     29.9760 (1.01)     31.3848 (1.02)     30.7436 (1.02)     0.6032 (1.52)     30.5949 (1.02)     1.0187 (1.47)          2;0  0.0325 (0.98)          5           1
test_snowflake_medium_sized_to_pandas (NOW)              29.7535 (1.0)      30.6404 (1.0)      30.1621 (1.0)      0.3964 (1.0)      29.9874 (1.0)      0.6921 (1.0)           2;0  0.0332 (1.0)           5           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[10-1]': 2 tests ------------------------------------------------------------------------------------
Name (time in us)                                    Min                 Max                Mean             StdDev              Median                IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[10-1] (0001_7e6b3ca)     344.7640 (1.0)      927.3510 (1.0)      359.5600 (1.0)      25.8308 (1.03)     355.4900 (1.0)      11.9820 (1.30)        48;57        2.7812 (1.0)        1630           1
test_wide_drop_compile[10-1] (NOW)              357.1380 (1.04)     960.2030 (1.04)     373.4859 (1.04)     24.9581 (1.0)      370.6085 (1.04)      9.2070 (1.0)         43;50        2.6775 (0.96)       1674           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[10-50]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                   Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[10-50] (0001_7e6b3ca)     1.7346 (1.0)       2.3217 (1.0)      1.8164 (1.0)      0.0656 (1.0)      1.7913 (1.0)      0.0807 (2.00)        96;14  550.5342 (1.0)         463           1
test_wide_drop_compile[10-50] (NOW)              1.7393 (1.00)     56.3826 (24.28)    1.9132 (1.05)     2.3321 (35.53)    1.8020 (1.01)     0.0403 (1.0)          1;66  522.6837 (0.95)        548           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[10-99]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[10-99] (0001_7e6b3ca)     1.4435 (1.0)      2.1779 (1.32)     1.5178 (1.02)     0.0596 (2.51)     1.4998 (1.01)     0.0770 (6.13)         68;2  658.8640 (0.98)        567           1
test_wide_drop_compile[10-99] (NOW)              1.4603 (1.01)     1.6492 (1.0)      1.4918 (1.0)      0.0238 (1.0)      1.4869 (1.0)      0.0126 (1.0)         43;41  670.3435 (1.0)         592           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[100-1]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                   Min                Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[100-1] (0001_7e6b3ca)     7.9890 (1.0)      10.6422 (1.0)      8.5318 (1.01)     0.2829 (1.0)      8.5395 (1.06)     0.1243 (1.61)        20;22  117.2087 (0.99)        113           1
test_wide_drop_compile[100-1] (NOW)              8.0125 (1.00)     53.9866 (5.07)     8.4817 (1.0)      4.2436 (15.00)    8.0749 (1.0)      0.0771 (1.0)           1;3  117.9012 (1.0)         117           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_drop_compile[100-50]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[100-50] (0001_7e6b3ca)     10.2594 (1.0)      10.9112 (1.0)      10.3307 (1.0)      0.0729 (1.0)      10.3178 (1.0)      0.0416 (1.0)           7;8  96.7992 (1.0)          95           1
test_wide_drop_compile[100-50] (NOW)              10.5455 (1.03)     12.2858 (1.13)     10.6916 (1.03)     0.2307 (3.16)     10.6285 (1.03)     0.0720 (1.73)         7;10  93.5314 (0.97)         90           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[100-99]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[100-99] (0001_7e6b3ca)     6.5248 (1.0)      6.9621 (1.01)     6.7128 (1.0)      0.0854 (2.85)     6.7162 (1.0)      0.0892 (2.05)         52;6  148.9694 (1.0)         143           1
test_wide_drop_compile[100-99] (NOW)              6.7838 (1.04)     6.8612 (1.0)      6.8234 (1.02)     0.0300 (1.0)      6.8170 (1.02)     0.0436 (1.0)           2;0  146.5535 (0.98)          5           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[1000-1]': 2 tests --------------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[1000-1] (0001_7e6b3ca)     74.6152 (1.0)      265.1583 (2.13)     100.1879 (1.17)     55.6399 (2.70)     75.3172 (1.0)      0.9611 (1.0)           2;3   9.9812 (0.86)         14           1
test_wide_drop_compile[1000-1] (NOW)              74.8026 (1.00)     124.4747 (1.0)       85.7335 (1.0)      20.6119 (1.0)      75.3839 (1.00)     1.4462 (1.50)          3;3  11.6641 (1.0)          14           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[1000-50]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean             StdDev             Median                IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[1000-50] (0001_7e6b3ca)     91.6189 (1.0)      177.4003 (1.20)     107.8740 (1.0)      34.2712 (1.41)     92.7048 (1.0)       1.2055 (1.0)           2;2  9.2701 (1.0)          11           1
test_wide_drop_compile[1000-50] (NOW)              94.6564 (1.03)     147.9228 (1.0)      109.3032 (1.01)     24.3572 (1.0)      95.2091 (1.03)     38.7132 (32.11)         3;0  9.1489 (0.99)         11           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[1000-99]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[1000-99] (0001_7e6b3ca)     58.3515 (1.01)     141.6710 (1.36)     64.9879 (1.06)     19.2281 (1.73)     60.4770 (1.03)     3.0698 (6.55)          1;1  15.3875 (0.95)         18           1
test_wide_drop_compile[1000-99] (NOW)              57.9504 (1.0)      104.4111 (1.0)      61.4736 (1.0)      11.0888 (1.0)      58.6419 (1.0)      0.4690 (1.0)           1;2  16.2672 (1.0)          17           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_wide_drop_compile[10000-1]': 2 tests -----------------------------------------------------------------------------------
Name (time in ms)                                       Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[10000-1] (0001_7e6b3ca)     921.1062 (1.0)      1,088.8020 (1.13)     1,047.3914 (1.09)     70.9724 (11.21)    1,075.6538 (1.12)     51.6613 (4.53)          1;1  0.9548 (0.92)          5           1
test_wide_drop_compile[10000-1] (NOW)              953.2421 (1.03)       967.3109 (1.0)        961.2633 (1.0)       6.3328 (1.0)        963.2766 (1.0)      11.4154 (1.0)           1;0  1.0403 (1.0)           5           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[10000-50]': 2 tests ----------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[10000-50] (0001_7e6b3ca)     1.2888 (1.05)     1.5095 (1.20)     1.3783 (1.11)     0.1016 (9.23)     1.3217 (1.06)     0.1751 (13.11)         1;0  0.7255 (0.90)          5           1
test_wide_drop_compile[10000-50] (NOW)              1.2308 (1.0)      1.2607 (1.0)      1.2444 (1.0)      0.0110 (1.0)      1.2443 (1.0)      0.0134 (1.0)           2;0  0.8036 (1.0)           5           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_drop_compile[10000-99]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_compile[10000-99] (0001_7e6b3ca)     741.6948 (1.07)     885.2657 (1.19)     827.4143 (1.18)     75.3977 (3.43)     880.7214 (1.27)     135.8394 (6.83)          2;0  1.2086 (0.85)          5           1
test_wide_drop_compile[10000-99] (NOW)              690.0414 (1.0)      742.6160 (1.0)      703.9334 (1.0)      21.9997 (1.0)      694.7676 (1.0)       19.8957 (1.0)           1;1  1.4206 (1.0)           5           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_wide_drop_construct[10-1]': 2 tests -------------------------------------------------------------------------------------
Name (time in ns)                                      Min                   Max                Mean             StdDev              Median               IQR             Outliers  OPS (Mops/s)            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[10-1] (0001_7e6b3ca)     101.4900 (1.0)      4,276.9300 (12.21)    105.6672 (1.0)      14.4529 (2.87)     103.8900 (1.0)      3.3000 (1.73)     1681;2206        9.4637 (1.0)       91567         100
test_wide_drop_construct[10-1] (NOW)              105.6000 (1.04)       350.1600 (1.0)      107.9194 (1.02)      5.0276 (1.0)      106.4100 (1.02)     1.9100 (1.0)      2838;3060        9.2662 (0.98)      91150         100
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[10-50]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                       Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[10-50] (0001_7e6b3ca)     253.4720 (1.06)     412.4140 (1.28)     273.8690 (1.09)     11.6172 (2.23)     270.3040 (1.08)     7.7950 (1.86)      231;176        3.6514 (0.91)       3319           1
test_wide_drop_construct[10-50] (NOW)              238.1020 (1.0)      321.9510 (1.0)      250.1550 (1.0)       5.2209 (1.0)      250.3950 (1.0)      4.1972 (1.0)      1251;380        3.9975 (1.0)        3489           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[10-99]': 2 tests ----------------------------------------------------------------------------------
Name (time in us)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[10-99] (0001_7e6b3ca)     299.3580 (1.05)     370.3030 (1.01)     306.5367 (1.02)     5.0111 (1.0)      305.6610 (1.02)     5.8360 (1.0)       523;101        3.2623 (0.98)       2480           1
test_wide_drop_construct[10-99] (NOW)              283.9800 (1.0)      368.4000 (1.0)      299.8702 (1.0)      6.3573 (1.27)     300.2100 (1.0)      6.7875 (1.16)       901;42        3.3348 (1.0)        2888           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[100-1]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[100-1] (0001_7e6b3ca)     1.2745 (1.04)     1.7771 (1.0)      1.3376 (1.06)     0.0538 (1.63)     1.3177 (1.04)     0.0357 (1.64)        77;69  747.6046 (0.95)        716           1
test_wide_drop_construct[100-1] (NOW)              1.2197 (1.0)      1.8162 (1.02)     1.2655 (1.0)      0.0331 (1.0)      1.2620 (1.0)      0.0218 (1.0)          30;6  790.2079 (1.0)         759           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[100-50]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[100-50] (0001_7e6b3ca)     1.9549 (1.01)     2.2419 (1.10)     2.0096 (1.01)     0.0274 (1.87)     2.0049 (1.00)     0.0247 (1.84)        88;20  497.6230 (0.99)        482           1
test_wide_drop_construct[100-50] (NOW)              1.9320 (1.0)      2.0339 (1.0)      1.9945 (1.0)      0.0147 (1.0)      1.9951 (1.0)      0.0134 (1.0)        115;47  501.3878 (1.0)         484           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[100-99]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[100-99] (0001_7e6b3ca)     2.6759 (1.04)     2.7412 (1.0)      2.7022 (1.03)     0.0112 (1.0)      2.7008 (1.03)     0.0146 (1.0)         101;5  370.0747 (0.97)        364           1
test_wide_drop_construct[100-99] (NOW)              2.5630 (1.0)      3.3670 (1.23)     2.6232 (1.0)      0.0580 (5.18)     2.6185 (1.0)      0.0208 (1.43)          6;9  381.2164 (1.0)         365           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_drop_construct[1000-1]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[1000-1] (0001_7e6b3ca)     11.8346 (1.0)      13.1108 (1.0)      12.1699 (1.0)      0.2957 (1.0)      12.0467 (1.0)      0.4535 (2.35)         12;1  82.1698 (1.0)          79           1
test_wide_drop_construct[1000-1] (NOW)              12.1322 (1.03)     57.9430 (4.42)     12.9520 (1.06)     5.0955 (17.23)    12.3854 (1.03)     0.1928 (1.0)           1;1  77.2079 (0.94)         80           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[1000-50]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                        Min                Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[1000-50] (0001_7e6b3ca)     18.6745 (1.00)     98.6904 (1.46)     20.4907 (1.02)     10.9518 (1.63)     18.9463 (1.0)      0.1866 (1.0)           1;4  48.8026 (0.98)         53           1
test_wide_drop_construct[1000-50] (NOW)              18.5840 (1.0)      67.6069 (1.0)      20.1254 (1.0)       6.7242 (1.0)      19.2735 (1.02)     0.3686 (1.98)          1;2  49.6885 (1.0)          52           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_drop_construct[1000-99]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[1000-99] (0001_7e6b3ca)     25.7180 (1.0)      26.6066 (1.0)      26.0235 (1.0)      0.2158 (1.0)      25.9259 (1.0)      0.3003 (2.36)         10;1  38.4268 (1.0)          37           1
test_wide_drop_construct[1000-99] (NOW)              25.7881 (1.00)     71.1600 (2.67)     27.1552 (1.04)     7.2327 (33.52)    25.9728 (1.00)     0.1274 (1.0)           1;2  36.8254 (0.96)         39           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[10000-1]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                         Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[10000-1] (0001_7e6b3ca)     126.5835 (1.02)     271.8340 (1.57)     180.7010 (1.22)     74.0501 (2.88)     127.3157 (1.0)      142.2433 (2.97)          3;0  5.5340 (0.82)          8           1
test_wide_drop_construct[10000-1] (NOW)              123.7495 (1.0)      172.8483 (1.0)      148.1616 (1.0)      25.6690 (1.0)      148.0696 (1.16)      47.8288 (1.0)           0;0  6.7494 (1.0)           8           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[10000-50]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                          Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[10000-50] (0001_7e6b3ca)     198.3414 (1.02)     339.8566 (1.38)     253.8201 (1.14)     75.6055 (2.88)     199.0266 (1.0)      136.4957 (2.85)          2;0  3.9398 (0.88)          5           1
test_wide_drop_construct[10000-50] (NOW)              194.2841 (1.0)      246.1747 (1.0)      223.4795 (1.0)      26.2237 (1.0)      239.4013 (1.20)      47.9167 (1.0)           2;0  4.4747 (1.0)           5           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_drop_construct[10000-99]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                          Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_drop_construct[10000-99] (0001_7e6b3ca)     262.4566 (1.0)      405.0936 (1.28)     347.3495 (1.15)     77.2123 (3.47)     402.2524 (1.30)     141.2270 (7.74)          2;0  2.8789 (0.87)          5           1
test_wide_drop_construct[10000-99] (NOW)              263.0889 (1.00)     316.0737 (1.0)      302.4234 (1.0)      22.2279 (1.0)      310.3714 (1.0)       18.2582 (1.0)           1;1  3.3066 (1.0)           5           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_wide_relocate[10-after]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[10-after] (0001_7e6b3ca)     253.7420 (1.02)     345.0350 (1.01)     258.3006 (1.0)      3.7694 (1.0)      256.7680 (1.0)      4.8090 (1.0)        391;50        3.8715 (1.0)        3123           1
test_wide_relocate[10-after] (NOW)              248.4720 (1.0)      342.1990 (1.0)      261.1100 (1.01)     4.5128 (1.20)     260.0430 (1.01)     5.4390 (1.13)      715;119        3.8298 (0.99)       3190           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_wide_relocate[10-before]': 2 tests -----------------------------------------------------------------------------------
Name (time in us)                                     Min                 Max                Mean             StdDev              Median               IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[10-before] (0001_7e6b3ca)     233.8340 (1.0)      471.9360 (1.60)     249.9408 (1.0)      16.9168 (3.92)     247.7200 (1.0)      8.2778 (1.97)        76;84        4.0009 (1.0)        3253           1
test_wide_relocate[10-before] (NOW)              252.8300 (1.08)     295.0910 (1.0)      259.4830 (1.04)      4.3113 (1.0)      258.3710 (1.04)     4.2080 (1.0)       873;131        3.8538 (0.96)       3510           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_wide_relocate[100-after]': 2 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[100-after] (0001_7e6b3ca)     1.7009 (1.01)     1.8793 (1.07)     1.7346 (1.02)     0.0135 (1.03)     1.7341 (1.02)     0.0129 (1.0)        117;20  576.4957 (0.98)        548           1
test_wide_relocate[100-after] (NOW)              1.6797 (1.0)      1.7603 (1.0)      1.7032 (1.0)      0.0130 (1.0)      1.7005 (1.0)      0.0139 (1.08)       146;29  587.1155 (1.0)         568           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_wide_relocate[100-before]': 2 tests -----------------------------------------------------------------------------
Name (time in ms)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[100-before] (0001_7e6b3ca)     1.6338 (1.0)      2.3292 (1.25)     1.6793 (1.0)      0.0501 (4.55)     1.6585 (1.0)      0.0493 (3.89)        109;6  595.4864 (1.0)         563           1
test_wide_relocate[100-before] (NOW)              1.7173 (1.05)     1.8700 (1.0)      1.7471 (1.04)     0.0110 (1.0)      1.7468 (1.05)     0.0127 (1.0)         148;4  572.3717 (0.96)        552           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_wide_relocate[1000-after]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[1000-after] (0001_7e6b3ca)     15.0998 (1.0)       16.2053 (1.0)      15.4042 (1.0)       0.2525 (1.0)      15.2876 (1.0)      0.3632 (2.47)         10;1  64.9176 (1.0)          61           1
test_wide_relocate[1000-after] (NOW)              15.9853 (1.06)     160.3049 (9.89)     18.5468 (1.20)     18.4531 (73.09)    16.1712 (1.06)     0.1468 (1.0)           1;1  53.9177 (0.83)         61           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_relocate[1000-before]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[1000-before] (0001_7e6b3ca)     15.9684 (1.0)      17.2534 (1.0)      16.3464 (1.0)      0.2088 (1.07)     16.3288 (1.0)      0.1720 (1.0)          11;5  61.1756 (1.0)          61           1
test_wide_relocate[1000-before] (NOW)              16.1689 (1.01)     17.2643 (1.00)     16.4878 (1.01)     0.1950 (1.0)      16.5120 (1.01)     0.3234 (1.88)         23;1  60.6507 (0.99)         60           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_relocate[10000-after]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[10000-after] (0001_7e6b3ca)     163.1182 (1.0)      292.5071 (1.0)      215.5030 (1.0)      70.0670 (1.02)     165.0984 (1.0)      127.7516 (1.02)          2;0  4.6403 (1.0)           5           1
test_wide_relocate[10000-after] (NOW)              164.7964 (1.01)     293.4506 (1.00)     216.3084 (1.00)     68.8496 (1.0)      167.0749 (1.01)     124.9589 (1.0)           2;0  4.6230 (1.00)          5           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_relocate[10000-before]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_relocate[10000-before] (0001_7e6b3ca)     165.7316 (1.01)     213.1810 (1.0)      192.9525 (1.0)      23.4717 (1.0)      207.0824 (1.0)       42.3900 (1.0)           2;0  5.1826 (1.0)           5           1
test_wide_relocate[10000-before] (NOW)              164.8623 (1.0)      296.9659 (1.39)     252.0287 (1.31)     67.1090 (2.86)     293.8839 (1.42)     130.5591 (3.08)          2;0  3.9678 (0.77)          6           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_rename[1000-ALL_CAPS]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[1000-ALL_CAPS] (0001_7e6b3ca)     19.8968 (1.0)      21.2113 (1.0)      20.1115 (1.0)      0.2005 (1.0)      20.0696 (1.0)      0.1628 (1.0)           4;2  49.7228 (1.0)          48           1
test_wide_rename[1000-ALL_CAPS] (NOW)              20.1539 (1.01)     21.5224 (1.01)     20.5725 (1.02)     0.2612 (1.30)     20.5370 (1.02)     0.2224 (1.37)         10;3  48.6085 (0.98)         49           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_wide_rename[1000-format_string]': 2 tests -------------------------------------------------------------------------------
Name (time in ms)                                           Min                 Max               Mean             StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[1000-format_string] (0001_7e6b3ca)     15.9493 (1.0)      135.5185 (7.83)     18.5067 (1.09)     15.6353 (93.96)    16.4380 (1.0)      0.2614 (1.02)          1;3  54.0346 (0.92)         58           1
test_wide_rename[1000-format_string] (NOW)              16.6534 (1.04)      17.3079 (1.0)      16.9628 (1.0)       0.1664 (1.0)      16.9483 (1.03)     0.2574 (1.0)          23;0  58.9526 (1.0)          58           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_rename[1000-function]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[1000-function] (0001_7e6b3ca)     15.8410 (1.0)      16.8978 (1.0)      16.2520 (1.0)      0.2085 (1.0)      16.2175 (1.0)      0.2661 (1.0)          15;1  61.5309 (1.0)          61           1
test_wide_rename[1000-function] (NOW)              16.1710 (1.02)     16.9594 (1.00)     16.5616 (1.02)     0.2089 (1.00)     16.6012 (1.02)     0.3437 (1.29)         25;0  60.3806 (0.98)         59           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_rename[1000-mapping]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[1000-mapping] (0001_7e6b3ca)     16.1311 (1.04)     16.4352 (1.0)      16.2474 (1.02)     0.1003 (1.0)      16.2289 (1.02)     0.0155 (1.0)           2;2  61.5483 (0.98)          6           1
test_wide_rename[1000-mapping] (NOW)              15.4842 (1.0)      16.5407 (1.01)     15.9205 (1.0)      0.2051 (2.05)     15.8875 (1.0)      0.2882 (18.65)        18;1  62.8123 (1.0)          61           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_rename[1000-no_op_function]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                            Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[1000-no_op_function] (0001_7e6b3ca)     16.0575 (1.01)     16.6008 (1.0)      16.2165 (1.0)      0.0978 (1.0)      16.1988 (1.01)     0.0899 (1.08)         12;5  61.6657 (1.0)          60           1
test_wide_rename[1000-no_op_function] (NOW)              15.9364 (1.0)      47.8159 (2.88)     16.6323 (1.03)     4.2046 (42.98)    16.0734 (1.0)      0.0832 (1.0)           1;3  60.1239 (0.97)         57           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_rename[1000-no_op_string]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                          Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[1000-no_op_string] (0001_7e6b3ca)     16.1478 (1.00)     16.5083 (1.0)      16.2778 (1.0)      0.0837 (1.0)      16.2492 (1.0)      0.1130 (1.0)          20;1  61.4332 (1.0)          61           1
test_wide_rename[1000-no_op_string] (NOW)              16.1078 (1.0)      17.6384 (1.07)     16.5039 (1.01)     0.2764 (3.30)     16.4312 (1.01)     0.3074 (2.72)         10;2  60.5918 (0.99)         60           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------ benchmark 'test_wide_rename[1000-snake_case]': 2 tests ------------------------------------------------------------------------------
Name (time in ms)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers      OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[1000-snake_case] (0001_7e6b3ca)     20.2107 (1.01)     21.7414 (1.02)     20.5019 (1.01)     0.2213 (1.0)      20.4908 (1.01)     0.1271 (1.0)           6;3  48.7759 (0.99)         47           1
test_wide_rename[1000-snake_case] (NOW)              19.9712 (1.0)      21.2635 (1.0)      20.3526 (1.0)      0.2605 (1.18)     20.3545 (1.0)      0.4113 (3.24)         16;1  49.1338 (1.0)          48           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_rename[10000-ALL_CAPS]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[10000-ALL_CAPS] (0001_7e6b3ca)     208.3623 (1.00)     329.9393 (1.01)     256.1757 (1.00)     64.7404 (1.01)     209.3654 (1.0)      116.7541 (1.01)          2;0  3.9036 (1.00)          5           1
test_wide_rename[10000-ALL_CAPS] (NOW)              208.2895 (1.0)      327.7336 (1.0)      255.4156 (1.0)      64.0333 (1.0)      209.3665 (1.00)     116.1096 (1.0)           2;0  3.9152 (1.0)           5           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_rename[10000-format_string]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[10000-format_string] (0001_7e6b3ca)     165.8042 (1.0)      302.3548 (1.31)     245.9553 (1.20)     70.1272 (2.16)     288.9927 (1.28)     129.1720 (2.17)          2;0  4.0658 (0.83)          5           1
test_wide_rename[10000-format_string] (NOW)              169.2427 (1.02)     231.5906 (1.0)      205.0972 (1.0)      32.4885 (1.0)      226.2177 (1.0)       59.5672 (1.0)           2;0  4.8757 (1.0)           5           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_rename[10000-function]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[10000-function] (0001_7e6b3ca)     160.8982 (1.0)      288.0142 (1.0)      214.7834 (1.0)      65.6317 (1.0)      162.8177 (1.0)      122.0246 (1.03)          3;0  4.6559 (1.0)           7           1
test_wide_rename[10000-function] (NOW)              167.1950 (1.04)     323.3916 (1.12)     232.9987 (1.08)     72.8974 (1.11)     226.7812 (1.39)     118.8691 (1.0)           1;0  4.2919 (0.92)          6           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_rename[10000-mapping]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[10000-mapping] (0001_7e6b3ca)     157.8194 (1.0)      286.8266 (1.0)      234.3471 (1.0)      68.4418 (1.0)      282.8019 (1.0)      123.9900 (1.0)           2;0  4.2672 (1.0)           5           1
test_wide_rename[10000-mapping] (NOW)              160.8292 (1.02)     302.7837 (1.06)     236.6088 (1.01)     69.2041 (1.01)     282.8514 (1.00)     131.0196 (1.06)          3;0  4.2264 (0.99)          7           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_rename[10000-no_op_function]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                              Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[10000-no_op_function] (0001_7e6b3ca)     165.0870 (1.01)     294.7947 (1.04)     229.1845 (1.04)     69.7936 (1.13)     228.3201 (1.05)     127.5673 (1.17)          0;0  4.3633 (0.96)          6           1
test_wide_rename[10000-no_op_function] (NOW)              163.6834 (1.0)      284.2675 (1.0)      220.3202 (1.0)      61.5677 (1.0)      218.2413 (1.0)      109.4118 (1.0)           1;0  4.5388 (1.0)           6           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_rename[10000-no_op_string]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                            Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[10000-no_op_string] (0001_7e6b3ca)     162.8562 (1.0)      298.2288 (1.00)     220.3188 (1.00)     69.8629 (1.0)      165.4165 (1.0)      129.6846 (1.01)          3;0  4.5389 (1.00)          7           1
test_wide_rename[10000-no_op_string] (NOW)              168.4248 (1.03)     297.5439 (1.0)      219.9447 (1.0)      70.3404 (1.01)     168.7012 (1.02)     128.1663 (1.0)           2;0  4.5466 (1.0)           5           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_wide_rename[10000-snake_case]': 2 tests ---------------------------------------------------------------------------------
Name (time in ms)                                          Min                 Max                Mean             StdDev              Median                 IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_wide_rename[10000-snake_case] (0001_7e6b3ca)     205.4681 (1.0)      355.9949 (1.06)     288.9041 (1.12)     76.2550 (1.12)     338.1428 (1.60)     137.3059 (1.12)          2;0  3.4614 (0.90)          5           1
test_wide_rename[10000-snake_case] (NOW)              208.3735 (1.01)     336.5974 (1.0)      258.8835 (1.0)      67.7880 (1.0)      211.2156 (1.0)      122.7316 (1.0)           2;0  3.8627 (1.0)           5           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

jcrist

Nice fix. Just a small nit on type annotations, otherwise LGTM.

ibis/backends/sql/rewrites.py

Co-authored-by: Jim Crist-Harif <jcristharif@gmail.com>

cpcloud added 4 commits July 30, 2024 14:47

test(sql): add test that CTEs are in the correct order

45c4d9b

chore(internals): add the ability to emit found nodes in topological …

1f01fde

…order

chore(internals): avoid constructing a throwaway list when extracting…

7e6b3ca

… CTEs

fix(ctes): emit CTEs in topological order

d887611

cpcloud added bug Incorrect behavior inside of ibis internals Issues or PRs related to ibis's internal APIs labels Jul 30, 2024

cpcloud requested a review from jcrist July 30, 2024 19:05

cpcloud added the ci-run-cloud Add this label to trigger a run of BigQuery, Snowflake, and Databricks backends in CI label Jul 30, 2024

ibis-docs-bot bot removed the ci-run-cloud Add this label to trigger a run of BigQuery, Snowflake, and Databricks backends in CI label Jul 30, 2024

jcrist approved these changes Jul 30, 2024

View reviewed changes

ibis/backends/sql/rewrites.py Outdated Show resolved Hide resolved

ibis/backends/sql/rewrites.py Outdated Show resolved Hide resolved

chore: abc you later

2db37fc

Co-authored-by: Jim Crist-Harif <jcristharif@gmail.com>

cpcloud enabled auto-merge (squash) July 30, 2024 19:37

cpcloud merged commit acd7d82 into ibis-project:main Jul 30, 2024
82 checks passed

cpcloud deleted the ctes-out-of-order branch July 30, 2024 20:05

cpcloud added this to the 9.3 milestone Aug 5, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix(internals): ensure that CTEs are emitted in topological order #9726

fix(internals): ensure that CTEs are emitted in topological order #9726

cpcloud commented Jul 30, 2024 •

edited

Loading

cpcloud commented Jul 30, 2024 •

edited

Loading

jcrist left a comment

fix(internals): ensure that CTEs are emitted in topological order #9726

fix(internals): ensure that CTEs are emitted in topological order #9726

Conversation

cpcloud commented Jul 30, 2024 • edited Loading

Description of changes

Issues closed

cpcloud commented Jul 30, 2024 • edited Loading

jcrist left a comment

Choose a reason for hiding this comment

cpcloud commented Jul 30, 2024 •

edited

Loading

cpcloud commented Jul 30, 2024 •

edited

Loading