Async datastream

[sundy-li]

I hereby agree to the terms of the CLA available at: https://databend.rs/policies/cla/

Summary

Summary about this PR

• Migrate BlockStream to SendableDataBlockStream.
• Remove SendableBlockStream inside the insert_plan and migrate it into the executor.
• introduce async-stream crate to streams/Source.
• Make CSV/Parquet read in async mod.
• Make Parquet table support projection.
• Add config storage.disk.temp_data_path for external temp data path.

Performance:

## generate test datas
echo "select rand(), toFloat32( sin(rand() ) ) , toString( cos(rand())) from numbers(1000000) format CSV" |  clickhouse-client  --host 127.0.0.1 --port 9999 > aa.csv


CREATE TABLE test
(
    a Int64,
    b Float32,
    c String
) ENGINE = CSV location =  '/Users/sundy/dataset/aa.csv';


set max_threads = 1;

Before:
mysql> select sum(a) from test;
+------------------+
| sum(a)           |
+------------------+
| 2147676606160454 |
+------------------+
1 row in set (0.45 sec)
Read 1000000 rows, 38.64 MB in 0.385 sec., 2.6 million rows/sec., 100.46 MB/sec.


After:
mysql> select sum(a) from test;
+------------------+
| sum(a)           |
+------------------+
| 2147676606160454 |
+------------------+
1 row in set (0.30 sec)
Read 1000000 rows, 38.64 MB in 0.248 sec., 4.04 million rows/sec., 155.99 MB/sec.

Changelog

• Improvement
• Performance Improvement

Related Issues

Fixes #2787 #2730

Test Plan

Unit Tests

Stateless Tests

[databend-bot]

Thanks for the contribution!
I have applied any labels matching special text in your PR Changelog.

Please review the labels and make any necessary changes.

[codecov-commenter]

Codecov Report

Merging #2786 (80602f6) into main (8d541a9) will decrease coverage by 0%.
The diff coverage is 91%.

@@          Coverage Diff          @@
##            main   #2786   +/-   ##
=====================================
- Coverage     69%     69%   -1%     
=====================================
  Files        601     600    -1     
  Lines      32728   32797   +69     
=====================================
+ Hits       22848   22867   +19     
- Misses      9880    9930   +50     

Impacted Files	Coverage Δ
common/datavalues/src/types/serializations/mod.rs	27% <ø> (ø)
query/src/catalogs/table.rs	66% <0%> (-1%)	⬇️
query/src/configs/config_test.rs	98% <ø> (ø)
.../src/datasources/database/example/example_table.rs	0% <0%> (ø)
query/src/datasources/table/csv/csv_table_test.rs	90% <ø> (ø)
...uery/src/datasources/table/fuse/io/block_reader.rs	78% <ø> (ø)
query/src/interpreters/interpreter.rs	0% <ø> (ø)
query/src/interpreters/interpreter_kill.rs	0% <0%> (ø)
common/dal/src/impls/local.rs	76% <50%> (+<1%)	⬆️
common/planners/src/plan_read_datasource.rs	80% <72%> (-1%)	⬇️
... and 69 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8d541a9...80602f6. Read the comment docs.

[databend-bot]

Wait for another reviewer approval