[FEAT] implement range operation and data streaming

[andrewgazelka]

No description provided.

[codspeed-hq]

CodSpeed Performance Report

Merging #3267 will improve performances by 19.73%

_{Comparing andrew/connect-range (9c26532) with main (e37c6d3)}

Summary

⚡ 2 improvements
✅ 15 untouched benchmarks

Benchmarks breakdown

	Benchmark	main	andrew/connect-range	Change
⚡	test_iter_rows_first_row[100 Small Files]	339.9 ms	287.5 ms	+18.2%
⚡	test_show[100 Small Files]	40.6 ms	33.9 ms	+19.73%

[universalmind303]

overall looks good to me, a few minor suggestions and comments.

[universalmind303]

can you add a comment on why we need to block here?

[andrewgazelka]

I am not completely sure but aren't we not leveraging python async really? → we are just blocking for a task to complete

[codecov]

Codecov Report

Attention: Patch coverage is 49.78723% with 118 lines in your changes missing coverage. Please review.

Project coverage is 77.58%. Comparing base (e37c6d3) to head (9c26532).
Report is 3 commits behind head on main.

Files with missing lines	Patch %	Lines
src/daft-connect/src/convert/formatting.rs	0.00%	58 Missing ⚠️
src/daft-connect/src/lib.rs	14.06%	55 Missing ⚠️
src/daft-connect/src/convert/data_conversion.rs	83.33%	2 Missing ⚠️
src/daft-connect/src/convert/schema_conversion.rs	0.00%	2 Missing ⚠️
.../daft-connect/src/convert/data_conversion/range.rs	96.77%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3267      +/-   ##
==========================================
+ Coverage   77.54%   77.58%   +0.04%     
==========================================
  Files         659      664       +5     
  Lines       80565    80798     +233     
==========================================
+ Hits        62473    62689     +216     
- Misses      18092    18109      +17     

Files with missing lines	Coverage Δ
src/daft-connect/src/command.rs	100.00% <100.00%> (ø)
.../daft-connect/src/convert/data_conversion/range.rs	96.77% <96.77%> (ø)
src/daft-connect/src/convert/data_conversion.rs	83.33% <83.33%> (ø)
src/daft-connect/src/convert/schema_conversion.rs	0.00% <0.00%> (ø)
src/daft-connect/src/lib.rs	47.54% <14.06%> (-11.14%)	⬇️
src/daft-connect/src/convert/formatting.rs	0.00% <0.00%> (ø)

... and 3 files with indirect coverage changes

[universalmind303]

This looks mostly fine to me. I think some function/struct names could be clearer to better express their purpose - but that's just my opinion.

[andrewgazelka]

This looks mostly fine to me. I think some function/struct names could be clearer to better express their purpose - but that's just my opinion.

will do in future PRs