ci: Output results in a CSV format

[raunakab]

Overview

This PR makes the visualizations of the run-cluster more user-friendly.

Usage

If you're ever running a script (on the GHA runner node, not on ray), you can output whatever files you want to the $GHA_OUTPUT_DIR env-variable, and that file or directory will be uploaded to the GitHub Actions Summary Page once the job fully completes.

This is what the .github/ci-scripts/job_runner.py file does. If you ever create a new GHA runner script, then outputting any files to the $GHA_OUTPUT_DIR will work.

[codspeed-hq]

CodSpeed Performance Report

Merging #3625 will improve performances by 17.7%

_{Comparing csv-outputs (a43ade4) with main (07f6b2c)}

Summary

⚡ 1 improvements
✅ 26 untouched benchmarks

Benchmarks breakdown

	Benchmark	main	csv-outputs	Change
⚡	test_iter_rows_first_row[100 Small Files]	244 ms	207.3 ms	+17.7%

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 77.84%. Comparing base (07f6b2c) to head (a43ade4).
Report is 2 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #3625   +/-   ##
=======================================
  Coverage   77.84%   77.84%           
=======================================
  Files         719      719           
  Lines       88280    88280           
=======================================
+ Hits        68720    68721    +1     
+ Misses      19560    19559    -1     

see 1 file with indirect coverage changes

[raunakab]

Example of successful runs:
https://github.com/Eventual-Inc/Daft/actions/runs/12420945783
https://github.com/Eventual-Inc/Daft/actions/runs/12421487395/job/34681477497