You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We are storing dal_metrics_read_bytes, dal_metrics_write_bytes in dal_metrics_write_bytes which is shared across the whole query. This doesn't make sense now because we could have multiple tables in the same query. Users should be able to know the metrics about different tables.
Thus, we should support multiple table progress reports.
Plan
rename dal_metrics_read_bytes to table_data_read_bytes
rename dal_metrics_write_bytes to table_data_write_bytes
Add support for table_cache_{read/write}_bytes.
Init the table data metrics while creating table instances instead of query start.
Other progress like scan_progress_read_rows and scan_progress_read_bytes should also be updated.
Tasks
Implement single table support
Implement multiple table support
The text was updated successfully, but these errors were encountered:
Address #8331
Summary
We are storing
dal_metrics_read_bytes
,dal_metrics_write_bytes
indal_metrics_write_bytes
which is shared across the whole query. This doesn't make sense now because we could have multiple tables in the same query. Users should be able to know the metrics about different tables.Thus, we should support multiple table progress reports.
Plan
dal_metrics_read_bytes
totable_data_read_bytes
dal_metrics_write_bytes
totable_data_write_bytes
table_cache_{read/write}_bytes
.Other progress like
scan_progress_read_rows
andscan_progress_read_bytes
should also be updated.Tasks
The text was updated successfully, but these errors were encountered: