You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As follow-up to #15231, add memory usage tests for other APIs that allow reading a subset of columns from file, to ensure similar bugs to #15098 don't exist now or happen in the future.
I omitted Excel and ODS because those file types won't be that big in practice, and read_json/read_ndjson because you can't currently choose a subset of columns, so you're reading everything. Might still be optimizations one can do but this is more about #15098-style bugs where you load everything even though the user requested a single column.
The text was updated successfully, but these errors were encountered:
Description
As follow-up to #15231, add memory usage tests for other APIs that allow reading a subset of columns from file, to ensure similar bugs to #15098 don't exist now or happen in the future.
I omitted Excel and ODS because those file types won't be that big in practice, and read_json/read_ndjson because you can't currently choose a subset of columns, so you're reading everything. Might still be optimizations one can do but this is more about #15098-style bugs where you load everything even though the user requested a single column.
The text was updated successfully, but these errors were encountered: