Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracking issue of result cache and download #5398

Closed
4 of 14 tasks
youngsofun opened this issue May 16, 2022 · 1 comment
Closed
4 of 14 tasks

Tracking issue of result cache and download #5398

youngsofun opened this issue May 16, 2022 · 1 comment
Labels
A-cloud Area: cloud infra

Comments

@youngsofun
Copy link
Member

youngsofun commented May 16, 2022

Summary

background

Originally posted by @BohuTANG in #4521

result table is used in multi places:

Roadmap

  • able to download result base on result table Feat(httphandler): result download #5395
    • write to result table when serving /v1/query
    • read result table to to serve `/v1/query/<query_id>/download
    • use result table to make /v1/query not blocked by client due to limited memory buffer
  • support more download format
  • management of result table, delete outdated
  • use table function to read it from table(result_scan(last_query_id()))
  • optimize write pipeline with 2 sinks
  • clickhouse/mysql write to result table too.
  • use result table to optimize query
  • avoid huge result Tracking issue of result cache and download #5398 (comment)
  • download without bendquery,

optional:

  • download limit rows,
  • download parallel
@BohuTANG
Copy link
Member

If select * from a huge table(with TB data size), we should reject the result cache.

@BohuTANG BohuTANG added the A-cloud Area: cloud infra label May 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-cloud Area: cloud infra
Projects
None yet
Development

No branches or pull requests

2 participants