Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Async Insert #4577

Closed
sundy-li opened this issue Mar 25, 2022 · 1 comment · Fixed by #5567
Closed

Feature: Async Insert #4577

sundy-li opened this issue Mar 25, 2022 · 1 comment · Fixed by #5567
Assignees
Labels
A-query Area: databend query A-storage Area: databend storage C-feature Category: feature community-take
Milestone

Comments

@sundy-li
Copy link
Member

sundy-li commented Mar 25, 2022

Summary

Description for this feature.

With Async Insert, high rate of small inserts will be buffered by the server into batches.
This sacrifices tiny latency for better insert throughput and smaller block count in storage.

Configs may be introduced:

  1. async_insert_wait_ms: time to wait to be grouped into batches for the single insert, defaults to 200ms.
  2. async_insert_max_rows: the maximum rows of a single grouped batch to insert to storage, defaults to 100000 .
@sundy-li sundy-li added C-feature Category: feature A-query Area: databend query A-storage Area: databend storage labels Mar 25, 2022
@fkuner
Copy link
Contributor

fkuner commented May 7, 2022

/assignme

@Xuanwo Xuanwo added this to the v0.8 milestone May 20, 2022
@sundy-li sundy-li moved this from Todo to In Progress in Databend Query Engine May 20, 2022
@Xuanwo Xuanwo added A-storage Area: databend storage and removed A-storage Area: databend storage labels May 20, 2022
Repository owner moved this from In Progress to Done in Databend Query Engine Jun 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-query Area: databend query A-storage Area: databend storage C-feature Category: feature community-take
Projects
Development

Successfully merging a pull request may close this issue.

4 participants