Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Batched writes during subgraph indexing #4538

Closed
1 of 2 tasks
azf20 opened this issue Apr 13, 2023 · 1 comment
Closed
1 of 2 tasks

[Feature] Batched writes during subgraph indexing #4538

azf20 opened this issue Apr 13, 2023 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@azf20
Copy link
Contributor

azf20 commented Apr 13, 2023

Description

Currently Graph Node writes entities to the store on every block. This leads to a large number of database interactions during historical syncing. This can be a significant performance bottleneck.

Graph Node could instead store entity changes in memory, writing those changes to the database every X blocks, or when the diff to be written is above a certain size.

This should combine with #4477 to reduce the number and size of database updates during syncing.

Are you aware of any blockers that must be resolved before implementing this feature? If so, which? Link to any relevant GitHub issues.

  • Impact on proof of indexing (ensuring that POI is not impacted by this change)

Some information to help us out

  • Tick this box if you plan on implementing this feature yourself.
  • I have searched the issue tracker to make sure this issue is not a duplicate.
@neysofu
Copy link
Member

neysofu commented Jun 1, 2023

Closed by #4606.

@neysofu neysofu closed this as completed Jun 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants