Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stabilize snapshot archive production in aggregator #1140

Open
4 tasks
jpraynaud opened this issue Aug 7, 2023 · 0 comments
Open
4 tasks

Stabilize snapshot archive production in aggregator #1140

jpraynaud opened this issue Aug 7, 2023 · 0 comments
Labels
devX 🌞 Developer experience optimization 🛠️ Optimization and/or small enhancements to-plan 📆 To plan in a sprint

Comments

@jpraynaud
Copy link
Member

jpraynaud commented Aug 7, 2023

Issue

As seen in #1137, the snapshot archive is unstable and produces from time to time corrupted files. We need to fix this issue, and to do so, we could make a capture of evolving files (volatile, ledger, and latest immutable files) in a temp folder prior to the creation of the archive. This would guarantee that the produced archive is much more likely to be valid. The temp folder would be wiped out after the creation of the archive.

To do

  • Implement the capture of evolving files prior to starting the archive production
  • Evaluate if this is enough or if we need to stop the Cardano node when doing this operation
  • Assess impact of IO/CPU performance on frequency of occurrence of this problem
  • Add a metric in prometheus endpoint to monitor the number of failed archive creation (see Expose Prometheus metrics for signer #1096)

Related issue

#1160

@jpraynaud jpraynaud added task dev 💪 optimization 🛠️ Optimization and/or small enhancements to-groom 🤔 Needs grooming devX 🌞 Developer experience labels Aug 7, 2023
@jpraynaud jpraynaud added to-plan 📆 To plan in a sprint and removed to-groom 🤔 Needs grooming labels Aug 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devX 🌞 Developer experience optimization 🛠️ Optimization and/or small enhancements to-plan 📆 To plan in a sprint
Projects
None yet
Development

No branches or pull requests

1 participant