Code

Database History migration tool#121

Code

Merged

alecps merged 30 commits intocelo4celo-org/optimism:celo4from mcortesi/dbplaycelo-org/optimism:mcortesi/dbplayCopy head branch name to clipboardJun 10, 2024

+618-91

Commits

Commits on May 9, 2024

• Initial script to play with celo DB history migration

  mcortesi

  committed
  fa72149

  Copy full SHA for fa72149

• Can Read All the headers

  Show description for e9ba2bd
  

  mcortesi

  and

  alecps

  committed
  e9ba2bd

  Copy full SHA for e9ba2bd

• Adds new command to migrate ancients db

  mcortesi

  committed
  ca8512e

  Copy full SHA for ca8512e

• Adds comment

  mcortesi

  committed
  37b7816

  Copy full SHA for 37b7816

• Adds extension methods for transformation

  mcortesi

  committed
  430b875

  Copy full SHA for 430b875

• Implements Transform CeloBody

  mcortesi

  committed
  587ccdb

  Copy full SHA for 587ccdb

• Adds impl that runs steps in a concurrent pipeline

  mcortesi

  committed
  aaca3c5

  Copy full SHA for aaca3c5

• Adds transformHead, verify hashing works

  Show description for 56a52c5
  mcortesi

  committed
  56a52c5

  Copy full SHA for 56a52c5

• add migration for non-frozen blocks

  

  alecps

  authored and

  mcortesi

  committed
  d8d9ecf

  Copy full SHA for d8d9ecf

• copy over entire db and modify in place, works with op-geth at piersy/minimal-data-migration

  

  alecps

  authored and

  mcortesi

  committed
  389aad2

  Copy full SHA for 389aad2

• remove unecessary copying, cleanup code

  

  alecps

  authored and

  mcortesi

  committed
  3d73ab3

  Copy full SHA for 3d73ab3

• close and reopen DBs

  

  alecps

  authored and

  mcortesi

  committed
  212e4c7

  Copy full SHA for 212e4c7

• migrate newdb in place

  

  alecps

  authored and

  mcortesi

  committed
  bbf552a

  Copy full SHA for bbf552a

• saving progress

  Show description for c6695bb
  

  alecps

  and

  mcortesi

  committed
  c6695bb

  Copy full SHA for c6695bb

• Refactor code to improve database migration process

  mcortesi

  committed
  fd245be

  Copy full SHA for fd245be

• better logging

  mcortesi

  committed
  1050eb9

  Copy full SHA for 1050eb9

• refactor: inline parMigrateAncientRange

  mcortesi

  committed
  7d35707

  Copy full SHA for 7d35707

• Remove frozen blocks from nonAncient DB

  mcortesi

  committed
  3999ba4

  Copy full SHA for 3999ba4

• check hash matches on nonAncients migration

  mcortesi

  committed
  49ae16a

  Copy full SHA for 49ae16a

• clean up branch

  Show description for 577f6ad
  mcortesi

  committed
  577f6ad

  Copy full SHA for 577f6ad

• decode into new types

  

  alecps

  authored and

  mcortesi

  committed
  4a27e32

  Copy full SHA for 4a27e32

• fix transformHeader

  mcortesi

  committed
  df6cf15

  Copy full SHA for df6cf15

• make old freezer not readonly so that .meta files are created

  

  alecps

  authored and

  mcortesi

  committed
  c088359

  Copy full SHA for c088359

Commits on May 10, 2024

• update go.mod to use migration op-geth branch

  alecps

  committed
  47d9e92

  Copy full SHA for 47d9e92

Commits on May 14, 2024

• add configurable memory limit

  alecps

  committed
  7452e6c

  Copy full SHA for 7452e6c

• add comment about memory

  alecps

  committed
  5f092c8

  Copy full SHA for 5f092c8

Commits on May 15, 2024

• Added celo-dbmigrate Makefile target

  jcortejoso

  committed
  02de038

  Copy full SHA for 02de038

• Added dockerfile for celo-dbmigrate and celo-migrate tools

  jcortejoso

  committed
  0208fb3

  Copy full SHA for 0208fb3

Commits on May 20, 2024

• Workflow for running cel2-migration-tool

  jcortejoso

  committed
  85a8aa2

  Copy full SHA for 85a8aa2

• Update cel2-migration-tool image registry

  jcortejoso

  committed
  1aa7167

  Copy full SHA for 1aa7167