Code

Combine Cel2 migration scripts#148

Code

Merged

alecps merged 78 commits intocelo6celo-org/optimism:celo6from cel2-migration-scriptcelo-org/optimism:cel2-migration-scriptCopy head branch name to clipboardJun 25, 2024

+1,438-412

Commits

Commits on Jun 12, 2024

• Initial script to play with celo DB history migration

  

  mcortesi

  authored and

  alecps

  committed
  6e41571

  Copy full SHA for 6e41571

• Can Read All the headers

  Show description for 2677854
  

  mcortesi

  and

  alecps

  committed
  2677854

  Copy full SHA for 2677854

• Adds new command to migrate ancients db

  

  mcortesi

  authored and

  alecps

  committed
  cbbc17f

  Copy full SHA for cbbc17f

• Adds comment

  

  mcortesi

  authored and

  alecps

  committed
  da81742

  Copy full SHA for da81742

• Adds extension methods for transformation

  

  mcortesi

  authored and

  alecps

  committed
  e88665a

  Copy full SHA for e88665a

• Implements Transform CeloBody

  

  mcortesi

  authored and

  alecps

  committed
  f3feeeb

  Copy full SHA for f3feeeb

• Adds impl that runs steps in a concurrent pipeline

  

  mcortesi

  authored and

  alecps

  committed
  d3aff38

  Copy full SHA for d3aff38

• Adds transformHead, verify hashing works

  Show description for c1b2e7a
  

  mcortesi

  authored and

  alecps

  committed
  c1b2e7a

  Copy full SHA for c1b2e7a

• add migration for non-frozen blocks

  alecps

  committed
  c1cca6e

  Copy full SHA for c1cca6e

• copy over entire db and modify in place, works with op-geth at piersy/minimal-data-migration

  alecps

  committed
  8787ce8

  Copy full SHA for 8787ce8

• remove unecessary copying, cleanup code

  alecps

  committed
  3ac4661

  Copy full SHA for 3ac4661

• close and reopen DBs

  alecps

  committed
  f004979

  Copy full SHA for f004979

• migrate newdb in place

  alecps

  committed
  349aaf1

  Copy full SHA for 349aaf1

• saving progress

  Show description for 9f841a4
  

  alecps

  and

  mcortesi

  committed
  9f841a4

  Copy full SHA for 9f841a4

• Refactor code to improve database migration process

  

  mcortesi

  authored and

  alecps

  committed
  4ae2e22

  Copy full SHA for 4ae2e22

• better logging

  

  mcortesi

  authored and

  alecps

  committed
  2df677a

  Copy full SHA for 2df677a

• refactor: inline parMigrateAncientRange

  

  mcortesi

  authored and

  alecps

  committed
  f158be8

  Copy full SHA for f158be8

• Remove frozen blocks from nonAncient DB

  

  mcortesi

  authored and

  alecps

  committed
  84d516a

  Copy full SHA for 84d516a

• check hash matches on nonAncients migration

  

  mcortesi

  authored and

  alecps

  committed
  a48f897

  Copy full SHA for a48f897

• clean up branch

  Show description for 0fecde3
  

  mcortesi

  authored and

  alecps

  committed
  0fecde3

  Copy full SHA for 0fecde3

• decode into new types

  alecps

  committed
  f1d88a2

  Copy full SHA for f1d88a2

• fix transformHeader

  

  mcortesi

  authored and

  alecps

  committed
  5c4a1e5

  Copy full SHA for 5c4a1e5

• make old freezer not readonly so that .meta files are created

  alecps

  committed
  393e96e

  Copy full SHA for 393e96e

• add configurable memory limit

  alecps

  committed
  c6f68f6

  Copy full SHA for c6f68f6

• add comment about memory

  alecps

  committed
  62b47f3

  Copy full SHA for 62b47f3

• Added celo-dbmigrate Makefile target

  

  jcortejoso

  authored and

  alecps

  committed
  3601fe6

  Copy full SHA for 3601fe6

• Added dockerfile for celo-dbmigrate and celo-migrate tools

  

  jcortejoso

  authored and

  alecps

  committed
  44f15c1

  Copy full SHA for 44f15c1

• Workflow for running cel2-migration-tool

  

  jcortejoso

  authored and

  alecps

  committed
  c861c70

  Copy full SHA for c861c70

• Update cel2-migration-tool image registry

  

  jcortejoso

  authored and

  alecps

  committed
  eb4188f

  Copy full SHA for eb4188f

• update op-geth to point to https://github.com/celo-org/op-geth/commits/piersy/for-use-with-migrated-celo-datadir-use-gas-limit-differentiation-rebased-celo6/

  alecps

  committed
  caec5c9

  Copy full SHA for caec5c9

• add celo6 logging

  alecps

  committed
  f72af10

  Copy full SHA for f72af10

• rename scripts to celo-migrate-state and celo-migrate-blocks

  alecps

  committed
  9a88fd0

  Copy full SHA for 9a88fd0

• first pass at combining scripts

  alecps

  committed
  3f7e60e

  Copy full SHA for 3f7e60e

Commits on Jun 13, 2024

• saving progress on testing

  alecps

  committed
  6f7de1d

  Copy full SHA for 6f7de1d

• fix lint error, use %w to fmt errors

  alecps

  committed
  237e786

  Copy full SHA for 237e786

Commits on Jun 14, 2024

• add updated state migration input files to testdata

  alecps

  committed
  d7c79a2

  Copy full SHA for d7c79a2

• add ability to run block and state migration seperately or together

  alecps

  committed
  6181819

  Copy full SHA for 6181819

• add option for migrating only frozen blocks

  alecps

  committed
  1e550e6

  Copy full SHA for 1e550e6

• remove old scripts

  alecps

  committed
  51ca36a

  Copy full SHA for 51ca36a

Commits on Jun 17, 2024

• minor logging improvements in block migrations

  alecps

  committed
  317ce5e

  Copy full SHA for 317ce5e

• invert clearNonAncients flag logic --> keepNonAncients, make dry-run flag only apply to state migration

  alecps

  committed
  31b3f76

  Copy full SHA for 31b3f76

• adds README, improves logging

  alecps

  committed
  ee7cddd

  Copy full SHA for ee7cddd

• fix lint err

  alecps

  committed
  861de54

  Copy full SHA for 861de54

Commits on Jun 18, 2024

• Fix Makefile and Dockerfile

  palango

  committed
  e7a40cf

  Copy full SHA for e7a40cf

• move createNewDbIfNotExists

  alecps

  committed
  7c8c74d

  Copy full SHA for 7c8c74d

• rename keep-non-ancients

  alecps

  committed
  fd0d3de

  Copy full SHA for fd0d3de

• update TODO to add more context and state changes

  alecps

  committed
  f0f2c03

  Copy full SHA for f0f2c03

• Remove channel buffers from ancients migration

  Show description for 970c109
  

  alecps

  and

  carterqw2

  committed
  970c109

  Copy full SHA for 970c109

• bump default batch size to 100000

  alecps

  committed
  0bafa5e

  Copy full SHA for 0bafa5e

• add back extended usage string

  alecps

  committed
  c68094b

  Copy full SHA for c68094b

• add info on state migration to README

  alecps

  committed
  ccec52d

  Copy full SHA for ccec52d

Commits on Jun 20, 2024

• remove --state-dry-run flag

  alecps

  committed
  1745c48

  Copy full SHA for 1745c48

• update default batch size to 50k

  alecps

  committed
  05d2498

  Copy full SHA for 05d2498

Commits on Jun 21, 2024

• Adding building for op images

  jcortejoso

  committed
  96a383e

  Copy full SHA for 96a383e

• Setting our values for image registry and repository

  jcortejoso

  committed
  ee03cbb

  Copy full SHA for ee03cbb

• update README

  alecps

  committed
  1a9b0d9

  Copy full SHA for 1a9b0d9

• fix logging when newAncients > oldAncients

  alecps

  committed
  b19f4cb

  Copy full SHA for b19f4cb

• fix return value when skipping ancients

  alecps

  committed
  f894ce7

  Copy full SHA for f894ce7

• skip transforming block bodies that have already been transformed

  alecps

  committed
  ffbf793

  Copy full SHA for ffbf793

• misc. fixes to get re-runs with --keep-non-ancients working

  alecps

  committed
  de8fa9c

  Copy full SHA for de8fa9c

• adds TODO

  alecps

  committed
  539f29d

  Copy full SHA for 539f29d

• addresses cosmetic feedback

  alecps

  committed
  e6dcd89

  Copy full SHA for e6dcd89

• add flag for specifying a buffer

  alecps

  committed
  ce8835a

  Copy full SHA for ce8835a

Commits on Jun 24, 2024

• Show progress on rsync

  jcortejoso

  committed
  7aff000

  Copy full SHA for 7aff000

• Update to latest op-geth

  palango

  committed
  771caf8

  Copy full SHA for 771caf8

• state-migration: Refactor subtask

  palango

  committed
  9c569ac

  Copy full SHA for 9c569ac

• state-migration: Use EIP1559 settings from deploy config

  Show description for 517705f
  palango

  committed
  517705f

  Copy full SHA for 517705f

• state-migration: Enable Fjord hardfork during migration

  Show description for 422e941
  palango

  committed
  422e941

  Copy full SHA for 422e941

• state-migration: Deterministicly set migration block timestamp

  Show description for 4fc5209
  palango

  committed
  4fc5209

  Copy full SHA for 4fc5209

• state-migration: Set WithdrawalsHash in Cel2 migration block

  palango

  committed
  e92bb17

  Copy full SHA for e92bb17

• fixup! Fix Makefile and Dockerfile

  palango

  committed
  4e80b6b

  Copy full SHA for 4e80b6b

• add note to README about using snapshots for pre-migration

  alecps

  committed
  a768c48

  Copy full SHA for a768c48

Commits on Jun 25, 2024

• Set blob gas header fields for transition block

  Show description for 961e132
  piersy

  committed
  961e132

  Copy full SHA for 961e132

• Use InitialBaseFee for pre-gingerbread transitionb

  piersy

  committed
  b905d9d

  Copy full SHA for b905d9d

• Fix warnings about capitalized error strings

  palango

  committed
  2d4cf40

  Copy full SHA for 2d4cf40

• Output chain config as marshalled JSON

  piersy

  committed
  abe15b5

  Copy full SHA for abe15b5

• state-migration: Handle accounts with existing balance

  Show description for e296ee1
  palango

  committed
  e296ee1

  Copy full SHA for e296ee1

• remove allocs file, add instructions for how to generate allocs file to README, update TODOs

  alecps

  committed
  fcd58f9

  Copy full SHA for fcd58f9