Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Paginate reading pending txs from the redis cache #4342

Merged
merged 3 commits into from
May 26, 2023
Merged

Paginate reading pending txs from the redis cache #4342

merged 3 commits into from
May 26, 2023

Conversation

wanglonghong
Copy link
Contributor

@wanglonghong wanglonghong commented May 25, 2023 •
edited
Loading

Description

Type of change

  • Docs change / dependency upgrade
  • Configuration / tooling changes
  • Refactoring
  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Requires changes in customer code

What's done

  • Update the codebase of the pending domain transfers to make the pagination working.
  • Refactor a retry mechanism. The previous one tried to send xcalls in 2s, 4s, 8s, 16s, 256s... but it didn't make sense to re-send 8 times within 4mins. 4 mins is the average execution window so no need to resend within its period

preethamr
preethamr previously approved these changes May 25, 2023
View reviewed changes
Copy link
Collaborator

@preethamr preethamr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neat ! LGTM.

@wanglonghong wanglonghong linked an issue May 26, 2023 that may be closed by this pull request
Get everything in testnet to process #4225
Closed
3 tasks
@wanglonghong wanglonghong requested a review from preethamr May 26, 2023 01:22
sanchaymittal
sanchaymittal approved these changes May 26, 2023
View reviewed changes
Copy link
Collaborator

@sanchaymittal sanchaymittal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lg! need @preethamr approve before merging this though.

@wanglonghong wanglonghong merged commit 0f16b83 into main May 26, 2023
@wanglonghong wanglonghong deleted the paginate-pending-transfers branch May 26, 2023 03:03
rhlsthrm pushed a commit that referenced this pull request May 26, 2023
@liu-zhipeng @sanchaymittal
@preethamr @prathmeshkhandelwal1 @wanglonghong
ci: testnet prod sync (#4343)
f23e95c 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
rhlsthrm added a commit that referenced this pull request May 26, 2023
@liu-zhipeng @0xksure
@rhlsthrm @carlomazzaferro @LayneHaber @just-a-node @sanchaymittal @wanglonghong @preethamr @prathmeshkhandelwal1
Prod Sync (#4339)
5860b1d 
* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef4.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
rhlsthrm added a commit that referenced this pull request May 29, 2023
@wanglonghong @liu-zhipeng
@rhlsthrm @sanchaymittal @preethamr @prathmeshkhandelwal1
ci: testnet prod sync (#4355)
dce3820 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
preethamr added a commit that referenced this pull request May 30, 2023
@preethamr @liu-zhipeng
@rhlsthrm @sanchaymittal @prathmeshkhandelwal1 @wanglonghong
ci: testnet prod sync (#4360)
c30c8cc 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
rhlsthrm added a commit that referenced this pull request Jun 1, 2023
@preethamr @liu-zhipeng
@rhlsthrm @sanchaymittal @prathmeshkhandelwal1 @wanglonghong
ci: testnet prod sync (#4379)
4e94490 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* feat: check root message status on db

* Fix commitlint

* fix: commitlint

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* ci: commitlint

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
rhlsthrm pushed a commit that referenced this pull request Jun 1, 2023
@liu-zhipeng @sanchaymittal
@preethamr @prathmeshkhandelwal1 @wanglonghong
ci: testnet prod (#4388)
2edba14 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* feat: check root message status on db

* Fix commitlint

* fix: commitlint

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* ci: commitlint

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: fix tests

* ci: fix smoke test config

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
rhlsthrm pushed a commit that referenced this pull request Jun 5, 2023
@wanglonghong @rhlsthrm
fix: paginate reading pending txs from the redis cache (#4342)
8f67dd2 
* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window
rhlsthrm pushed a commit that referenced this pull request Jun 5, 2023
@liu-zhipeng @sanchaymittal
@preethamr @prathmeshkhandelwal1 @wanglonghong @rhlsthrm
ci: testnet prod sync (#4343)
099b969 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
rhlsthrm added a commit that referenced this pull request Jun 5, 2023
@liu-zhipeng @0xksure
@rhlsthrm @carlomazzaferro @LayneHaber @just-a-node @sanchaymittal @wanglonghong @preethamr @prathmeshkhandelwal1
Prod Sync (#4339)
80c452c 
* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef4.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
rhlsthrm added a commit that referenced this pull request Jun 5, 2023
@preethamr @liu-zhipeng
@rhlsthrm @sanchaymittal @prathmeshkhandelwal1 @wanglonghong
ci: testnet prod sync (#4360)
6668c27 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
rhlsthrm pushed a commit that referenced this pull request Jun 6, 2023
@liu-zhipeng @sanchaymittal
@preethamr @prathmeshkhandelwal1 @wanglonghong @just-a-node @carlomazzaferro
prod sync (#4387)
998879a 
* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* feat: check root message status on db

* Fix commitlint

* fix: commitlint

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* ci: commitlint

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: commitlint

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* fix: remove unecessary prefetch config setup

* fix: wait until none (#4386)

* fix: wait until none

* fix: slowpath cache issue

* ci: testnet prod sync (#4379)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* feat: check root message status on db

* Fix commitlint

* fix: commitlint

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* ci: commitlint

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tests

* ci: fix smoke test config

* ci: testnet prod (#4388)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* feat: check root message status on db

* Fix commitlint

* fix: commitlint

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* ci: commitlint

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: fix tests

* ci: fix smoke test config

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* chore: bump chain abstraction

* fix: update tf config for sequncer cname

* fix: sequencer http queue config update

* fix: add auto scaling to seq publisher

* fix: typo and seq health port config change

* feat: testnet prod sync (#4399)

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* ci: remove deprecated commands (#4385)

* ci: fix job

---------

Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
rhlsthrm added a commit that referenced this pull request Jun 6, 2023
@carlomazzaferro @rhlsthrm
@wanglonghong @liu-zhipeng @LayneHaber @just-a-node @sanchaymittal @0xksure @preethamr @prathmeshkhandelwal1
redis allow from anywhere + bigger nodes (#4349)
8939a46 
* redis allow from anywhere + bigger nodes

* ci: redis allow from anywhere + bigger nodes

* fix vpc id

* chore: improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* fix: paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* fix: commitlint

* Testnet prod (#4258)

* feat: update swapandxcall addresses

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* Change to pending-reboot

* Increase mem

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: remove gelato temporarily

* fix: reenable gelato

* fix: merge

* fix: build

* fix: lint

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* ci: bump sequencer CPU

* Prod Sync (#4339)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef4.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>

* ci: fix commitlint

* ci: fix ci

* ci: redis allow from anywhere + bigger nodes

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* ci: fix commitlint

* fix: commitlint

* ci: commitlint

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* feat: check root message status on db

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: lint

* ci: testnet prod sync (#4360)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: commitlint

* ci: fix db

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: better rpcs

* ci: bigger prover

* fix: sequencer exec data not found in the cache (#4383)

* fix: wait until none (#4386)

* fix: wait until none

* fix: slowpath cache issue

* ci: fix tests

* ci: fix smoke test config

* fix: update tf config for sequncer cname

* chore: bump chain abstraction

* fix: sequencer http queue config update

* fix: add auto scaling to seq publisher

* fix: typo and seq health port config change

* fix vpc id

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* ci: remove deprecated commands (#4385)

* ci: fix job

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: update from other branch

* fix sg name

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>
rhlsthrm pushed a commit that referenced this pull request Jun 7, 2023
@carlomazzaferro @just-a-node
@wanglonghong @liu-zhipeng @LayneHaber @sanchaymittal @0xksure @preethamr @prathmeshkhandelwal1
testnet prod (#4428)
1689c65 
* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* feat: add redis plugin to server

* feat: make cache options configurable

* chore: add yarn.lock

* ci: remove deprecated commands (#4385)

* ci: fix job

* chore: yarn lock update

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: change variadic listen signature

* fix: use config file only if env var not supplied

* feat: staging redis for sdk server

* feat: prod redis for sdk server

* fix: redis config in backend

* redis allow from anywhere + bigger nodes (#4349)

* redis allow from anywhere + bigger nodes

* ci: redis allow from anywhere + bigger nodes

* fix vpc id

* chore: improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* fix: paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* fix: commitlint

* Testnet prod (#4258)

* feat: update swapandxcall addresses

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* Change to pending-reboot

* Increase mem

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: remove gelato temporarily

* fix: reenable gelato

* fix: merge

* fix: build

* fix: lint

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* ci: bump sequencer CPU

* Prod Sync (#4339)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef4.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>

* ci: fix commitlint

* ci: fix ci

* ci: redis allow from anywhere + bigger nodes

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* ci: fix commitlint

* fix: commitlint

* ci: commitlint

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* feat: check root message status on db

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: lint

* ci: testnet prod sync (#4360)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: commitlint

* ci: fix db

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: better rpcs

* ci: bigger prover

* fix: sequencer exec data not found in the cache (#4383)

* fix: wait until none (#4386)

* fix: wait until none

* fix: slowpath cache issue

* ci: fix tests

* ci: fix smoke test config

* fix: update tf config for sequncer cname

* chore: bump chain abstraction

* fix: sequencer http queue config update

* fix: add auto scaling to seq publisher

* fix: typo and seq health port config change

* fix vpc id

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* ci: remove deprecated commands (#4385)

* ci: fix job

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: update from other branch

* fix sg name

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>

* chore: add relayer

* feat: add new subgraphs (#4424)

* chore: add transferId to the requestcontext (#4427)

---------

Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
rhlsthrm pushed a commit that referenced this pull request Jul 11, 2023
@just-a-node @carlomazzaferro
@wanglonghong @liu-zhipeng @LayneHaber @sanchaymittal @0xksure @preethamr @prathmeshkhandelwal1 @Hesnicewithit @ArjunBhuptani @0xdcota
ci: prod (#4638)
04ca8a9 
* chore: use Transfer type, move to interfaces

* fix: sdk core imports

* fix: unused imports, ordering, types

* redis allow from anywhere + bigger nodes (#4349)

* redis allow from anywhere + bigger nodes

* ci: redis allow from anywhere + bigger nodes

* fix vpc id

* chore: improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* fix: paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* fix: commitlint

* Testnet prod (#4258)

* feat: update swapandxcall addresses

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* Change to pending-reboot

* Increase mem

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: remove gelato temporarily

* fix: reenable gelato

* fix: merge

* fix: build

* fix: lint

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* ci: bump sequencer CPU

* Prod Sync (#4339)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931d2405f9fd073704b81b5980a47dadc99b.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef463ae6baf22a65bddf973017f6771c76be.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>

* ci: fix commitlint

* ci: fix ci

* ci: redis allow from anywhere + bigger nodes

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* ci: fix commitlint

* fix: commitlint

* ci: commitlint

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* feat: check root message status on db

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: lint

* ci: testnet prod sync (#4360)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: commitlint

* ci: fix db

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: better rpcs

* ci: bigger prover

* fix: sequencer exec data not found in the cache (#4383)

* fix: wait until none (#4386)

* fix: wait until none

* fix: slowpath cache issue

* ci: fix tests

* ci: fix smoke test config

* fix: update tf config for sequncer cname

* chore: bump chain abstraction

* fix: sequencer http queue config update

* fix: add auto scaling to seq publisher

* fix: typo and seq health port config change

* fix vpc id

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* ci: remove deprecated commands (#4385)

* ci: fix job

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: update from other branch

* fix sg name

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>

* chore: add relayer

* fix: mockable import and pool test added

* chore: sdk server startup and config to match other agents

* chore: server config tests

* chore: update config example

* ci: update ops config

* chore: add deps, update yarn lock

* chore: use exact version of dep

* fix: env var typos

* feat: add optional provider params to relevant methods

* fix: optional

* fix: added nycrc config

* feat: add new subgraphs (#4424)

* fix: env config

* chore: proper import from core

* chore: add transferId to the requestcontext (#4427)

* testnet prod (#4428)

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* feat: add redis plugin to server

* feat: make cache options configurable

* chore: add yarn.lock

* ci: remove deprecated commands (#4385)

* ci: fix job

* chore: yarn lock update

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: change variadic listen signature

* fix: use config file only if env var not supplied

* feat: staging redis for sdk server

* feat: prod redis for sdk server

* fix: redis config in backend

* redis allow from anywhere + bigger nodes (#4349)

* redis allow from anywhere + bigger nodes

* ci: redis allow from anywhere + bigger nodes

* fix vpc id

* chore: improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* fix: paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* fix: commitlint

* Testnet prod (#4258)

* feat: update swapandxcall addresses

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* Change to pending-reboot

* Increase mem

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: remove gelato temporarily

* fix: reenable gelato

* fix: merge

* fix: build

* fix: lint

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* ci: bump sequencer CPU

* Prod Sync (#4339)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: sanchaymittal <sanchaymittal@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931d2405f9fd073704b81b5980a47dadc99b.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef463ae6baf22a65bddf973017f6771c76be.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>
Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>

* ci: fix commitlint

* ci: fix ci

* ci: redis allow from anywhere + bigger nodes

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* ci: fix commitlint

* fix: commitlint

* ci: commitlint

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* feat: check root message status on db

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: lint

* ci: testnet prod sync (#4360)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>

* ci: commitlint

* ci: fix db

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: better rpcs

* ci: bigger prover

* fix: sequencer exec data not found in the cache (#4383)

* fix: wait until none (#4386)

* fix: wait until none

* fix: slowpath cache issue

* ci: fix tests

* ci: fix smoke test config

* fix: update tf config for sequncer cname

* chore: bump chain abstraction

* fix: sequencer http queue config update

* fix: add auto scaling to seq publisher

* fix: typo and seq health port config change

* fix vpc id

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* ci: remove deprecated commands (#4385)

* ci: fix job

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: update from other branch

* fix sg name

---------

Co-authored-by: Rahul Sethuram <rahul.eth@icloud.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@connext.network>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>
Co-authored-by: Rahul Sethuram <rahul@sethuram.com>

* chore: add relayer

* feat: add new subgraphs (#4424)

* chore: add transferId to the requestcontext (#4427)

---------

Co-authored-by: carlomazzaferro <carlo.mazzaferro@gmail.com>
Co-authored-by: just-a-node <eye1717@gmail.com>
Co-authored-by: wanglonghong <wanglonghong4467@gmail.com>
Co-authored-by: Liu <57480598+liu-zhipeng@users.noreply.github.com>
Co-authored-by: Layne Haber <layne.haber@gmail.com>
Co-authored-by: Sanchay Mittal <sanchaymittal@gmail.com>
Co-authored-by: kristohberg <kristoffer.hovland.berg@gmail.com>
Co-authored-by: preethamr <preethamr@users.noreply.github.com>
Co-authored-by: Prathmesh Khandelwal <201952225@iiitvadodara.ac.in>
Co-authored-by: Prathmesh Khandelwal <prathmeshkhandelwal83@gmail.com>

* feat: providerSanityCheck

* feat: providerSanityCheck tests

* chore: validation test

* fix: optional providers now

* fix: added few more test

* fix: import order and remove explicit cast

* chore: add .nycrc.json

* chore: fresh yarn.lock update

* chore: another yarn lock update

* ci: add yarn version check in workflow

* ci: add comment about network and environment

* fix: another yarn lock …
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sanchaymittal sanchaymittal sanchaymittal approved these changes

@preethamr preethamr preethamr approved these changes

@liu-zhipeng liu-zhipeng Awaiting requested review from liu-zhipeng

@rhlsthrm rhlsthrm Awaiting requested review from rhlsthrm

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Get everything in testnet to process
3 participants
@wanglonghong @preethamr @sanchaymittal