Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: prod #4638

Merged
merged 407 commits into from
Jul 11, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
407 commits
Select commit Hold shift + click to select a range
ed93799
Merge branch 'main' of https://github.com/connext/monorepo into wrapp…
just-a-node Jun 5, 2023
1de0954
chore: use Transfer type, move to interfaces
just-a-node Jun 5, 2023
f94ce75
fix: sdk core imports
just-a-node Jun 5, 2023
e7d17af
fix: unused imports, ordering, types
just-a-node Jun 5, 2023
8939a46
redis allow from anywhere + bigger nodes (#4349)
carlomazzaferro Jun 6, 2023
8e1bda6
chore: add relayer
rhlsthrm Jun 6, 2023
f84b575
Merge pull request #4409 from connext/sdk-server-redis
just-a-node Jun 6, 2023
0f37c90
fix: mockable import and pool test added
prathmeshkhandelwal1 Jun 6, 2023
0c29bb4
Merge pull request #4398 from connext/fee-estimate-server-side-cache
just-a-node Jun 6, 2023
3fb86e8
chore: sdk server startup and config to match other agents
just-a-node Jun 6, 2023
7200488
chore: server config tests
just-a-node Jun 6, 2023
e5ec224
chore: update config example
just-a-node Jun 6, 2023
f861e0e
ci: update ops config
just-a-node Jun 6, 2023
07ed8f2
chore: add deps, update yarn lock
just-a-node Jun 6, 2023
8e30dc4
chore: use exact version of dep
just-a-node Jun 6, 2023
317b3d8
fix: env var typos
just-a-node Jun 7, 2023
0af1405
feat: add optional provider params to relevant methods
just-a-node Jun 7, 2023
b0cc411
fix: optional
just-a-node Jun 7, 2023
2885ce3
Merge branch 'prod' into testnet-prod
rhlsthrm Jun 7, 2023
36b4b42
Merge branch 'testnet-prod'
rhlsthrm Jun 7, 2023
57bb137
fix: added nycrc config
prathmeshkhandelwal1 Jun 7, 2023
52b0718
chore: merge resolved
prathmeshkhandelwal1 Jun 7, 2023
a70ce7a
feat: add new subgraphs (#4424)
Jun 7, 2023
c4b1d2c
fix: env config
just-a-node Jun 7, 2023
6ac93be
chore: proper import from core
just-a-node Jun 7, 2023
ee2ab21
chore: add transferId to the requestcontext (#4427)
wanglonghong Jun 7, 2023
1689c65
testnet prod (#4428)
Jun 7, 2023
bf03408
feat: providerSanityCheck
just-a-node Jun 7, 2023
f852dcd
feat: providerSanityCheck tests
just-a-node Jun 7, 2023
ede771d
chore: validation test
just-a-node Jun 7, 2023
76a2916
fix: optional providers now
just-a-node Jun 7, 2023
4f1b856
fix: added few more test
prathmeshkhandelwal1 Jun 7, 2023
159a941
fix: import order and remove explicit cast
just-a-node Jun 7, 2023
1021022
chore: add .nycrc.json
just-a-node Jun 7, 2023
25d45b0
chore: fresh yarn.lock update
just-a-node Jun 7, 2023
b4c6526
Merge branch 'wrapper-sdk' of https://github.com/connext/monorepo int…
just-a-node Jun 7, 2023
9b16d25
chore: another yarn lock update
just-a-node Jun 7, 2023
8335b17
ci: add yarn version check in workflow
just-a-node Jun 7, 2023
546667e
ci: add comment about network and environment
just-a-node Jun 7, 2023
aff3672
fix: another yarn lock update
just-a-node Jun 7, 2023
8b45e76
fix: another one
just-a-node Jun 7, 2023
d98cdce
fix: set correct yarn version
just-a-node Jun 7, 2023
7e3256d
feat: throw in providerSanityCheck, use in applicable methods
just-a-node Jun 7, 2023
1184e3a
fix: use stubbed classes in tests
just-a-node Jun 7, 2023
8586d80
fix: pool tests
just-a-node Jun 7, 2023
c45b664
fix: lint
prathmeshkhandelwal1 Jun 8, 2023
245e029
Merge branch 'prod' into testnet-prod
rhlsthrm Jun 8, 2023
6783f8b
Merge branch 'testnet-prod'
rhlsthrm Jun 8, 2023
85a5adb
Merge pull request #4422 from connext/provider-options
prathmeshkhandelwal1 Jun 8, 2023
e85e3ee
fix: mock replaced with api call data
prathmeshkhandelwal1 Jun 8, 2023
4e97784
Merge branch 'provider-options' into wrapper-sdk
prathmeshkhandelwal1 Jun 8, 2023
8b7ba3e
Merge pull request #4418 from connext/sdk-server-config
just-a-node Jun 8, 2023
ec65dc0
Merge remote-tracking branch 'origin' into wrapper-sdk
just-a-node Jun 8, 2023
e569bcf
Merge pull request #4444 from connext/prod
preethamr Jun 8, 2023
3ff632a
chore: update and lint imports
just-a-node Jun 8, 2023
1792014
chore: rm unnecessary type annotation
just-a-node Jun 8, 2023
efeda61
chore: all wrapped sdkBase tests
just-a-node Jun 8, 2023
5dbf415
Merge pull request #4439 from connext/main
preethamr Jun 8, 2023
c85247e
chore: shared should be in routes too
just-a-node Jun 9, 2023
45c5c08
fix: param typo
just-a-node Jun 9, 2023
db84f18
fix: missing keys
just-a-node Jun 9, 2023
a7dd004
chore: all wrapped pool tests except two
just-a-node Jun 9, 2023
10ceea9
4376 message verification fails bc of duplicated missing leaves in th…
liu-zhipeng Jun 9, 2023
4edd4a9
chore: add all wrapped sdkRouter tests
just-a-node Jun 9, 2023
46cb7b4
Merge pull request #4450 from connext/main
preethamr Jun 9, 2023
e4bec76
chore: add all wrapped sdkShared tests
just-a-node Jun 9, 2023
b353004
fix: some route param fixes
just-a-node Jun 9, 2023
7427765
chore: rm only
just-a-node Jun 9, 2023
52950f0
chore: add all wrapped sdkUtils tests
just-a-node Jun 9, 2023
aff6cfa
chore: add all wrapped sdkUtils tests
just-a-node Jun 9, 2023
0b4ab7d
Merge branch 'wrapper-sdk' of https://github.com/connext/monorepo int…
just-a-node Jun 9, 2023
c3ac7d8
chore: function existence checks
just-a-node Jun 9, 2023
b488fa8
fix: index param
just-a-node Jun 9, 2023
4758d00
chore: last wrapped pool tests
just-a-node Jun 9, 2023
c732430
feat: allow horizontal scalability of lighthouse prover (#4347)
wanglonghong Jun 9, 2023
b142854
feat: allow horizontal scalability of lighthouse prover (#4347) (#4451)
Jun 9, 2023
e989a83
ci: ops
rhlsthrm Jun 9, 2023
eed807a
ci: fix
rhlsthrm Jun 9, 2023
14a5250
Merge branch 'main' into wrapper-sdk
just-a-node Jun 9, 2023
7c58b82
feat: use server uris based on env
just-a-node Jun 9, 2023
45f89c7
Alchemix assets added
Hesnicewithit Jun 9, 2023
4eb53fd
feat: batch size (#4458)
wanglonghong Jun 10, 2023
df08e19
ci: use mumbai key
rhlsthrm Jun 10, 2023
3cfb935
Merge branch 'testnet-prod'
rhlsthrm Jun 10, 2023
8a2476c
ci: testnet (#4459)
Jun 10, 2023
7f4fe40
ci: fix rpc
rhlsthrm Jun 10, 2023
67d5f87
ci: use latest image (#4454)
just-a-node Jun 10, 2023
961760d
Merge pull request #4456 from Hesnicewithit/alchemix-assets
ArjunBhuptani Jun 12, 2023
1c7d927
Testnet prod sync (#4469)
just-a-node Jun 12, 2023
1ff9679
Commit reword (#4471)
just-a-node Jun 12, 2023
d495cfd
ci: commitlint
rhlsthrm Jun 12, 2023
24e34fc
Merge pull request #4402 from connext/wrapper-sdk
just-a-node Jun 12, 2023
93a51da
fix: use sdk-core
just-a-node Jun 12, 2023
1b89437
fix: yarn lock
just-a-node Jun 12, 2023
9897bc0
Merge pull request #4474 from connext/testnet-prod
just-a-node Jun 12, 2023
42cd5ce
chore: add preetham to examples owners
LayneHaber Jun 12, 2023
b662b46
chore: add preetham to examples owners
LayneHaber Jun 12, 2023
578a84a
Merge pull request #4475 from connext/sdk-server-deps
just-a-node Jun 12, 2023
a3b4e79
fix: make auto scale for seq sub respond faster
preethamr Jun 12, 2023
fbeb9ad
feat: sanity check asset config; specify domains correctly
LayneHaber Jun 13, 2023
db5916b
fix: proper error handling / application checks
LayneHaber Jun 13, 2023
e5115cf
Merge pull request #4472 from connext/main
LayneHaber Jun 13, 2023
49e946c
fix: health check endpt (#4480)
just-a-node Jun 13, 2023
33cea65
fix: health check endpt (#4480) (#4481)
Jun 13, 2023
7f64d34
feat: add an endpoint (#4485)
wanglonghong Jun 13, 2023
12acd7a
fix: limit one message per seq sub
preethamr Jun 13, 2023
df8d34a
feat: 4449 re org non existent transfer (#4483)
liu-zhipeng Jun 13, 2023
e775eb1
feat: paginate database call (#4490)
wanglonghong Jun 13, 2023
f0eab2b
fix: offset should not change
wanglonghong Jun 13, 2023
56b0e60
Merge pull request #4493 from connext/hotfix-no-increase-offset
preethamr Jun 13, 2023
3f99361
3437 checkpoints for carto at scale (#4452)
liu-zhipeng Jun 13, 2023
edfb79e
fix: resolve commit lint
preethamr Jun 13, 2023
945ccae
Merge pull request #4491 from connext/main
preethamr Jun 13, 2023
9dd84e4
3692 update vendor sdks (#3762)
LayneHaber Jun 14, 2023
6b170f3
ci: commitlint
rhlsthrm Jun 14, 2023
5760c9c
fix: hotfix bump up lh sub cpu
preethamr Jun 14, 2023
8575482
fix: run sdk-server on 0.0.0.0
rhlsthrm Jun 14, 2023
52e155f
fix: use proper config (#4499)
Jun 14, 2023
7ee1ea7
ci: sdk-server limits (#4501)
carlomazzaferro Jun 14, 2023
8176216
ci: testnet prod (#4500)
Jun 14, 2023
1e7d0bf
feat: 4495 increase subgraph queries (#4497)
wanglonghong Jun 14, 2023
1b89d3a
ci: new gelato key
rhlsthrm Jun 14, 2023
5012b12
fix: increase graph query limit on origin messages
preethamr Jun 14, 2023
a073ebf
feat: use fastify setErrorHandler
just-a-node Jun 14, 2023
c313601
fix: use literals in deployment names type
just-a-node Jun 14, 2023
853e91d
fix: use same response obj for cached result
just-a-node Jun 14, 2023
84b03ad
feat: add options obj to schemas
just-a-node Jun 14, 2023
e6ad746
fix: sanity check return bool only
just-a-node Jun 14, 2023
3af6622
fix: updates in use of sanity check
just-a-node Jun 14, 2023
f3f2b05
fix: server route updates
just-a-node Jun 14, 2023
2cbd496
chore: test new routes
just-a-node Jun 14, 2023
b89b73a
fix: tests
just-a-node Jun 15, 2023
cc53117
fix: update lh sub and auto scaling config
preethamr Jun 15, 2023
c12c5c1
fix: lint issues
just-a-node Jun 15, 2023
323e558
Merge branch 'testnet-prod'
rhlsthrm Jun 15, 2023
390efaa
feat: dedeup and improve relayer (#4512)
wanglonghong Jun 15, 2023
775b962
feat: consume messages in parallel (#4513)
wanglonghong Jun 15, 2023
ffa87e9
ci: testnet prod (#4515)
Jun 15, 2023
2697cd6
Merge pull request #4505 from connext/sdk-server-load-test-prep
just-a-node Jun 15, 2023
5406f8d
Merge pull request #4518 from connext/main
LayneHaber Jun 15, 2023
e63c84a
feat: add sdk-server to mainnet
just-a-node Jun 15, 2023
465909f
feat: use autoscaling policy
just-a-node Jun 15, 2023
70cdb82
fix: typo
just-a-node Jun 16, 2023
43cd800
fix: store interval only when complete
preethamr Jun 16, 2023
f2a1884
Merge pull request #4521 from connext/fix_nodes_cache
preethamr Jun 16, 2023
82e67e8
feat: estimateAmount Method added (#4465)
prathmeshkhandelwal1 Jun 16, 2023
d388c43
fix: husky
rhlsthrm Jun 16, 2023
8e3e101
feat: as for sdk-server
carlomazzaferro Jun 16, 2023
d4b4101
fix: remove gelato hardcoded gas limit (#4524)
Jun 16, 2023
19ef83e
fix: capacity variables and definitions
carlomazzaferro Jun 16, 2023
d2096fc
fix: capacity values and definitions
carlomazzaferro Jun 16, 2023
88932b5
chore: remove alAssets for now
ArjunBhuptani Jun 16, 2023
818b710
fix: 4496 linea bridge changed (#4509)
liu-zhipeng Jun 16, 2023
0825872
ci: testnet prod (#4526)
Jun 16, 2023
8ced8ea
Merge pull request #4527 from connext/whitelist-al-testnet-assets
LayneHaber Jun 16, 2023
c2c2eed
Merge pull request #4525 from connext/feat/sdk-server-as
just-a-node Jun 16, 2023
d15821c
fix: options overrides in sdkbase and tests
just-a-node Jun 16, 2023
fc5137f
fix: options overrides in sdkpool and tests
just-a-node Jun 16, 2023
c912a24
fix: options overrides in sdkrouter and tests
just-a-node Jun 16, 2023
48d5055
fix: options overrides in sdkshared and tests
just-a-node Jun 16, 2023
0fe3f3d
Merge branch 'main' of https://github.com/connext/monorepo into sdk-o…
just-a-node Jun 16, 2023
f7a631e
chore: rm dupe autoscaling config from merge
just-a-node Jun 16, 2023
d2ba5bc
fix: use custom auto scaling min max
preethamr Jun 16, 2023
a0d499d
feat: expose logger for tests
just-a-node Jun 16, 2023
7d7fa55
chore: inc coverage in pool tests
just-a-node Jun 16, 2023
baa9160
chore: inc coverage in router tests
just-a-node Jun 16, 2023
3b2cd1c
chore: inc coverage in base tests
just-a-node Jun 16, 2023
0b39bc3
chore: inc coverage in shared tests
just-a-node Jun 16, 2023
51d2d8a
chore: unused import
just-a-node Jun 16, 2023
39b5b86
Merge pull request #4528 from connext/sdk-options
LayneHaber Jun 16, 2023
2ad07bf
Merge pull request #4529 from connext/main
LayneHaber Jun 16, 2023
d382c71
fix: limit lh sub auto scaling max temporarily
preethamr Jun 17, 2023
d1f5dbc
fix: comment (#4533)
wanglonghong Jun 19, 2023
1cd5e39
chore: make 1 (#4537)
wanglonghong Jun 19, 2023
947c1dd
4443 subgraph out of sync did not fall back properly (#4534)
Jun 19, 2023
75f8e64
chore: increase (#4543)
wanglonghong Jun 19, 2023
30a929a
chore: no need to reread message status here (#4546)
wanglonghong Jun 19, 2023
3ccd838
fix: remove unused
rhlsthrm Jun 19, 2023
0208701
fix: temp resolve sim gas limit issue
preethamr Jun 19, 2023
f2fc246
fix: update lh sub with readonly and autos config
preethamr Jun 20, 2023
2618c2a
feat: add multiple networks domains (#4549)
sanchaymittal Jun 20, 2023
56defa5
feat: version release for utils and txService
sanchaymittal Jun 20, 2023
038f6f6
feat: use alchemy rpc in lh (#4552)
wanglonghong Jun 20, 2023
6338b3e
fix: add to variables.tf (#4553)
wanglonghong Jun 20, 2023
8820aeb
fix: clear cache on verification fail
preethamr Jun 20, 2023
24bf8ba
Merge pull request #4559 from connext/testnet-prod
preethamr Jun 21, 2023
96e0bc2
chore: increase pagesize
wanglonghong Jun 21, 2023
af30911
Merge pull request #4557 from connext/reset_cache_on_reorg
preethamr Jun 21, 2023
dd5d7a6
Merge pull request #4561 from connext/main
preethamr Jun 21, 2023
5931679
fix: use default db url
preethamr Jun 21, 2023
2241ef2
ci: fix tests
rhlsthrm Jun 21, 2023
1411cc1
ci: testnet (#4563)
Jun 21, 2023
bf26efb
feat: reenable cache (#4566)
wanglonghong Jun 21, 2023
1c4d813
chore: try with default value (#4567)
wanglonghong Jun 21, 2023
1710db2
feat: separate reader and writer in lh
preethamr Jun 21, 2023
7845465
Merge pull request #4572 from connext/4571-lighthouse-should-use-read…
preethamr Jun 21, 2023
b001486
fix: writer should not overwrite reader pool
preethamr Jun 21, 2023
0f17e5e
fix: resolve db error
preethamr Jun 22, 2023
13f30fb
fix: set max limit on lh prover pub (#4570)
preethamr Jun 22, 2023
4b39bc3
fix: requeue on error
preethamr Jun 22, 2023
3f6084b
fix: wait on message redelivery and update config
preethamr Jun 22, 2023
647f552
chore: retry in publisher
wanglonghong Jun 23, 2023
c72ec64
chore: configurable
wanglonghong Jun 23, 2023
3e90a30
ci: test
wanglonghong Jun 23, 2023
0d36539
fix: skip if empty
wanglonghong Jun 23, 2023
7827de1
fix: lint
wanglonghong Jun 23, 2023
cc430a5
fix: only remove messages sent to relayer
preethamr Jun 23, 2023
96fb0d1
fix: unit tests
preethamr Jun 23, 2023
a9930a3
fix: lint
preethamr Jun 23, 2023
0a75882
Merge pull request #4578 from connext/lh-publisher-retry
preethamr Jun 23, 2023
8574b4c
feat: use redis to store lh sub cache
preethamr Jun 24, 2023
8a146b2
fix: unit test
preethamr Jun 24, 2023
526eb16
Merge pull request #4581 from connext/use-redis-lh-sub-cache
preethamr Jun 24, 2023
fa23b79
fix: update config and cache handling
preethamr Jun 25, 2023
b850e16
fix: remove successful messages
preethamr Jun 25, 2023
05e8a39
fix: remove messages not in cache
preethamr Jun 25, 2023
1d865a5
fix: debug logging
preethamr Jun 25, 2023
6548fa4
fix: dedup messages in lh sub
preethamr Jun 25, 2023
93350bd
fix: dedup messages by leaf
preethamr Jun 25, 2023
6abd114
fix: enable lh sub app cache and tests
preethamr Jun 26, 2023
a04f936
fix: arb goerli gas limit (#4585)
Jun 26, 2023
b137a9d
fix: message duplication in queue (#4584)
wanglonghong Jun 26, 2023
9f4229b
chore: slow down (#4586)
wanglonghong Jun 26, 2023
14f2ef2
chore: revert (#4587)
wanglonghong Jun 26, 2023
7834b35
fix: delete cache only locally and update config
preethamr Jun 27, 2023
7986bf9
fix: resolve lh sub hitting cpu max
preethamr Jun 27, 2023
9384722
fix: lh batch size and auto scale min
preethamr Jun 27, 2023
a0752d6
Merge pull request #4593 from connext/clear_cache_locally
preethamr Jun 27, 2023
e738d31
ci: testnet (#4594)
Jun 27, 2023
628e76d
fix: no reset (#4595)
wanglonghong Jun 27, 2023
4fd56a3
ci: fix vars
rhlsthrm Jun 27, 2023
2b5d133
fix: decrease arb-goerli hardcoded gaslimit (#4596)
wanglonghong Jun 27, 2023
4769066
fix: lh upper bound (#4598)
wanglonghong Jun 27, 2023
02382f0
ci: testnet prod (#4601)
Jun 27, 2023
82a3420
chore: descrease timeout (#4605)
wanglonghong Jun 28, 2023
441e4f2
ci: lambda rate
rhlsthrm Jun 28, 2023
a0ebda9
chore: increase (#4606)
wanglonghong Jun 28, 2023
597b2ba
fix: update lh pub config for better performance
preethamr Jun 28, 2023
78016f3
fix: add lh pub mutex
preethamr Jun 28, 2023
71dc335
fix: lock lh pub
preethamr Jun 28, 2023
99b2512
fix: lh pub lock release
preethamr Jun 28, 2023
e10a501
fix: try larger pub max
preethamr Jun 29, 2023
d03a8a6
fix: tune LH config (#4612)
preethamr Jun 30, 2023
6e06213
ci: testnet prod (#4635)
Jul 5, 2023
f6acf4e
fix: update prod config to be on par with testnet
preethamr Jul 6, 2023
aef4da9
ci: testnet prod sync (#4656)
preethamr Jul 7, 2023
51c5873
ci: testnet-prod sync (#4665)
liu-zhipeng Jul 7, 2023
9e59ebc
ci: testnet prod sync (#4667)
preethamr Jul 10, 2023
150d473
ci: testnet-prod (#4678)
Jul 11, 2023
8210f14
ci: testnet prod (#4679)
Jul 11, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,6 @@
/packages/agents/ @preethamr @liu-zhipeng @wanglonghong @sanchaymittal @rhlsthrm
/packages/agents/sdk/ @just-a-node @sanchaymittal @rhlsthrm
/packages/deployments/ @LayneHaber @rhlsthrm @liu-zhipeng
/packages/examples/ @just-a-node @rhlsthrm @sanchaymittal
/packages/examples/ @just-a-node @rhlsthrm @sanchaymittal @preethamr
/packages/integration/ @LayneHaber @preethamr @rhlsthrm
/packages/utils/ @preethamr @liu-zhipeng @wanglonghong @rhlsthrm
70 changes: 65 additions & 5 deletions .github/workflows/build-test-deploy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -61,9 +61,14 @@ jobs:
node-version: "18"
cache: "yarn"

# - name: Validate using commitlint
# if: github.ref != 'refs/heads/testnet-prod' || github.ref != 'refs/heads/prod'
# uses: wagoid/commitlint-github-action@v5
- name: Check Yarn version
run: yarn --version

- name: Validate using commitlint
if: github.ref != 'refs/heads/testnet-prod' || github.ref != 'refs/heads/prod'
uses: wagoid/commitlint-github-action@v5
with:
commitDepth: 1

- name: Yarn install
run: yarn install
Expand Down Expand Up @@ -102,7 +107,8 @@ jobs:
"packages/adapters/txservice:@connext/nxtp-txservice"
"packages/adapters/subgraph:@connext/nxtp-adapters-subgraph"
"packages/adapters/cache:@connext/nxtp-adapters-cache"
"packages/agents/sdk:@connext/sdk"
"packages/agents/sdk:@connext/sdk-core"
"packages/agents/sdk-wrapper:@connext/sdk"
)

for entry in "${workspaces[@]}"; do
Expand Down Expand Up @@ -609,10 +615,52 @@ jobs:
- name: Build, tag, and push docker image to Amazon ECR Public

run: |
DOCKER_BUILDKIT=1 docker build -f docker/lighthouse/Dockerfile -t $REGISTRY/$REPOSITORY:$IMAGE_TAG -t ghcr.io/connext/lighthouse:$IMAGE_TAG .
DOCKER_BUILDKIT=1 docker build -f docker/lighthouse/lambda/Dockerfile -t $REGISTRY/$REPOSITORY:$IMAGE_TAG -t ghcr.io/connext/lighthouse:$IMAGE_TAG .
docker push $REGISTRY/$REPOSITORY:$IMAGE_TAG
docker push ghcr.io/connext/lighthouse:$IMAGE_TAG

build-and-push-lighthouse-prover-subscriber-image:
if: github.ref == 'refs/heads/main' || github.ref == 'refs/heads/staging' || github.ref == 'refs/heads/testnet-prod' || github.ref == 'refs/heads/prod'
env:
REGISTRY: ghcr.io
IMAGE_NAME: connext/lighthouse-subscriber
runs-on: ubuntu-latest
permissions:
contents: read
packages: write

steps:
- name: Checkout repository
uses: actions/checkout@v3

- name: Log in to the Container registry
uses: docker/login-action@f054a8b539a109f9f41c372932f1ae047eff08c9
with:
registry: ${{ env.REGISTRY }}
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}

- name: Extract metadata (tags, labels) for Docker
id: meta
uses: docker/metadata-action@98669ae865ea3cffbcbaa878cf57c20bbf1c6c38
with:
images: ${{ env.REGISTRY }}/${{ env.IMAGE_NAME }}
tags: |
type=sha,format=short
type=semver,pattern={{raw}}

- name: Build and push Docker image
uses: docker/build-push-action@ad44023a93711e3deb337508980b4b5e9bcdc5dc
with:
context: .
push: true
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}
file: docker/lighthouse/subscriber/Dockerfile

outputs:
json: ${{ steps.meta.outputs.json }}

build-and-push-relayer-image:
if: github.ref == 'refs/heads/main' || github.ref == 'refs/heads/staging' || github.ref == 'refs/heads/testnet-prod' || github.ref == 'refs/heads/prod'
env:
Expand Down Expand Up @@ -773,6 +821,7 @@ jobs:
build-and-push-sequencer-subscriber-image,
build-and-push-cartographer-image,
build-and-push-lighthouse-image,
build-and-push-lighthouse-prover-subscriber-image,
build-and-push-relayer-image,
build-and-push-watcher-image,
build-and-push-sdk-server-image,
Expand All @@ -786,6 +835,7 @@ jobs:
SEQUENCER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-sequencer-subscriber-image.outputs.json).tags[0] }}
CARTOGRAPHER_IMAGE: ghcr.io/connext/cartographer:${{ github.sha }}
LIGHTHOUSE_IMAGE: ghcr.io/connext/lighthouse:${{ github.sha }}
LIGHTHOUSE_PROVER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json).tags[0] }}
RELAYER_IMAGE: ${{ fromJSON(needs.build-and-push-relayer-image.outputs.json).tags[0] }}
WATCHER_IMAGE: ${{ fromJSON(needs.build-and-push-watcher-image.outputs.json).tags[0] }}
SDK_SERVER_IMAGE: ${{ fromJSON(needs.build-and-push-sdk-server-image.outputs.json).tags[0] }}
Expand Down Expand Up @@ -814,6 +864,7 @@ jobs:
sequencer-server-tags: ${{ needs.build-and-push-sequencer-server-image.outputs.json }}
sequencer-publisher-tags: ${{ needs.build-and-push-sequencer-publisher-image.outputs.json }}
sequencer-subscriber-tags: ${{ needs.build-and-push-sequencer-subscriber-image.outputs.json }}
lighthouse-prover-subscriber-tags: ${{ needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json }}
relayer-tags: ${{ needs.build-and-push-relayer-image.outputs.json }}
watcher-tags: ${{ needs.build-and-push-watcher-image.outputs.json }}
sdk-server-tags: ${{ needs.build-and-push-sdk-server-image.outputs.json }}
Expand All @@ -832,6 +883,7 @@ jobs:
build-and-push-sequencer-subscriber-image,
build-and-push-cartographer-image,
build-and-push-lighthouse-image,
build-and-push-lighthouse-prover-subscriber-image,
build-and-push-relayer-image,
build-and-push-watcher-image,
build-and-push-sdk-server-image,
Expand All @@ -844,6 +896,7 @@ jobs:
SEQUENCER_PUBLISHER_IMAGE: ${{ fromJSON(needs.build-and-push-sequencer-publisher-image.outputs.json).tags[0] }}
SEQUENCER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-sequencer-subscriber-image.outputs.json).tags[0] }}
LIGHTHOUSE_IMAGE: ghcr.io/connext/lighthouse:${{ github.sha }}
LIGHTHOUSE_PROVER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json).tags[0] }}
RELAYER_IMAGE: ${{ fromJSON(needs.build-and-push-relayer-image.outputs.json).tags[0] }}
WATCHER_IMAGE: ${{ fromJSON(needs.build-and-push-watcher-image.outputs.json).tags[0] }}
WEB3_SIGNER_PRIVATE_KEY_ROUTER: "0xc87509a1c067bbde78beb793e6fa76530b6382a4c0241e5e4a9ec0a0f44dc0d3"
Expand Down Expand Up @@ -878,6 +931,7 @@ jobs:
sequencer-server-tags: ${{ needs.build-and-push-sequencer-server-image.outputs.json }}
sequencer-publisher-tags: ${{ needs.build-and-push-sequencer-publisher-image.outputs.json }}
sequencer-subscriber-tags: ${{ needs.build-and-push-sequencer-subscriber-image.outputs.json }}
lighthouse-prover-subscriber-tags: ${{ needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json }}
relayer-tags: ${{ needs.build-and-push-relayer-image.outputs.json }}
watcher-tags: ${{ needs.build-and-push-watcher-image.outputs.json }}
sdk-server-tags: ${{ needs.build-and-push-sdk-server-image.outputs.json }}
Expand Down Expand Up @@ -989,6 +1043,7 @@ jobs:
TF_VAR_full_image_name_sequencer_subscriber: ${{ fromJSON(needs.smoke-tests.outputs.sequencer-subscriber-tags).tags[0] }}
TF_VAR_full_image_name_watcher: ${{ fromJSON(needs.smoke-tests.outputs.watcher-tags).tags[0] }}
TF_VAR_full_image_name_relayer: ${{ fromJSON(needs.smoke-tests.outputs.relayer-tags).tags[0] }}
TF_VAR_full_image_name_lighthouse_prover_subscriber: ${{ fromJSON(needs.smoke-tests.outputs.lighthouse-prover-subscriber-tags).tags[0] }}
TF_VAR_lighthouse_image_tag: ${{ github.sha }}

runs-on: ubuntu-latest
Expand Down Expand Up @@ -1045,6 +1100,7 @@ jobs:
sequencer-server-tags: ${{ needs.smoke-tests.outputs.sequencer-server-tags }}
sequencer-publisher-tags: ${{ needs.smoke-tests.outputs.sequencer-publisher-tags }}
sequencer-subscriber-tags: ${{ needs.smoke-tests.outputs.sequencer-subscriber-tags }}
lighthouse-prover-subscriber-tags: ${{ needs.smoke-tests.outputs.lighthouse-prover-subscriber-tags }}
router-publisher-tags: ${{ needs.smoke-tests.outputs.router-publisher-tags }}
router-subscriber-tags: ${{ needs.smoke-tests.outputs.router-subscriber-tags }}
router-executor-tags: ${{ needs.smoke-tests.outputs.router-executor-tags }}
Expand All @@ -1063,6 +1119,7 @@ jobs:
TF_VAR_full_image_name_sequencer_subscriber: ${{ fromJSON(needs.e2e-tests.outputs.sequencer-subscriber-tags).tags[0] }}
TF_VAR_full_image_name_relayer: ${{ fromJSON(needs.e2e-tests.outputs.relayer-tags).tags[0] }}
TF_VAR_full_image_name_watcher: ${{ fromJSON(needs.e2e-tests.outputs.watcher-tags).tags[0] }}
TF_VAR_full_image_name_lighthouse_prover_subscriber: ${{ fromJSON(needs.e2e-tests.outputs.lighthouse-prover-subscriber-tags).tags[0] }}
TF_VAR_lighthouse_image_tag: ${{ github.sha }}

runs-on: ubuntu-latest
Expand Down Expand Up @@ -1117,6 +1174,7 @@ jobs:
sequencer-server-tags: ${{ needs.e2e-tests.outputs.sequencer-server-tags }}
sequencer-publisher-tags: ${{ needs.e2e-tests.outputs.sequencer-publisher-tags }}
sequencer-subscriber-tags: ${{ needs.e2e-tests.outputs.sequencer-subscriber-tags }}
lighthouse-prover-subscriber-tags: ${{ needs.e2e-tests.outputs.lighthouse-prover-subscriber-tags }}
router-publisher-tags: ${{ needs.e2e-tests.outputs.router-publisher-tags }}
router-subscriber-tags: ${{ needs.e2e-tests.outputs.router-subscriber-tags }}
router-executor-tags: ${{ needs.e2e-tests.outputs.router-executor-tags }}
Expand Down Expand Up @@ -1188,6 +1246,7 @@ jobs:
router-publisher-tags: ${{ needs.e2e-tests.outputs.router-publisher-tags }}
router-subscriber-tags: ${{ needs.e2e-tests.outputs.router-subscriber-tags }}
router-executor-tags: ${{ needs.e2e-tests.outputs.router-executor-tags }}
lighthouse-prover-subscriber-tags: ${{ needs.e2e-tests.outputs.lighthouse-prover-subscriber-tags }}
relayer-tags: ${{ needs.e2e-tests.outputs.relayer-tags }}
watcher-tags: ${{ needs.e2e-tests.outputs.watcher-tags }}
sdk-server-tags: ${{ needs.e2e-tests.outputs.sdk-server-tags }}
Expand Down Expand Up @@ -1262,6 +1321,7 @@ jobs:
TF_VAR_full_image_name_sequencer_subscriber: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.sequencer-subscriber-tags).tags[0] }}
TF_VAR_full_image_name_relayer: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.relayer-tags).tags[0] }}
TF_VAR_full_image_name_watcher: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.watcher-tags).tags[0] }}
TF_VAR_full_image_name_lighthouse_prover_subscriber: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.lighthouse-prover-subscriber-tags).tags[0] }}
TF_VAR_lighthouse_image_tag: ${{ github.sha }}

runs-on: ubuntu-latest
Expand Down
2 changes: 0 additions & 2 deletions .husky/commit-msg
Original file line number Diff line number Diff line change
@@ -1,4 +1,2 @@
#!/usr/bin/env sh
. "$(dirname -- "$0")/_/husky.sh"

yarn dlx commitlint --edit $1
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@

## Connext Architecture

The Connext architecture can be seen as a layered system, as follows:
The Connext architecture can be seen as a layered system, as follows.

| Layer | Protocol/Stakeholders |
| -------------------------------- | -------------------------------------- |
Expand Down
File renamed without changes.
85 changes: 85 additions & 0 deletions docker/lighthouse/subscriber/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
FROM node:18-alpine as node

# ----------------------------------------
# Builds Docker container for nxtp-router package.
# @dev configuraion located ./config.json (relative to this file)


# ----------------------------------------

FROM node as build
RUN apk update
RUN apk add git

ENV HOME=/tmp/build \
PATH=/tmp/build/node_modules/.bin:./node_modules/.bin:${PATH}

WORKDIR /tmp/build

ARG TEMP_DEPS_DIR

# ----- Copy only the files that affect yarn install -----
# Allows docker to use cache and skip install if dependencies are unchanged.
# Assumes that ./packages/*/package.json files have been copied to TEMP_DEPS_DIR
# with that same directory structure. build.sh does this.
COPY .yarn /tmp/build/.yarn/
COPY .yarnrc.yml /tmp/build/
COPY package.json /tmp/build/
COPY packages/agents/lighthouse/package.json /tmp/build/packages/agents/lighthouse/
COPY packages/agents/relayer/package.json /tmp/build/packages/agents/relayer/
COPY packages/adapters/txservice/package.json /tmp/build/packages/adapters/txservice/
COPY packages/adapters/cache/package.json /tmp/build/packages/adapters/cache/
COPY packages/adapters/web3signer/package.json /tmp/build/packages/adapters/web3signer/
COPY packages/deployments/contracts/package.json /tmp/build/packages/deployments/contracts/
COPY packages/adapters/database/package.json /tmp/build/packages/adapters/database/
COPY packages/adapters/relayer/package.json /tmp/build/packages/adapters/relayer/
COPY packages/adapters/subgraph/package.json /tmp/build/packages/adapters/subgraph/
COPY packages/adapters/web3signer/package.json /tmp/build/packages/adapters/web3signer/
COPY packages/utils/package.json /tmp/build/packages/utils/
COPY yarn.lock /tmp/build/

# ----- Install dependencies -----
# Install dependencies exactly as in the yarn.lock file - no updates.
RUN yarn install

# ----- Copy source and all other files that affect lint, test, build -----
COPY config config/
COPY packages/agents/lighthouse/ /tmp/build/packages/agents/lighthouse/
COPY packages/agents/relayer /tmp/build/packages/agents/relayer
COPY packages/adapters/txservice /tmp/build/packages/adapters/txservice
COPY packages/adapters/cache /tmp/build/packages/adapters/cache
COPY packages/adapters/web3signer /tmp/build/packages/adapters/web3signer
COPY packages/deployments/contracts /tmp/build/packages/deployments/contracts/
COPY packages/adapters/database /tmp/build/packages/adapters/database
COPY packages/adapters/relayer /tmp/build/packages/adapters/relayer
COPY packages/adapters/subgraph /tmp/build/packages/adapters/subgraph
COPY packages/utils /tmp/build/packages/utils
COPY .eslintignore /tmp/build/
COPY .eslintrc.js /tmp/build/

# ----- Lint, test and build -----
RUN yarn build

# ----------------------------------------
# Copy files to the deployment image.
# ----------------------------------------

FROM node as runtime

ENV NODE_ENV=production \
PORT=8081

ARG COMMIT_HASH
ENV COMMIT_HASH ${COMMIT_HASH:-unknown}

# ----- Copy files required at runtime by the app -----
COPY --from=build --chown=node:node /tmp/build /home/node

# This user is created in the base image with uid and gid = 1000.
USER node

WORKDIR /home/node/packages/agents/lighthouse

EXPOSE 8081

CMD ["node", "--trace-warnings", "dist/tasks/run.js"]
8 changes: 5 additions & 3 deletions ops/env/testnet/core/secrets.prod.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
"optgoerli_alchemy_key_1": "ENC[AES256_GCM,data:IKvEQW3u/ShLXgt90ZyvbwSgaoWSVjNKucefr1ZUOks=,iv:KNkyaDV+MoVJ4GmQDwxn/drHeTNXAtJ+IdXkh5r1UxY=,tag:7stNWMB0nmWqOrqZwsOENw==,type:str]",
"arbgoerli_alchemy_key_0": "ENC[AES256_GCM,data:FznvthayCWL5gQrBs4GSyRkZrXg1fAXTpuvHoZ0Brmw=,iv:h/Ln5MiegVXtUgCWB65hwfCVhRht9cr2Fw4QbUO4ZPg=,tag:r1ueHnIDTKcQBxVRmirvfg==,type:str]",
"arbgoerli_alchemy_key_1": "ENC[AES256_GCM,data:AoJEiPuHviI14XuFJP7/GFTbEd5UfLHXq3OefHwV3BQ=,iv:tvvt76MHKvXcsVOl+Lk2t6PjazzhS/tBXbVWuJ1JL8w=,tag:KS9pom1Fz9o7DLsPuxLrRQ==,type:str]",
"mumbai_alchemy_key_0": "ENC[AES256_GCM,data:VolMxEjn8+QnY13VzDpEWenyv1CBjvyjcLMb1l/xlrw=,iv:BWvw9p/3JYsLpqdszm5JIasoxjypghjaff/BJ2QIOtM=,tag:M/AN6XyOJoAL7/RNWy7SuQ==,type:str]",
"blast_key": "ENC[AES256_GCM,data:aOV48KWCE0L4tjHc+Tdt4oQBFGbTRKeb+2DMFI4Y7LGjYNke,iv:wv3W/M2ZKTFpj28WAUZIvPKOc4kvsWqabDd+qoVTdg4=,tag:gWHQBWTVIjT0PymIHOROnQ==,type:str]",
"infura_key": "ENC[AES256_GCM,data:xLJ5hNQ15pRWC7HwEX478tkJBv1czUM7LGufL+wIgsI=,iv:ZWrq2/0iXMTe+V6+0owJ4A3WczTMUYANEM6mUV/b8II=,tag:Uw8BBlJg6LkaVPMya9fMrA==,type:str]",
"admin_token_router": "ENC[AES256_GCM,data:V0FuvFfMBS0=,iv:MW6eOYjcM8xgMGpr3204tYvFsm3IVXNTAUjBmcs2YRc=,tag:lLfG206oCZvEUn7jeWTEyw==,type:str]",
Expand All @@ -13,14 +14,15 @@
"sequencer_web3_signer_private_key": "ENC[AES256_GCM,data:LKvTW3OXzOuoPCUcHSTzhJ9GUYZk1wXLZGeILQRI6Rby6F/uRzANeSRqlYQScpZFPWQsHP4kr4w0CAN87YKb+gBC,iv:FNTTCOjwsVNhq+aBY6wvciDMDC/k0me36OVueVg0KKc=,tag:HZZwkikhZvthv+NaegYaFA==,type:str]",
"rmq_mgt_password": "ENC[AES256_GCM,data:Oi9s0fu4N/f7fAfOrOzT,iv:dPo0CPlK/jW++lrvn8BXvBEUFYM1/zR/wQ18IbLFB1Y=,tag:S2poo/5rwURMmflFGkVFaQ==,type:str]",
"dd_api_key": "ENC[AES256_GCM,data:rIb32o+5nSbWcnlP2Mh809lyUX9YBPmdiLb2sMZjlKU=,iv:7FEHx2G+2f0DDXkpJbhg22olEFi84MJ5wGae7AWymLw=,tag:Uw30LcE7I6gSHpoOkHkkMw==,type:str]",
"gelato_api_key": "ENC[AES256_GCM,data:hO9Iu+2/P9VvjKdAD2bPUo3umAo40H8o4znXHjmU/eYRSoQeValKPQ6XYHE=,iv:e2wzAorK7Xi74ZjcseV7MXMYpzyZbshjTda26OCOCoE=,tag:6kJTtFFbGGX1Lp6eX1oRow==,type:str]",
"gelato_api_key": "ENC[AES256_GCM,data:4OclSfsgqoUaLlP2VCPHuBWHjyNhqacfcHSVIuITTT+3MS472H+/cDAD/Jo=,iv:FQxUG/iDcRYJfJ9+HmGKqVmMzQj2q+jYl97Ilk39iBM=,tag:P4P8+9T6NhKy/Le3tnlaPg==,type:str]",
"postgres_password": "ENC[AES256_GCM,data:B1oNgHFUYpPq0yW0nQ8g,iv:+S3cX5vplDOG6E7lOoP9i5gxZNImoJa15Lpq1hTt0lY=,tag:kz712HJLrstZJms8zwbHZA==,type:str]",
"lighthouse_prover_heartbeat": "ENC[AES256_GCM,data:oK1YZySKHGLzEQK1c9lIXV8+tSr7xUcE,iv:AbmAilQ6OKgsULAhf7FKPQnx+t7qhT16JKScfgx73c8=,tag:AGxzf4RhHF8KK3w/+aEPxw==,type:str]",
"lighthouse_processor_heartbeat": "ENC[AES256_GCM,data:jP4KFfz+YlpcDsV+RzyHpskYyUGppfyy,iv:VcyoHBwSvsN/hiZ5S44euEjjbJXOEX0/PwqGpy1IJMw=,tag:oatM6EgA5fU2zfZz2KPm5A==,type:str]",
"lighthouse_propagate_heartbeat": "ENC[AES256_GCM,data:ngWH/ENDrnuZWThozPT+NO1DWZ4eFgKH,iv:MJDorgIdm4o+vm1wgpwgqk9783sHi95sgfd0XXzStSM=,tag:3lCtngMWTyUf27+fz8yQRQ==,type:str]",
"lighthouse_send_outbound_root_heartbeat": "ENC[AES256_GCM,data:rK5ImySl4pZdI6Ag4sAZ84cECd/NTz1k,iv:450J2HvaXXf3p4fN1GAGFMQWRjBWKQI4KfqsiZh9gug=,tag:EE6dpf0QRLw7Z4c/RvVFSA==,type:str]",
"relayer_web3_signer_private_key": "ENC[AES256_GCM,data:zUtd3IiSb3GWERzM5aRQG0WInleSduWFkg6NJb/oIAJ4o4nMp1q+hWhPC2dEpma1lppbX9tkmydxAgrzr16u7MAa,iv:exruQBT5UsbagQiibyS88od/nmWHRs5wCPWetuFY4QY=,tag:G8QhkoxQYpqf0SioA/NBCQ==,type:str]",
"linea_node": "ENC[AES256_GCM,data:I1fqRfyk3iF0xsSd2OuyxCBdF2odFVRjYJg=,iv:sZlgP202Q7Q2gPGmefezi+8XNqWo8qV7SQzlGUHl1Ig=,tag:m7yczphoaziyedJMAL6AAg==,type:str]",
"optgoerli_alchemy_key_for_lh": "ENC[AES256_GCM,data:is7Xn79cWf8JIQEu5MPbdpy7kGKXmMDGbqnq5xxMinE=,iv:6UpjIqrMb0PNytb37aOH5clr4/GMVSIFGtO3T0NfYr8=,tag:JKhE5xQLR5wpMxOMscXvVQ==,type:str]",
"sops": {
"kms": [
{
Expand All @@ -34,8 +36,8 @@
"azure_kv": null,
"hc_vault": null,
"age": null,
"lastmodified": "2023-05-05T15:11:36Z",
"mac": "ENC[AES256_GCM,data:7QVkpinkhx3R1gwdTKmVRFZ5E9Yfvsgx5vHfnl/B4F5xiL2RPD+gglPqVP41h5i03VfltSsQtRaOzw4Bw935Eq/8Tr5ypr2vIb9hnMys4yq5lQDXEj2/dXsRRRp1EHAMwD2lFFa8OBJdqUwFQ3Ocl1Nj6UNtvPGohaEx6frctME=,iv:rKID/71rb1/Pg9YvoCIakkFgchvF9MCs9pqUUMS7B20=,tag:vkYdru8bzYNk93Cd++Vkew==,type:str]",
"lastmodified": "2023-06-20T08:53:00Z",
"mac": "ENC[AES256_GCM,data:03ff0KH7+dCzZrc/SHwl4DdInbZ5ArBveoDKQRRWStKX8r5aYxoVNGVLRv5GtJvg/sWRBodUxJfpXXr/C2N2TseMAbCcFeQz23LmJgQwljSvq9hC33Seupf5MUl0EX1+ibFkpLAmxYyhTKCiLMKNh7GvjTKxF6jt5CcOW+b1RyI=,iv:g9XXrnV7+SCwJT87RzIIGa+woRlhpLTAnUq46mCGfZk=,tag:8/1fuUCINRamsbQRpKyXTQ==,type:str]",
"pgp": null,
"unencrypted_suffix": "_unencrypted",
"version": "3.7.3"
Expand Down
Loading