Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set up a GCP image with initial state for FT benchmark #11630

Closed
Tracked by #11348
aborg-dev opened this issue Jun 20, 2024 · 2 comments
Closed
Tracked by #11348

Set up a GCP image with initial state for FT benchmark #11630

aborg-dev opened this issue Jun 20, 2024 · 2 comments
Assignees

Comments

@aborg-dev
Copy link
Contributor

aborg-dev commented Jun 20, 2024

This is a follow-up to #11359.

We now know how to generate the initial state but still need to start using it in the benchmarks. Concretely, I think we should follow the steps suggested in https://near.zulipchat.com/#narrow/stream/308695-nearone.2Fprivate/topic/Creating.20GCP.20disk.20image.20with.20initial.20NEAR.20state/near/445814332 for creating a new GCP image and then using this image in the Terraform configuration of CRT benchmark.

@aborg-dev
Copy link
Contributor Author

I finished generating a GCP disk and image with desired state, it is available at crt-benchmark-state-28-06-2024.
Some useful stats for when we decide to repeat the state generation:

  • It was fully generated on a single n2d-standard-16 instance in just under 40 hours.
  • The command that I've used to generate it is:
locust -H 127.0.0.1:3030 \
  -f locustfiles/ft.py \
  --funding-key=$KEY \
   --fixed-contract-names --num-ft-contracts=1 \
   --num-passive-users=5000000 \
   --max-workers=8 -u 1 -r 1 --headless --processes 8

To use this state, one must use --fixed-contract-names, --num-ft-contracts=1 and --num-passive-users flags.

@aborg-dev
Copy link
Contributor Author

For the future record, here is how the shard size looks like:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant