Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write a script to do performance testing #642

Open
4 tasks
SankaD opened this issue Jan 22, 2024 · 0 comments
Open
4 tasks

Write a script to do performance testing #642

SankaD opened this issue Jan 22, 2024 · 0 comments
Assignees
Labels
automation labels regarding CI CD and other automation work perf improvements perf related improvements or testing Testing something related to testing

Comments

@SankaD
Copy link
Member

SankaD commented Jan 22, 2024

We need a script to automate performance testing to get the perf numbers when necessary. Below is the requirement.

Setup

  1. 2 environments setup for performance testing
  2. config file with details such as environments to connect to
  3. same config file or a different file to setup parameters per each test

Operation

Per each test,

  • Read node and spammer environment details from a config file
  • Clean rust node and spammer node's data/blocks directory
  • Start the nodes
  • Measure the performance metrics

Parameters

  1. Verification Thread count
  2. Tx rate from spammer
  3. Payload in transaction

CSV Format

  1. Tx Rate from Spammer
  2. Tx Payload Size
  3. Verification Thread Count
  4. Max Tx Rate at network thread
  5. Max Tx Rate at Verification Threads
  6. Total Txs
  7. Block Count
  8. Longest Chain length
  9. Total Block Size
  10. Average Block Size
  11. Time to load blocks
  12. Time to fetch blocks from peer
  13. RAM usage after initial run
  14. RAM usage after loading blocks from disk
  15. RAM usage after fetching blocks from peer

Output

A CSV file containing values "per" each perf test

@SankaD SankaD self-assigned this Jan 22, 2024
@SankaD SankaD added Large Testing something related to testing automation labels regarding CI CD and other automation work perf improvements perf related improvements or testing and removed Large labels Jan 22, 2024
@SankaD SankaD assigned davikstone2 and unassigned SankaD Jan 22, 2024
@SankaD SankaD assigned SankaD and unassigned davikstone2 Feb 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automation labels regarding CI CD and other automation work perf improvements perf related improvements or testing Testing something related to testing
Projects
None yet
Development

No branches or pull requests

2 participants