Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

perf(*) 2.7.1 performance run #8474

Closed
wants to merge 12 commits into from
Closed

perf(*) 2.7.1 performance run #8474

wants to merge 12 commits into from

Conversation

kikito
Copy link
Member

@kikito kikito commented Feb 28, 2022

Summary

Full changelog

  • [Implement ...]
  • [Add related tests]
  • ...

Issue reference

Fix #[issue number]

@github-actions github-actions bot added the chore Not part of the core functionality of kong, but still needed label Mar 1, 2022
@fffonion fffonion changed the base branch from master to perf/2.7.0 March 1, 2022 08:27
@github-actions
Copy link
Contributor

github-actions bot commented Mar 1, 2022

🚀 Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand 
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.103.96.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   657.15us    1.40ms  12.16ms   87.39%
    Req/Sec   105.13k     4.86k  119.80k    71.62%
  15700950 requests in 30.10s, 2.05GB read
Requests/sec: 521637.84
Transfer/sec:     69.65MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.103.96.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   656.54us    1.38ms  12.16ms   87.28%
    Req/Sec    96.67k     3.64k  118.84k    76.60%
  14426486 requests in 30.02s, 1.88GB read
Requests/sec: 480585.88
Transfer/sec:     64.16MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.103.96.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   666.40us    1.40ms  12.19ms   87.25%
    Req/Sec    96.88k     3.63k  115.87k    76.33%
  14458919 requests in 30.02s, 1.89GB read
Requests/sec: 481646.88
Transfer/sec:     64.31MB
### Combined result for upstream directly:
RPS     Avg: 494623.53
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa #simple #no_plugins #single_route
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 1):
Running 30s test @ http://10.103.96.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.44ms    2.74ms  70.60ms   91.99%
    Req/Sec    26.82k     5.73k   41.38k    60.99%
  4006889 requests in 30.10s, 859.60MB read
Requests/sec: 133122.35
Transfer/sec:     28.56MB
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 2):
Running 30s test @ http://10.103.96.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.47ms    2.96ms  74.91ms   92.19%
    Req/Sec    26.91k     6.05k   44.61k    59.56%
  4018427 requests in 30.10s, 862.08MB read
Requests/sec: 133504.71
Transfer/sec:     28.64MB
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 3):
Running 30s test @ http://10.103.96.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.42ms    2.64ms  54.38ms   91.50%
    Req/Sec    27.12k     6.00k   38.89k    58.33%
  4047195 requests in 30.02s, 868.25MB read
Requests/sec: 134816.49
Transfer/sec:     28.92MB
### Combined result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa:
RPS     Avg: 133814.52
Latency Avg: 1.44ms    Max: 74.91ms
  
### Test Suite: git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 1):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.38ms    2.41ms  46.37ms   91.78%
    Req/Sec    25.23k     5.51k   37.65k    60.57%
  3775392 requests in 30.10s, 809.94MB read
Requests/sec: 125428.08
Transfer/sec:     26.91MB
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 2):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.36ms    2.43ms  52.83ms   91.93%
    Req/Sec    25.44k     5.42k   37.39k    61.06%
  3809298 requests in 30.10s, 817.21MB read
Requests/sec: 126554.37
Transfer/sec:     27.15MB
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 3):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.37ms    2.45ms  55.93ms   91.91%
    Req/Sec    25.45k     5.34k   37.53k    58.67%
  3810996 requests in 30.10s, 817.58MB read
Requests/sec: 126609.12
Transfer/sec:     27.16MB
### Combined result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa:
RPS     Avg: 126197.19
Latency Avg: 1.37ms    Max: 55.93ms
  
### Test Suite: git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 1):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.05ms  52.31ms   93.50%
    Req/Sec    22.24k     3.98k   34.16k    67.36%
  3321488 requests in 30.10s, 712.56MB read
Requests/sec: 110350.64
Transfer/sec:     23.67MB
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 2):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.32ms    2.12ms  55.07ms   93.40%
    Req/Sec    22.15k     4.28k   32.19k    65.09%
  3314165 requests in 30.10s, 710.99MB read
Requests/sec: 110104.88
Transfer/sec:     23.62MB
### Result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa (run 3):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.32ms    2.15ms  66.69ms   93.61%
    Req/Sec    22.18k     4.24k   32.25k    66.38%
  3313764 requests in 30.10s, 710.90MB read
Requests/sec: 110090.69
Transfer/sec:     23.62MB
### Combined result for Kong git:92bec7949aa8e81a2f0bf9c85960b3d673c636fa:
RPS     Avg: 110182.07
Latency Avg: 1.31ms    Max: 66.69ms
  
### Test Suite: git:perf/2.7.0 #simple #no_plugins #single_route
### Result for Kong git:perf/2.7.0 (run 1):
Running 30s test @ http://10.103.96.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.42ms    2.70ms  56.63ms   91.46%
    Req/Sec    27.14k     6.20k   42.67k    58.56%
  4052823 requests in 30.10s, 869.46MB read
Requests/sec: 134648.04
Transfer/sec:     28.89MB
### Result for Kong git:perf/2.7.0 (run 2):
Running 30s test @ http://10.103.96.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.44ms    2.77ms  63.74ms   91.39%
    Req/Sec    27.30k     6.34k   49.75k    58.00%
  4073037 requests in 30.03s, 0.85GB read
Requests/sec: 135613.31
Transfer/sec:     29.09MB
### Result for Kong git:perf/2.7.0 (run 3):
Running 30s test @ http://10.103.96.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.44ms    2.78ms  72.32ms   91.52%
    Req/Sec    27.27k     6.22k   42.11k    59.33%
  4069748 requests in 30.02s, 0.85GB read
Requests/sec: 135566.11
Transfer/sec:     29.08MB
### Combined result for Kong git:perf/2.7.0:
RPS     Avg: 135275.82
Latency Avg: 1.43ms    Max: 72.32ms
  
### Test Suite: git:perf/2.7.0 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/2.7.0 (run 1):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.36ms    2.43ms  59.66ms   91.87%
    Req/Sec    25.39k     5.55k   37.07k    60.27%
  3800665 requests in 30.10s, 815.36MB read
Requests/sec: 126267.35
Transfer/sec:     27.09MB
### Result for Kong git:perf/2.7.0 (run 2):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.38ms    2.57ms  68.71ms   92.12%
    Req/Sec    25.38k     5.46k   38.03k    60.97%
  3797226 requests in 30.10s, 814.62MB read
Requests/sec: 126150.84
Transfer/sec:     27.06MB
### Result for Kong git:perf/2.7.0 (run 3):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.35ms    2.39ms  63.05ms   91.76%
    Req/Sec    25.53k     5.32k   38.63k    59.77%
  3820527 requests in 30.10s, 819.62MB read
Requests/sec: 126927.47
Transfer/sec:     27.23MB
### Combined result for Kong git:perf/2.7.0:
RPS     Avg: 126448.55
Latency Avg: 1.36ms    Max: 68.71ms
  
### Test Suite: git:perf/2.7.0 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/2.7.0 (run 1):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.37ms    2.31ms 130.11ms   93.04%
    Req/Sec    22.31k     4.17k   32.84k    66.02%
  3338720 requests in 30.10s, 716.26MB read
Requests/sec: 110920.71
Transfer/sec:     23.80MB
### Result for Kong git:perf/2.7.0 (run 2):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.38ms    2.39ms  55.18ms   93.33%
    Req/Sec    22.33k     4.43k   31.79k    66.18%
  3337055 requests in 30.10s, 715.90MB read
Requests/sec: 110865.32
Transfer/sec:     23.78MB
### Result for Kong git:perf/2.7.0 (run 3):
Running 30s test @ http://10.103.96.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.34ms    2.25ms  47.51ms   93.58%
    Req/Sec    22.52k     4.28k   33.82k    66.69%
  3369280 requests in 30.10s, 722.81MB read
Requests/sec: 111935.83
Transfer/sec:     24.01MB
### Combined result for Kong git:perf/2.7.0:
RPS     Avg: 111240.62
Latency Avg: 1.36ms    Max: 130.11ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

@kikito kikito closed this Mar 1, 2022
@kikito kikito deleted the perf-2.7.1 branch March 1, 2022 11:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
chore Not part of the core functionality of kong, but still needed core/balancer core/db
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@kikito @locao @aboudreault @bungle @fffonion