Skip to content

Commit

Permalink
Establishes new performance baseline
Browse files Browse the repository at this point in the history
  • Loading branch information
Aaron Dandy committed Nov 23, 2023
1 parent f7fb5db commit c93d0be
Show file tree
Hide file tree
Showing 12 changed files with 68 additions and 68 deletions.
4 changes: 2 additions & 2 deletions ...eCantSpell.Hunspell.Benchmarks.NHunspell.Suites.CheckEnUsSuite-report-github.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,5 @@ MaxWarmupIterationCount=5 MinIterationCount=1 MinWarmupIterationCount=1
```
| Method | Mean | Error | StdDev | Min | Max | Median | Ratio |
|--------------------------- |----------:|----------:|----------:|----------:|----------:|----------:|------:|
| 'Check words: WeCantSpell' | 18.476 ms | 0.2682 ms | 0.0696 ms | 18.367 ms | 18.554 ms | 18.480 ms | 1.00 |
| 'Check words: NHunspell' | 6.097 ms | 0.1177 ms | 0.0420 ms | 6.019 ms | 6.132 ms | 6.111 ms | 0.33 |
| 'Check words: WeCantSpell' | 18.338 ms | 0.2788 ms | 0.0432 ms | 18.287 ms | 18.392 ms | 18.337 ms | 1.00 |
| 'Check words: NHunspell' | 6.060 ms | 0.1201 ms | 0.0794 ms | 5.973 ms | 6.175 ms | 6.049 ms | 0.33 |
4 changes: 2 additions & 2 deletions .../bench/results/WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.CheckEnUsSuite-report.csv
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
Method,Job,AnalyzeLaunchVariance,EvaluateOverhead,MaxAbsoluteError,MaxRelativeError,MinInvokeCount,MinIterationTime,OutlierMode,Affinity,EnvironmentVariables,Jit,LargeAddressAware,Platform,PowerPlanMode,Runtime,AllowVeryLargeObjects,Concurrent,CpuGroups,Force,HeapAffinitizeMask,HeapCount,NoAffinitize,RetainVm,Server,Arguments,BuildConfiguration,Clock,EngineFactory,NuGetReferences,Toolchain,IsMutator,InvocationCount,IterationCount,IterationTime,LaunchCount,MaxIterationCount,MaxWarmupIterationCount,MemoryRandomization,MinIterationCount,MinWarmupIterationCount,RunStrategy,UnrollFactor,WarmupCount,Mean,Error,StdDev,Min,Max,Median,Ratio
'Check words: WeCantSpell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,18.476 ms,0.2682 ms,0.0696 ms,18.367 ms,18.554 ms,18.480 ms,1.00
'Check words: NHunspell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,6.097 ms,0.1177 ms,0.0420 ms,6.019 ms,6.132 ms,6.111 ms,0.33
'Check words: WeCantSpell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,18.338 ms,0.2788 ms,0.0432 ms,18.287 ms,18.392 ms,18.337 ms,1.00
'Check words: NHunspell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,6.060 ms,0.1201 ms,0.0794 ms,5.973 ms,6.175 ms,6.049 ms,0.33
6 changes: 3 additions & 3 deletions ...bench/results/WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.CheckEnUsSuite-report.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
<html lang='en'>
<head>
<meta charset='utf-8' />
<title>WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.CheckEnUsSuite-20231123-110714</title>
<title>WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.CheckEnUsSuite-20231123-122835</title>

<style type="text/css">
table { border-collapse: collapse; display: block; width: 100%; overflow: auto; }
Expand All @@ -25,8 +25,8 @@
<table>
<thead><tr><th>Method </th><th>Mean</th><th>Error</th><th>StdDev</th><th>Min</th><th>Max</th><th>Median</th><th>Ratio</th>
</tr>
</thead><tbody><tr><td>&#39;Check words: WeCantSpell&#39;</td><td>18.476 ms</td><td>0.2682 ms</td><td>0.0696 ms</td><td>18.367 ms</td><td>18.554 ms</td><td>18.480 ms</td><td>1.00</td>
</tr><tr><td>&#39;Check words: NHunspell&#39;</td><td>6.097 ms</td><td>0.1177 ms</td><td>0.0420 ms</td><td>6.019 ms</td><td>6.132 ms</td><td>6.111 ms</td><td>0.33</td>
</thead><tbody><tr><td>&#39;Check words: WeCantSpell&#39;</td><td>18.338 ms</td><td>0.2788 ms</td><td>0.0432 ms</td><td>18.287 ms</td><td>18.392 ms</td><td>18.337 ms</td><td>1.00</td>
</tr><tr><td>&#39;Check words: NHunspell&#39;</td><td>6.060 ms</td><td>0.1201 ms</td><td>0.0794 ms</td><td>5.973 ms</td><td>6.175 ms</td><td>6.049 ms</td><td>0.33</td>
</tr></tbody></table>
</body>
</html>
4 changes: 2 additions & 2 deletions ...antSpell.Hunspell.Benchmarks.NHunspell.Suites.SuggestEnUsSuite-report-github.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,5 @@ MaxWarmupIterationCount=5 MinIterationCount=1 MinWarmupIterationCount=1
```
| Method | Mean | Error | StdDev | Min | Max | Median | Ratio | RatioSD |
|----------------------------- |-----------:|---------:|---------:|-----------:|-----------:|-----------:|------:|--------:|
| &#39;Suggest words: WeCantSpell&#39; | 751.7 ms | 9.60 ms | 1.49 ms | 750.2 ms | 753.5 ms | 751.5 ms | 1.00 | 0.00 |
| &#39;Suggest words: NHunspell&#39; | 1,896.1 ms | 34.36 ms | 15.25 ms | 1,875.9 ms | 1,908.8 ms | 1,905.4 ms | 2.52 | 0.02 |
| &#39;Suggest words: WeCantSpell&#39; | 759.0 ms | 7.36 ms | 1.14 ms | 758.1 ms | 760.7 ms | 758.7 ms | 1.00 | 0.00 |
| &#39;Suggest words: NHunspell&#39; | 1,895.0 ms | 32.72 ms | 17.11 ms | 1,873.2 ms | 1,911.9 ms | 1,899.5 ms | 2.50 | 0.02 |
4 changes: 2 additions & 2 deletions ...ench/results/WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.SuggestEnUsSuite-report.csv
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
Method,Job,AnalyzeLaunchVariance,EvaluateOverhead,MaxAbsoluteError,MaxRelativeError,MinInvokeCount,MinIterationTime,OutlierMode,Affinity,EnvironmentVariables,Jit,LargeAddressAware,Platform,PowerPlanMode,Runtime,AllowVeryLargeObjects,Concurrent,CpuGroups,Force,HeapAffinitizeMask,HeapCount,NoAffinitize,RetainVm,Server,Arguments,BuildConfiguration,Clock,EngineFactory,NuGetReferences,Toolchain,IsMutator,InvocationCount,IterationCount,IterationTime,LaunchCount,MaxIterationCount,MaxWarmupIterationCount,MemoryRandomization,MinIterationCount,MinWarmupIterationCount,RunStrategy,UnrollFactor,WarmupCount,Mean,Error,StdDev,Min,Max,Median,Ratio,RatioSD
'Suggest words: WeCantSpell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,751.7 ms,9.60 ms,1.49 ms,750.2 ms,753.5 ms,751.5 ms,1.00,0.00
'Suggest words: NHunspell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,"1,896.1 ms",34.36 ms,15.25 ms,"1,875.9 ms","1,908.8 ms","1,905.4 ms",2.52,0.02
'Suggest words: WeCantSpell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,759.0 ms,7.36 ms,1.14 ms,758.1 ms,760.7 ms,758.7 ms,1.00,0.00
'Suggest words: NHunspell',Job-TPWOKF,False,Default,Default,Default,1,Default,Default,1111111111111111,Empty,RyuJit,Default,X64,8c5e7fda-e8bf-4a96-9a85-a6e23a8c635c,.NET Framework 4.8,False,True,False,True,Default,Default,False,False,False,Default,Default,Default,Default,Default,Default,Default,Default,Default,1.0000 s,Default,20,5,Default,1,1,Default,16,Default,"1,895.0 ms",32.72 ms,17.11 ms,"1,873.2 ms","1,911.9 ms","1,899.5 ms",2.50,0.02
6 changes: 3 additions & 3 deletions ...nch/results/WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.SuggestEnUsSuite-report.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
<html lang='en'>
<head>
<meta charset='utf-8' />
<title>WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.SuggestEnUsSuite-20231123-110746</title>
<title>WeCantSpell.Hunspell.Benchmarks.NHunspell.Suites.SuggestEnUsSuite-20231123-122910</title>

<style type="text/css">
table { border-collapse: collapse; display: block; width: 100%; overflow: auto; }
Expand All @@ -25,8 +25,8 @@
<table>
<thead><tr><th>Method </th><th>Mean</th><th>Error</th><th>StdDev</th><th>Min </th><th>Max </th><th>Median</th><th>Ratio</th><th>RatioSD</th>
</tr>
</thead><tbody><tr><td>&#39;Suggest words: WeCantSpell&#39;</td><td>751.7 ms</td><td>9.60 ms</td><td>1.49 ms</td><td>750.2 ms</td><td>753.5 ms</td><td>751.5 ms</td><td>1.00</td><td>0.00</td>
</tr><tr><td>&#39;Suggest words: NHunspell&#39;</td><td>1,896.1 ms</td><td>34.36 ms</td><td>15.25 ms</td><td>1,875.9 ms</td><td>1,908.8 ms</td><td>1,905.4 ms</td><td>2.52</td><td>0.02</td>
</thead><tbody><tr><td>&#39;Suggest words: WeCantSpell&#39;</td><td>759.0 ms</td><td>7.36 ms</td><td>1.14 ms</td><td>758.1 ms</td><td>760.7 ms</td><td>758.7 ms</td><td>1.00</td><td>0.00</td>
</tr><tr><td>&#39;Suggest words: NHunspell&#39;</td><td>1,895.0 ms</td><td>32.72 ms</td><td>17.11 ms</td><td>1,873.2 ms</td><td>1,911.9 ms</td><td>1,899.5 ms</td><td>2.50</td><td>0.02</td>
</tr></tbody></table>
</body>
</html>
34 changes: 17 additions & 17 deletions .../results/WeCantSpell.Hunspell.Benchmarks.Suites.CheckEnUsSuite-report-github.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,20 +11,20 @@ MinInvokeCount=1 IterationTime=250.0000 ms MaxIterationCount=20
MaxWarmupIterationCount=5 MinIterationCount=1 MinWarmupIterationCount=1
```
| Method | Runtime | set | words | Mean | Error | StdDev | Min | Max | Median | Ratio | RatioSD |
|-------------- |------------------- |-------- |------------- |------------:|----------:|----------:|------------:|------------:|------------:|------:|--------:|
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **All** | **String[7158]** | **18,611.7 μs** | **222.26 μs** | **12.18 μs** | **18,597.8 μs** | **18,620.4 μs** | **18,616.8 μs** | **1.87** | **0.00** |
| &#39;Check words&#39; | .NET 6.0 | All | String[7158] | 9,930.7 μs | 84.23 μs | 13.03 μs | 9,912.3 μs | 9,943.1 μs | 9,933.8 μs | 1.00 | 0.00 |
| &#39;Check words&#39; | .NET 8.0 | All | String[7158] | 7,902.9 μs | 121.80 μs | 43.44 μs | 7,869.7 μs | 7,987.4 μs | 7,889.1 μs | 0.80 | 0.01 |
| | | | | | | | | | | | |
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **Correct** | **String[3001]** | **1,363.2 μs** | **21.76 μs** | **1.19 μs** | **1,362.3 μs** | **1,364.5 μs** | **1,362.7 μs** | **1.74** | **0.00** |
| &#39;Check words&#39; | .NET 6.0 | Correct | String[3001] | 784.4 μs | 8.98 μs | 0.49 μs | 783.9 μs | 784.8 μs | 784.6 μs | 1.00 | 0.00 |
| &#39;Check words&#39; | .NET 8.0 | Correct | String[3001] | 573.5 μs | 7.50 μs | 4.47 μs | 567.4 μs | 581.3 μs | 572.8 μs | 0.74 | 0.01 |
| | | | | | | | | | | | |
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **Roots** | **String[2035]** | **562.1 μs** | **13.73 μs** | **15.26 μs** | **551.9 μs** | **592.0 μs** | **553.8 μs** | **1.59** | **0.04** |
| &#39;Check words&#39; | .NET 6.0 | Roots | String[2035] | 366.0 μs | 5.29 μs | 1.37 μs | 363.9 μs | 367.2 μs | 366.3 μs | 1.00 | 0.00 |
| &#39;Check words&#39; | .NET 8.0 | Roots | String[2035] | 241.7 μs | 4.35 μs | 0.67 μs | 241.1 μs | 242.6 μs | 241.6 μs | 0.66 | 0.00 |
| | | | | | | | | | | | |
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **Wrong** | **String[4157]** | **17,707.5 μs** | **480.63 μs** | **553.49 μs** | **16,743.1 μs** | **18,581.6 μs** | **17,843.7 μs** | **1.98** | **0.03** |
| &#39;Check words&#39; | .NET 6.0 | Wrong | String[4157] | 9,038.7 μs | 79.60 μs | 35.34 μs | 8,985.4 μs | 9,091.9 μs | 9,042.3 μs | 1.00 | 0.00 |
| &#39;Check words&#39; | .NET 8.0 | Wrong | String[4157] | 7,360.2 μs | 129.96 μs | 93.97 μs | 7,218.5 μs | 7,479.9 μs | 7,372.6 μs | 0.81 | 0.01 |
| Method | Runtime | set | words | Mean | Error | StdDev | Min | Max | Median | Ratio |
|-------------- |------------------- |-------- |------------- |------------:|----------:|---------:|------------:|------------:|------------:|------:|
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **All** | **String[7158]** | **18,417.0 μs** | **264.01 μs** | **40.86 μs** | **18,358.4 μs** | **18,448.1 μs** | **18,430.7 μs** | **1.86** |
| &#39;Check words&#39; | .NET 6.0 | All | String[7158] | 9,915.8 μs | 141.57 μs | 7.76 μs | 9,910.7 μs | 9,924.8 μs | 9,912.1 μs | 1.00 |
| &#39;Check words&#39; | .NET 8.0 | All | String[7158] | 7,782.8 μs | 120.87 μs | 43.10 μs | 7,727.9 μs | 7,830.6 μs | 7,793.4 μs | 0.78 |
| | | | | | | | | | | |
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **Correct** | **String[3001]** | **1,359.4 μs** | **7.60 μs** | **0.42 μs** | **1,358.9 μs** | **1,359.7 μs** | **1,359.5 μs** | **1.68** |
| &#39;Check words&#39; | .NET 6.0 | Correct | String[3001] | 808.9 μs | 10.78 μs | 2.80 μs | 805.5 μs | 811.5 μs | 810.0 μs | 1.00 |
| &#39;Check words&#39; | .NET 8.0 | Correct | String[3001] | 554.3 μs | 10.31 μs | 7.46 μs | 546.0 μs | 570.1 μs | 551.4 μs | 0.69 |
| | | | | | | | | | | |
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **Roots** | **String[2035]** | **548.3 μs** | **8.98 μs** | **0.49 μs** | **547.7 μs** | **548.7 μs** | **548.5 μs** | **1.47** |
| &#39;Check words&#39; | .NET 6.0 | Roots | String[2035] | 373.7 μs | 0.89 μs | 0.05 μs | 373.6 μs | 373.7 μs | 373.7 μs | 1.00 |
| &#39;Check words&#39; | .NET 8.0 | Roots | String[2035] | 257.2 μs | 3.29 μs | 0.51 μs | 256.6 μs | 257.6 μs | 257.3 μs | 0.69 |
| | | | | | | | | | | |
| **&#39;Check words&#39;** | **.NET Framework 4.8** | **Wrong** | **String[4157]** | **16,404.3 μs** | **68.65 μs** | **3.76 μs** | **16,400.0 μs** | **16,406.8 μs** | **16,406.1 μs** | **1.83** |
| &#39;Check words&#39; | .NET 6.0 | Wrong | String[4157] | 8,952.3 μs | 43.38 μs | 2.38 μs | 8,950.0 μs | 8,954.8 μs | 8,952.0 μs | 1.00 |
| &#39;Check words&#39; | .NET 8.0 | Wrong | String[4157] | 6,877.2 μs | 135.73 μs | 98.14 μs | 6,735.4 μs | 7,021.2 μs | 6,904.8 μs | 0.77 |
Loading

0 comments on commit c93d0be

Please sign in to comment.