Skip to content

Commit

Permalink
[SPARK-45287][TESTS] Add Java 21 benchmark result
Browse files Browse the repository at this point in the history
  • Loading branch information
@dongjoon-hyun
dongjoon-hyun committed Sep 22, 2023
1 parent 06ccb6d commit 40b398e
Show file tree
Hide file tree
Showing 68 changed files with 7,249 additions and 0 deletions.
141 changes: 141 additions & 0 deletions connector/avro/benchmarks/AvroReadBenchmark-jdk21-results.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,141 @@
================================================================================================
SQL Single Numeric Column Scan
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2886 2979 132 5.4 183.5 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2867 2904 52 5.5 182.3 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 2971 2977 8 5.3 188.9 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3320 3330 13 4.7 211.1 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3054 3062 10 5.1 194.2 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum 3102 3120 25 5.1 197.2 1.0X


================================================================================================
Int and String Scan
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of columns 4712 4725 18 2.2 449.4 1.0X


================================================================================================
Partitioned Table Scan
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Data column 3554 3591 52 4.4 226.0 1.0X
Partition column 3319 3330 16 4.7 211.0 1.1X
Both columns 3660 3698 54 4.3 232.7 1.0X


================================================================================================
Repeated String Scan
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 3469 3533 91 3.0 330.8 1.0X


================================================================================================
String with Nulls Scan
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 5024 5112 124 2.1 479.1 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 3703 3795 130 2.8 353.2 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of string length 2179 2274 135 4.8 207.8 1.0X


================================================================================================
Select All From Wide Columns
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Wide Column Scan from 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select of all columns 38121 38267 207 0.0 76241.3 1.0X


================================================================================================
Single Column Scan From Wide Columns
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 3996 4014 24 0.3 3811.3 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 7311 7391 113 0.1 6972.3 1.0X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Sum of single column 11012 11019 9 0.1 10502.3 1.0X


OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
w/o filters 7807 7840 28 0.1 7807.5 1.0X
pushdown disabled 7685 7738 46 0.1 7685.0 1.0X
w/ filters 3342 3396 47 0.3 3342.4 2.3X

16 changes: 16 additions & 0 deletions connector/avro/benchmarks/AvroWriteBenchmark-jdk21-results.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Avro writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Output Single Int Column 2430 2450 29 6.5 154.5 1.0X
Output Single Double Column 2609 2618 12 6.0 165.9 0.9X
Output Int and String Column 5321 5359 54 3.0 338.3 0.5X
Output Partitions 4199 4331 187 3.7 267.0 0.6X
Output Buckets 5511 5533 31 2.9 350.4 0.4X

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Write wide rows into 20 files: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Write wide rows 35195 35378 259 0.0 70390.7 1.0X

40 changes: 40 additions & 0 deletions core/benchmarks/CoalescedRDDBenchmark-jdk21-results.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
================================================================================================
Coalesced RDD , large scale
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 452 488 58 0.2 4519.3 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 217 225 8 0.5 2173.4 2.1X
Coalesce Num Partitions: 100 Num Hosts: 10 215 218 4 0.5 2154.3 2.1X
Coalesce Num Partitions: 100 Num Hosts: 20 216 229 11 0.5 2158.9 2.1X
Coalesce Num Partitions: 100 Num Hosts: 40 177 195 17 0.6 1766.0 2.6X
Coalesce Num Partitions: 100 Num Hosts: 80 226 236 10 0.4 2256.0 2.0X
Coalesce Num Partitions: 500 Num Hosts: 1 1575 1595 22 0.1 15749.0 0.3X
Coalesce Num Partitions: 500 Num Hosts: 5 446 472 33 0.2 4457.9 1.0X
Coalesce Num Partitions: 500 Num Hosts: 10 311 323 11 0.3 3112.5 1.5X
Coalesce Num Partitions: 500 Num Hosts: 20 278 283 5 0.4 2776.6 1.6X
Coalesce Num Partitions: 500 Num Hosts: 40 208 214 9 0.5 2081.8 2.2X
Coalesce Num Partitions: 500 Num Hosts: 80 235 242 6 0.4 2349.5 1.9X
Coalesce Num Partitions: 1000 Num Hosts: 1 2929 2962 37 0.0 29292.4 0.2X
Coalesce Num Partitions: 1000 Num Hosts: 5 672 680 13 0.1 6721.3 0.7X
Coalesce Num Partitions: 1000 Num Hosts: 10 446 454 13 0.2 4463.5 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 20 314 321 10 0.3 3138.4 1.4X
Coalesce Num Partitions: 1000 Num Hosts: 40 304 321 15 0.3 3040.5 1.5X
Coalesce Num Partitions: 1000 Num Hosts: 80 220 234 13 0.5 2201.6 2.1X
Coalesce Num Partitions: 5000 Num Hosts: 1 13745 13778 36 0.0 137452.8 0.0X
Coalesce Num Partitions: 5000 Num Hosts: 5 3790 3831 36 0.0 37897.8 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 10 2054 2090 31 0.0 20544.6 0.2X
Coalesce Num Partitions: 5000 Num Hosts: 20 1018 1069 45 0.1 10176.6 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 40 628 654 26 0.2 6277.8 0.7X
Coalesce Num Partitions: 5000 Num Hosts: 80 463 474 16 0.2 4625.3 1.0X
Coalesce Num Partitions: 10000 Num Hosts: 1 25828 26067 320 0.0 258276.9 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 7638 7751 125 0.0 76377.0 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 3914 3963 75 0.0 39140.7 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 20 2116 2139 33 0.0 21163.6 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 40 1041 1063 25 0.1 10412.2 0.4X
Coalesce Num Partitions: 10000 Num Hosts: 80 624 649 22 0.2 6241.4 0.7X


28 changes: 28 additions & 0 deletions core/benchmarks/KryoBenchmark-jdk21-results.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
================================================================================================
Benchmark Kryo Unsafe vs safe Serialization
================================================================================================

OpenJDK 64-Bit Server VM 21+35 on Linux 5.15.0-1046-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Benchmark Kryo Unsafe vs safe Serialization: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
basicTypes: Int with unsafe:true 315 333 11 3.2 315.0 1.0X
basicTypes: Long with unsafe:true 351 366 12 2.8 351.0 0.9X
basicTypes: Float with unsafe:true 362 379 13 2.8 362.0 0.9X
basicTypes: Double with unsafe:true 376 399 14 2.7 375.6 0.8X
Array: Int with unsafe:true 4 5 1 273.9 3.7 86.3X
Array: Long with unsafe:true 6 7 1 163.4 6.1 51.5X
Array: Float with unsafe:true 4 4 0 274.1 3.6 86.3X
Array: Double with unsafe:true 6 7 1 157.3 6.4 49.5X
Map of string->Double with unsafe:true 46 49 2 21.8 45.8 6.9X
basicTypes: Int with unsafe:false 380 397 9 2.6 379.6 0.8X
basicTypes: Long with unsafe:false 413 434 17 2.4 413.0 0.8X
basicTypes: Float with unsafe:false 364 382 9 2.8 363.6 0.9X
basicTypes: Double with unsafe:false 388 412 13 2.6 387.9 0.8X
Array: Int with unsafe:false 22 25 2 45.6 21.9 14.4X
Array: Long with unsafe:false 36 38 2 27.8 35.9 8.8X
Array: Float with unsafe:false 11 13 1 91.8 10.9 28.9X
Array: Double with unsafe:false 16 18 1 62.7 15.9 19.8X
Map of string->Double with unsafe:false 49 54 3 20.5 48.9 6.4X


Loading

0 comments on commit 40b398e

Please sign in to comment.