Commits: JuliaLang/julia@c5ee39f1012676f3e719c548a3b56d6a180722f9 vs JuliaLang/julia@ebae71690cd99a50406c27fcebf9adaa2d4ef064
Comparison Diff: link
Triggered By: link
Tag Predicate: !"scalar"
Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.
Below is a table of this job's results, obtained by running the benchmarks found in
JuliaCI/BaseBenchmarks.jl. The values
listed in the ID column have the structure [parent_group, child_group, ..., key],
and can be used to index into the BaseBenchmarks suite to retrieve the corresponding
benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).
| ID | time ratio | memory ratio |
|---|---|---|
["array", "accumulate", ("cumsum!", "Float64", "dim2")] |
1.07 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("==", "BitArray")] |
1.10 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("==", "UnitRange{Int64}")] |
0.84 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "UnitRange{Int64}")] |
1.10 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Int64}")] |
0.94 (5%) ✅ | 1.00 (1%) |
["array", "growth", ("push_multiple!", 256)] |
1.09 (5%) ❌ | 1.00 (1%) |
["array", "index", "2d"] |
1.06 (5%) ❌ | 1.00 (1%) |
["array", "reductions", ("norm1", "Float64")] |
1.07 (5%) ❌ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 1)] |
0.93 (5%) ✅ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 2)] |
1.08 (5%) ❌ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 3)] |
0.93 (5%) ✅ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 4)] |
1.08 (5%) ❌ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 5)] |
1.08 (5%) ❌ | 1.00 (1%) |
["broadcast", "dotop", ("Float64", "(1000, 1000)", 2)] |
0.91 (5%) ✅ | 1.00 (1%) |
["broadcast", "mix_scalar_tuple", (10, "scal_tup_x3")] |
1.14 (5%) ❌ | 1.00 (1%) |
["broadcast", "typeargs", ("tuple", 10)] |
0.88 (5%) ✅ | 1.00 (1%) |
["collection", "queries & updates", ("BitSet", "Int", "length")] |
0.42 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "==", "self")] |
0.38 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "⊆", "Set")] |
0.50 (25%) ✅ | 1.00 (1%) |
["collection", "set operations", ("BitSet", "Int", "⊆", "Vector")] |
0.48 (25%) ✅ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{Float32}")] |
0.93 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{Float64}")] |
0.94 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{UInt64}")] |
0.92 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{UInt8}")] |
0.93 (5%) ✅ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Float32}")] |
1.13 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Float64}")] |
0.94 (5%) ✅ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{UInt8}")] |
0.94 (5%) ✅ | 1.00 (1%) |
["io", "array_limit", ("display", "Matrix{Float64}(10000, 10000)")] |
1.05 (5%) ❌ | 1.00 (1%) |
["io", "read", "read"] |
1.15 (5%) ❌ | 1.00 (1%) |
["io", "serialization", ("deserialize", "Matrix{Float64}")] |
0.88 (5%) ✅ | 1.00 (1%) |
["misc", "allocation elision view", "conditional"] |
1.10 (5%) ❌ | 1.00 (1%) |
["misc", "allocation elision view", "no conditional"] |
0.91 (5%) ✅ | 1.00 (1%) |
["misc", "bitshift", ("UInt32", "UInt32")] |
0.84 (5%) ✅ | 1.00 (1%) |
["misc", "foldl", "foldl(+, filter(...))"] |
1.12 (5%) ❌ | 1.00 (1%) |
["misc", "julia", ("macroexpand", "evalpoly")] |
1.06 (5%) ❌ | 1.00 (1%) |
["problem", "simplex", "simplex"] |
0.91 (5%) ✅ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Float64", 2, 64)] |
1.88 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Float32", 4, 64)] |
0.75 (20%) ✅ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Float64", 3, 31)] |
1.27 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "manual_example!", "Int32", 3, 32)] |
0.63 (20%) ✅ | 1.00 (1%) |
["simd", ("CartesianPartition", "axpy!", "Float64", 2, 64)] |
1.61 (20%) ❌ | 1.00 (1%) |
["sparse", "constructors", ("Diagonal", 100)] |
0.90 (5%) ✅ | 1.00 (1%) |
["sparse", "constructors", ("Diagonal", 1000)] |
0.92 (5%) ✅ | 1.00 (1%) |
["sparse", "constructors", ("IJV", 1000)] |
0.91 (5%) ✅ | 1.00 (1%) |
["sparse", "constructors", ("SymTridiagonal", 100)] |
0.93 (5%) ✅ | 1.00 (1%) |
["sparse", "transpose", ("transpose", "(600, 400)")] |
1.40 (30%) ❌ | 1.00 (1%) |
["string", "==(::SubString, ::String)", "different length"] |
1.17 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(8, 8)", "(8,)")] |
0.86 (5%) ✅ | 1.00 (1%) |
["tuple", "reduction", ("minimum", "(4,)")] |
1.06 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sumabs", "(2, 2)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["tuple", "reduction", ("sumabs", "(4,)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "all", "Int64", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "abs", "Float32", 1)] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "abs", "Int8", 0)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Int64", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum", "Int8", 0)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum", "Int8", 1)] |
1.07 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum2", "Int8", 0)] |
1.11 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_sum4", "Int8", 0)] |
1.10 (5%) ❌ | 1.00 (1%) |
Here's a list of all the benchmark groups executed by this job:
["alloc"]["array", "accumulate"]["array", "any/all"]["array", "bool"]["array", "cat"]["array", "comprehension"]["array", "convert"]["array", "equality"]["array", "growth"]["array", "index"]["array", "reductions"]["array", "reverse"]["array", "setindex!"]["array", "subarray"]["broadcast"]["broadcast", "dotop"]["broadcast", "fusion"]["broadcast", "mix_scalar_tuple"]["broadcast", "sparse"]["broadcast", "typeargs"]["collection", "deletion"]["collection", "initialization"]["collection", "iteration"]["collection", "optimizations"]["collection", "queries & updates"]["collection", "set operations"]["dates", "accessor"]["dates", "arithmetic"]["dates", "construction"]["dates", "conversion"]["dates", "parse"]["dates", "query"]["dates", "string"]["find", "findall"]["find", "findnext"]["find", "findprev"]["frontend"]["inference", "abstract interpretation"]["inference", "allinference"]["inference", "optimization"]["io", "array_limit"]["io", "read"]["io", "serialization"]["io"]["linalg", "arithmetic"]["linalg", "blas"]["linalg", "factorization"]["linalg"]["micro"]["misc"]["misc", "23042"]["misc", "afoldl"]["misc", "allocation elision view"]["misc", "bitshift"]["misc", "foldl"]["misc", "issue 12165"]["misc", "iterators"]["misc", "julia"]["misc", "parse"]["misc", "repeat"]["misc", "splatting"]["problem", "chaosgame"]["problem", "fem"]["problem", "go"]["problem", "grigoriadis khachiyan"]["problem", "imdb"]["problem", "json"]["problem", "laplacian"]["problem", "monte carlo"]["problem", "raytrace"]["problem", "seismic"]["problem", "simplex"]["problem", "spellcheck"]["problem", "stockcorr"]["problem", "ziggurat"]["random", "collections"]["random", "randstring"]["random", "ranges"]["random", "sequences"]["random", "types"]["shootout"]["simd"]["sort", "insertionsort"]["sort", "issorted"]["sort", "mergesort"]["sort", "quicksort"]["sparse", "arithmetic"]["sparse", "constructors"]["sparse", "index"]["sparse", "matmul"]["sparse", "sparse matvec"]["sparse", "sparse solves"]["sparse", "transpose"]["string", "==(::AbstractString, ::AbstractString)"]["string", "==(::SubString, ::String)"]["string", "findfirst"]["string"]["string", "readuntil"]["string", "repeat"]["tuple", "index"]["tuple", "linear algebra"]["tuple", "misc"]["tuple", "reduction"]["union", "array"]
Julia Version 1.11.0-DEV.264
Commit c5ee39f101 (2023-08-10 02:10 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 22.04.2 LTS
uname: Linux 5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz:
speed user nice sys idle irq
#1 1200 MHz 93442 s 28 s 38483 s 29712625 s 0 s
#2 800 MHz 1578228 s 29 s 64588 s 28167181 s 0 s
#3 3506 MHz 93491 s 26 s 54621 s 29691505 s 0 s
#4 800 MHz 76560 s 29 s 36632 s 29698519 s 0 s
#5 2500 MHz 77370 s 21 s 56230 s 29566214 s 0 s
#6 800 MHz 81838 s 22 s 49600 s 29699043 s 0 s
#7 800 MHz 88637 s 6 s 45783 s 29698022 s 0 s
#8 800 MHz 88898 s 40 s 60300 s 29690950 s 0 s
Memory: 31.301593780517578 GB (24431.98828125 MB free)
Uptime: 2.98745749e6 sec
Load Avg: 1.07 1.02 1.0
WORD_SIZE: 64
LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
Threads: 1 on 8 virtual cores
Julia Version 1.11.0-DEV.251
Commit ebae71690c (2023-08-10 00:23 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 22.04.2 LTS
uname: Linux 5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz:
speed user nice sys idle irq
#1 900 MHz 94082 s 28 s 38972 s 29813280 s 0 s
#2 800 MHz 1677130 s 29 s 66081 s 28168825 s 0 s
#3 3503 MHz 94186 s 26 s 54637 s 29792850 s 0 s
#4 800 MHz 76633 s 29 s 36641 s 29800406 s 0 s
#5 800 MHz 77443 s 21 s 56240 s 29668047 s 0 s
#6 800 MHz 82428 s 22 s 49611 s 29800508 s 0 s
#7 800 MHz 88897 s 6 s 45790 s 29799811 s 0 s
#8 800 MHz 89026 s 40 s 60306 s 29792877 s 0 s
Memory: 31.301593780517578 GB (24434.9765625 MB free)
Uptime: 2.99766473e6 sec
Load Avg: 1.0 1.0 1.0
WORD_SIZE: 64
LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
Threads: 1 on 8 virtual cores