Commits: JuliaLang/julia@548b7ba291ade37bb33fdd4d481a446b91e4e187 vs JuliaLang/julia@eba10ddfbb1f6c57fb65e1d8d0bd75e9ecb4e179
Comparison Diff: link
Triggered By: link
Tag Predicate: !"scalar"
Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.
Below is a table of this job's results, obtained by running the benchmarks found in
JuliaCI/BaseBenchmarks.jl. The values
listed in the ID column have the structure [parent_group, child_group, ..., key],
and can be used to index into the BaseBenchmarks suite to retrieve the corresponding
benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).
| ID | time ratio | memory ratio |
|---|---|---|
["alloc", "structs"] |
0.94 (5%) ✅ | 1.00 (1%) |
["array", "any/all", ("all", "BitArray")] |
1.07 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Bool}")] |
1.23 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Int16} generator")] |
1.24 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Int16}")] |
1.23 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Int64} generator")] |
1.09 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("all", "Vector{Int64}")] |
1.09 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "BitArray")] |
1.07 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Bool}")] |
1.23 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Int16} generator")] |
1.24 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Int16}")] |
1.24 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Int64} generator")] |
1.08 (5%) ❌ | 1.00 (1%) |
["array", "any/all", ("any", "Vector{Int64}")] |
1.08 (5%) ❌ | 1.00 (1%) |
["array", "bool", "bitarray_true_fill!"] |
1.06 (5%) ❌ | 1.00 (1%) |
["array", "bool", "boolarray_true_load!"] |
9.32 (5%) ❌ | 1.00 (1%) |
["array", "cat", ("catnd", 5)] |
1.08 (5%) ❌ | 1.00 (1%) |
["array", "cat", ("catnd", 500)] |
0.91 (5%) ✅ | 1.00 (1%) |
["array", "cat", ("hvcat", 5)] |
0.94 (5%) ✅ | 1.00 (1%) |
["array", "cat", ("hvcat_setind", 5)] |
0.93 (5%) ✅ | 1.00 (1%) |
["array", "cat", ("vcat", 5)] |
0.94 (5%) ✅ | 1.00 (1%) |
["array", "cat", ("vcat_setind", 5)] |
0.95 (5%) ✅ | 1.00 (1%) |
["array", "convert", ("Complex{Float64}", "Int")] |
0.87 (5%) ✅ | 1.00 (1%) |
["array", "convert", ("Float64", "Int")] |
0.66 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "BitArray")] |
0.83 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Bool}")] |
0.92 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Float32}")] |
0.93 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Float64}")] |
0.91 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Int64} == UnitRange{Int64}")] |
1.16 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Int64} == Vector{Float32}")] |
0.87 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("==", "Vector{Int64} == Vector{Int16}")] |
1.14 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "UnitRange{Int64}")] |
1.10 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Bool}")] |
0.92 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Float32}")] |
0.86 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Float64}")] |
0.86 (5%) ✅ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int16}")] |
1.14 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int64} isequal UnitRange{Int64}")] |
1.16 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int64} isequal Vector{Int16}")] |
1.14 (5%) ❌ | 1.00 (1%) |
["array", "equality", ("isequal", "Vector{Int64}")] |
1.14 (5%) ❌ | 1.00 (1%) |
["array", "index", "2d"] |
1.24 (5%) ❌ | 1.00 (1%) |
["array", "index", "3d"] |
1.06 (5%) ❌ | 1.00 (1%) |
["array", "index", "4d"] |
1.18 (5%) ❌ | 1.00 (1%) |
["array", "index", "5d"] |
1.23 (5%) ❌ | 1.00 (1%) |
["array", "index", "6d"] |
1.31 (5%) ❌ | 1.00 (1%) |
["array", "index", "7d"] |
1.40 (5%) ❌ | 1.00 (1%) |
["array", "index", ("sumcolon", "SubArray{Float32, 2, Array{Float32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, true}")] |
1.03 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumcolon", "SubArray{Float32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
1.02 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumcolon", "SubArray{Float32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Float32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
1.03 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumcolon", "SubArray{Float32, 2, Matrix{Float32}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, true}")] |
1.02 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumcolon", "SubArray{Int32, 2, Array{Int32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, true}")] |
0.97 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumcolon", "SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 2}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
1.01 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumcolon", "SubArray{Int32, 2, BaseBenchmarks.ArrayBenchmarks.ArrayLS{Int32, 3}, Tuple{Int64, Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, false}")] |
0.96 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumcolon", "SubArray{Int32, 2, Matrix{Int32}, Tuple{Base.Slice{Base.OneTo{Int64}}, Base.Slice{Base.OneTo{Int64}}}, true}")] |
1.01 (50%) | 1.02 (1%) ❌ |
["array", "index", ("sumeach", "BitMatrix")] |
0.13 (50%) ✅ | 1.00 (1%) |
["array", "index", ("sumeach_view", "BitMatrix")] |
7.81 (50%) ❌ | 1.00 (1%) |
["array", "index", ("sumlinear", "BitMatrix")] |
0.13 (50%) ✅ | 1.00 (1%) |
["array", "index", ("sumlinear_view", "BitMatrix")] |
7.80 (50%) ❌ | 1.00 (1%) |
["array", "reductions", ("sumabs", "Float64")] |
1.09 (5%) ❌ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 2)] |
0.93 (5%) ✅ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 3)] |
1.07 (5%) ❌ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 4)] |
1.07 (5%) ❌ | 1.00 (1%) |
["array", "setindex!", ("setindex!", 5)] |
1.07 (5%) ❌ | 1.00 (1%) |
["broadcast", "mix_scalar_tuple", (10, "scal_tup")] |
1.09 (5%) ❌ | 1.00 (1%) |
["broadcast", "typeargs", ("array", 3)] |
0.90 (5%) ✅ | 1.00 (1%) |
["broadcast", "typeargs", ("array", 5)] |
0.87 (5%) ✅ | 1.00 (1%) |
["broadcast", "typeargs", ("tuple", 5)] |
1.11 (5%) ❌ | 1.00 (1%) |
["collection", "initialization", ("Dict", "Int", "loop", "sizehint!")] |
1.52 (25%) ❌ | 1.00 (1%) |
["collection", "initialization", ("Vector", "String", "iterator")] |
1.55 (25%) ❌ | 1.00 (1%) |
["collection", "optimizations", ("Vector", "concrete", "Nothing")] |
2.12 (25%) ❌ | 1.00 (1%) |
["dates", "arithmetic", ("DateTime", "Day")] |
1.10 (5%) ❌ | 1.00 (1%) |
["dates", "arithmetic", ("DateTime", "Hour")] |
0.94 (5%) ✅ | 1.00 (1%) |
["dates", "arithmetic", ("DateTime", "Second")] |
1.06 (5%) ❌ | 1.00 (1%) |
["dates", "conversion", "Date -> DateTime"] |
0.82 (5%) ✅ | 1.00 (1%) |
["dates", "parse", ("Date", "DateFormat")] |
0.93 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("BitVector", "50-50")] |
0.94 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("Vector{Bool}", "10-90")] |
0.74 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("Vector{Bool}", "50-50")] |
0.85 (5%) ✅ | 1.00 (1%) |
["find", "findall", ("ispos", "Vector{Float64}")] |
0.94 (5%) ✅ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Int64}")] |
0.90 (5%) ✅ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{Int8}")] |
1.12 (5%) ❌ | 1.00 (1%) |
["find", "findnext", ("ispos", "Vector{UInt8}")] |
0.91 (5%) ✅ | 1.00 (1%) |
["find", "findprev", ("Vector{Bool}", "50-50")] |
3.29 (5%) ❌ | 1.00 (1%) |
["find", "findprev", ("ispos", "Vector{Float32}")] |
1.19 (5%) ❌ | 1.00 (1%) |
["inference", "abstract interpretation", "many_local_vars"] |
1.05 (5%) ❌ | 1.00 (1%) |
["inference", "abstract interpretation", "many_opaque_closures"] |
0.99 (5%) | 0.99 (1%) ✅ |
["inference", "optimization", "rand(Float64)"] |
1.06 (5%) ❌ | 1.00 (1%) |
["inference", "optimization", "sin(42)"] |
0.81 (5%) ✅ | 1.00 (1%) |
["io", "read", "read"] |
0.79 (5%) ✅ | 1.00 (1%) |
["io", "serialization", ("deserialize", "Matrix{Float64}")] |
0.95 (5%) ✅ | 1.00 (1%) |
["linalg", "small exp #29116"] |
1.00 (5%) | 1.02 (1%) ❌ |
["micro", "fib"] |
1.12 (5%) ❌ | 1.00 (1%) |
["micro", "parseint"] |
0.95 (5%) ✅ | 1.00 (1%) |
["micro", "printfd"] |
0.92 (5%) ✅ | 1.00 (1%) |
["misc", "23042", "Float64"] |
0.95 (5%) ✅ | 1.00 (1%) |
["misc", "allocation elision view", "conditional"] |
0.74 (5%) ✅ | 1.00 (1%) |
["misc", "allocation elision view", "no conditional"] |
1.29 (5%) ❌ | 1.00 (1%) |
["misc", "fastmath many args"] |
0.90 (5%) ✅ | 1.00 (1%) |
["misc", "foldl", "foldl(+, filter(...))"] |
1.16 (5%) ❌ | 1.00 (1%) |
["misc", "iterators", "zip(1:1)"] |
0.91 (5%) ✅ | 1.00 (1%) |
["misc", "iterators", "zip(1:1000, 1:1000)"] |
0.94 (5%) ✅ | 1.00 (1%) |
["misc", "iterators", "zip(1:1000, 1:1000, 1:1000)"] |
0.89 (5%) ✅ | 1.00 (1%) |
["misc", "iterators", "zip(1:1000, 1:1000, 1:1000, 1:1000)"] |
0.95 (5%) ✅ | 1.00 (1%) |
["misc", "julia", ("parse", "array")] |
1.09 (5%) ❌ | 1.00 (1%) |
["misc", "julia", ("parse", "function")] |
1.30 (5%) ❌ | 1.00 (1%) |
["misc", "julia", ("parse", "nested")] |
3.23 (5%) ❌ | 1.00 (1%) |
["misc", "repeat", (200, 1, 24)] |
0.95 (5%) ✅ | 1.00 (1%) |
["problem", "json", "parse_json"] |
0.92 (5%) ✅ | 1.00 (1%) |
["problem", "laplacian", "laplace_iter_devec"] |
0.91 (5%) ✅ | 1.00 (1%) |
["problem", "simplex", "simplex"] |
0.86 (5%) ✅ | 1.00 (1%) |
["problem", "stockcorr", "stockcorr"] |
1.07 (5%) ❌ | 1.00 (1%) |
["shootout", "fasta"] |
1.05 (5%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "axpy!", "Int32", 3, 64)] |
1.24 (20%) ❌ | 1.00 (1%) |
["simd", ("Cartesian", "conditional_loop!", "Int32", 3, 31)] |
1.47 (20%) ❌ | 1.00 (1%) |
["simd", ("CartesianPartition", "axpy!", "Float32", 3, 31)] |
1.20 (20%) ❌ | 1.00 (1%) |
["simd", ("CartesianPartition", "axpy!", "Int64", 3, 31)] |
1.26 (20%) ❌ | 1.00 (1%) |
["simd", ("CartesianPartition", "conditional_loop!", "Int64", 4, 31)] |
0.80 (20%) ✅ | 1.00 (1%) |
["simd", ("Linear", "auto_two_reductions", "Int32", 4095)] |
0.19 (20%) ✅ | 1.00 (1%) |
["simd", ("Linear", "auto_two_reductions", "Int32", 4096)] |
0.19 (20%) ✅ | 1.00 (1%) |
["simd", ("Linear", "inner_aliased", "Float32", 4095)] |
1.28 (20%) ❌ | 1.00 (1%) |
["simd", ("Linear", "inner_aliased", "Float32", 4096)] |
1.36 (20%) ❌ | 1.00 (1%) |
["simd", ("Linear", "sum_reduce", "Float32", 4095)] |
1.38 (20%) ❌ | 1.00 (1%) |
["sort", "length = 3", "Int unions with missing"] |
0.62 (20%) ✅ | 1.00 (1%) |
["sort", "length = 3", "ascending"] |
0.68 (20%) ✅ | 1.00 (1%) |
["sparse", "constructors", ("IV", 100)] |
0.87 (5%) ✅ | 1.00 (1%) |
["sparse", "constructors", ("IV", 1000)] |
0.92 (5%) ✅ | 1.00 (1%) |
["sparse", "index", ("spmat", "splogical", 100)] |
0.64 (30%) ✅ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_Bt!", "dense 4000x40, sparse 4000x4000 -> dense 40x4000")] |
1.41 (30%) ❌ | 1.00 (1%) |
["sparse", "matmul", ("At_mul_Bt!", "dense 400x40, sparse 4000x400 -> dense 40x4000")] |
1.45 (30%) ❌ | 1.00 (1%) |
["sparse", "sparse matvec", "non-adjoint"] |
0.90 (5%) ✅ | 1.00 (1%) |
["string", "findfirst", "Char"] |
1.09 (5%) ❌ | 1.00 (1%) |
["string", "readuntil", "backtracking"] |
0.95 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "no backtracking"] |
0.92 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "target length 1000"] |
0.93 (5%) ✅ | 1.00 (1%) |
["string", "readuntil", "target length 50000"] |
0.93 (5%) ✅ | 1.00 (1%) |
["tuple", "linear algebra", ("matmat", "(2, 2)", "(2, 2)")] |
1.09 (5%) ❌ | 1.00 (1%) |
["tuple", "linear algebra", ("matmat", "(4, 4)", "(4, 4)")] |
0.64 (5%) ✅ | 1.00 (1%) |
["tuple", "linear algebra", ("matmat", "(8, 8)", "(8, 8)")] |
0.82 (5%) ✅ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(16, 16)", "(16,)")] |
0.81 (5%) ✅ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(2, 2)", "(2,)")] |
0.93 (5%) ✅ | 1.00 (1%) |
["tuple", "linear algebra", ("matvec", "(8, 8)", "(8,)")] |
0.91 (5%) ✅ | 1.00 (1%) |
["tuple", "misc", "11899"] |
1.10 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("minimum", "(8, 8)")] |
1.12 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sum", "(2, 2)")] |
1.14 (5%) ❌ | 1.00 (1%) |
["tuple", "reduction", ("sumabs", "(2,)")] |
0.93 (5%) ✅ | 1.00 (1%) |
["tuple", "reduction", ("sumabs", "(4,)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(false, true)")] |
1.45 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Bool", "(true, true)")] |
1.42 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "ComplexF64", "(false, true)")] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "ComplexF64", "(true, true)")] |
0.92 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(false, false)")] |
2.22 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(false, true)")] |
1.47 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float32", "(true, true)")] |
1.56 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float64", "(false, false)")] |
2.01 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float64", "(false, true)")] |
1.47 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Float64", "(true, true)")] |
1.46 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int64", "(false, false)")] |
1.99 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int64", "(false, true)")] |
1.42 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int64", "(true, true)")] |
1.45 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int8", "(false, false)")] |
2.28 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int8", "(false, true)")] |
1.58 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "*", "Int8", "(true, true)")] |
1.54 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Bool", 1)] |
1.98 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "ComplexF64", 0)] |
0.92 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Float32", 0)] |
1.57 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Float32", 1)] |
1.61 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Float64", 0)] |
1.52 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Float64", 1)] |
1.43 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Int64", 0)] |
1.53 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Int64", 1)] |
1.63 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Int8", 0)] |
1.66 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "abs", "Int8", 1)] |
1.68 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "BigInt", 0)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Bool", 1)] |
1.70 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "ComplexF64", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Float32", 0)] |
1.67 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Float32", 1)] |
1.60 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Float64", 0)] |
1.49 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Float64", 1)] |
1.49 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Int64", 0)] |
1.51 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Int64", 1)] |
1.43 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Int8", 0)] |
1.92 (5%) ❌ | 1.00 (1%) |
["union", "array", ("broadcast", "identity", "Int8", 1)] |
1.80 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "BigFloat", 1)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "all", "Bool", 0)] |
1.98 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Bool", 1)] |
1.72 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Float32", 0)] |
1.81 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Float32", 1)] |
1.75 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Float64", 0)] |
1.64 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Float64", 1)] |
1.52 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Int64", 0)] |
1.65 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Int64", 1)] |
1.56 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Int8", 0)] |
1.98 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "all", "Int8", 1)] |
1.60 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "filter", "BigFloat", 1)] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "filter", "BigInt", 1)] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("collect", "filter", "Float64", 0)] |
1.18 (5%) ❌ | 1.00 (1%) |
["union", "array", ("collect", "filter", "Float64", 1)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(false, false)")] |
1.29 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(false, true)")] |
0.88 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Bool", "(true, true)")] |
0.89 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Float32", "(false, false)")] |
1.40 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Float32", "(false, true)")] |
0.84 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Float32", "(true, true)")] |
0.86 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Float64", "(false, false)")] |
1.40 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Float64", "(false, true)")] |
0.82 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Float64", "(true, true)")] |
0.84 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Int64", "(false, false)")] |
1.29 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Int64", "(false, true)")] |
0.84 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Int64", "(true, true)")] |
0.83 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Int8", "(false, false)")] |
1.25 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "*", "Int8", "(false, true)")] |
0.85 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "*", "Int8", "(true, true)")] |
0.85 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "abs", "Bool", 0)] |
1.99 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Bool", 1)] |
1.74 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Float32", 0)] |
1.90 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Float32", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Float64", 0)] |
1.58 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Float64", 1)] |
1.38 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Int64", 0)] |
1.63 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Int64", 1)] |
1.45 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Int8", 0)] |
1.79 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "abs", "Int8", 1)] |
1.14 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "BigFloat", 1)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("map", "identity", "Bool", 0)] |
1.98 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Bool", 1)] |
1.72 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Float32", 0)] |
1.81 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Float32", 1)] |
1.75 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Float64", 0)] |
1.64 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Float64", 1)] |
1.50 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Int64", 0)] |
1.64 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Int64", 1)] |
1.56 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Int8", 0)] |
1.98 (5%) ❌ | 1.00 (1%) |
["union", "array", ("map", "identity", "Int8", 1)] |
1.60 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Bool", "(false, false)")] |
1.80 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Bool", "(false, true)")] |
1.58 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Bool", "(true, true)")] |
1.55 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float32", "(false, false)")] |
1.79 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float32", "(false, true)")] |
1.60 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float32", "(true, true)")] |
1.52 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float64", "(false, false)")] |
1.66 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float64", "(false, true)")] |
1.46 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Float64", "(true, true)")] |
1.48 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int64", "(false, false)")] |
1.63 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int64", "(false, true)")] |
1.48 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int64", "(true, true)")] |
1.52 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int8", "(false, false)")] |
1.93 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int8", "(false, true)")] |
1.66 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_binaryop", "*", "Int8", "(true, true)")] |
1.55 (5%) ❌ | 1.00 (1%) |
["union", "array", ("perf_countnothing", "Bool", 0)] |
0.91 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_simplecopy", "BigInt", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_simplecopy", "Bool", 1)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum", "Int8", 0)] |
0.85 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum", "Int8", 1)] |
0.91 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum2", "Int8", 0)] |
0.87 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum2", "Int8", 1)] |
0.91 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum3", "Float64", 1)] |
0.74 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum3", "Int64", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum4", "Int8", 0)] |
0.84 (5%) ✅ | 1.00 (1%) |
["union", "array", ("perf_sum4", "Int8", 1)] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Bool", 0)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Union{Nothing, Bool}", 0)] |
1.16 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Union{Nothing, Float32}", 0)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Union{Nothing, Float64}", 0)] |
1.11 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Union{Nothing, Int64}", 0)] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "collect", "Union{Nothing, Int8}", 0)] |
1.15 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "eachindex", "Union{Missing, BigInt}", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "eachindex", "Union{Missing, Bool}", 1)] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "eachindex", "Union{Missing, ComplexF64}", 1)] |
1.07 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "eachindex", "Union{Missing, Float32}", 1)] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "eachindex", "Union{Missing, Float64}", 1)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "eachindex", "Union{Missing, Int64}", 1)] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "filter", "Union{Missing, Bool}", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "filter", "Union{Missing, Int64}", 1)] |
1.13 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "filter", "Union{Missing, Int8}", 1)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "filter", "Union{Nothing, BigInt}", 0)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "keys", "Union{Missing, BigFloat}", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "keys", "Union{Missing, Bool}", 1)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "keys", "Union{Missing, ComplexF64}", 1)] |
1.09 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "keys", "Union{Missing, Float32}", 1)] |
1.10 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "keys", "Union{Missing, Int64}", 1)] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "keys", "Union{Missing, Int8}", 1)] |
1.08 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Int8", 0)] |
0.83 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, BigFloat}", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, BigInt}", 1)] |
1.05 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Bool}", 1)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Float32}", 1)] |
1.06 (5%) ❌ | 1.00 (1%) |
["union", "array", ("skipmissing", "perf_sumskipmissing", "Union{Missing, Float64}", 1)] |
0.92 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "BigFloat", 0)] |
0.93 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "Union{Missing, BigFloat}", 1)] |
0.90 (5%) ✅ | 1.00 (1%) |
["union", "array", ("skipmissing", "sum", "Union{Nothing, Int64}", 0)] |
0.82 (5%) ✅ | 1.00 (1%) |
["union", "array", ("sort", "Union{Missing, Bool}", 1)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Float32}", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Float64}", 0)] |
0.94 (5%) ✅ | 1.00 (1%) |
["union", "array", ("sort", "Union{Nothing, Int8}", 0)] |
0.95 (5%) ✅ | 1.00 (1%) |
Here's a list of all the benchmark groups executed by this job:
["alloc"]["array", "accumulate"]["array", "any/all"]["array", "bool"]["array", "cat"]["array", "comprehension"]["array", "convert"]["array", "equality"]["array", "growth"]["array", "index"]["array", "reductions"]["array", "reverse"]["array", "setindex!"]["array", "subarray"]["broadcast"]["broadcast", "dotop"]["broadcast", "fusion"]["broadcast", "mix_scalar_tuple"]["broadcast", "sparse"]["broadcast", "typeargs"]["collection", "deletion"]["collection", "initialization"]["collection", "iteration"]["collection", "optimizations"]["collection", "queries & updates"]["collection", "set operations"]["dates", "accessor"]["dates", "arithmetic"]["dates", "construction"]["dates", "conversion"]["dates", "parse"]["dates", "query"]["dates", "string"]["find", "findall"]["find", "findnext"]["find", "findprev"]["frontend"]["inference", "abstract interpretation"]["inference", "allinference"]["inference", "optimization"]["io", "array_limit"]["io", "read"]["io", "serialization"]["io"]["linalg", "arithmetic"]["linalg", "blas"]["linalg", "factorization"]["linalg"]["micro"]["misc"]["misc", "23042"]["misc", "afoldl"]["misc", "allocation elision view"]["misc", "bitshift"]["misc", "foldl"]["misc", "issue 12165"]["misc", "iterators"]["misc", "julia"]["misc", "parse"]["misc", "repeat"]["misc", "splatting"]["problem", "chaosgame"]["problem", "fem"]["problem", "go"]["problem", "grigoriadis khachiyan"]["problem", "imdb"]["problem", "json"]["problem", "laplacian"]["problem", "monte carlo"]["problem", "raytrace"]["problem", "seismic"]["problem", "simplex"]["problem", "spellcheck"]["problem", "stockcorr"]["problem", "ziggurat"]["random", "collections"]["random", "randstring"]["random", "ranges"]["random", "sequences"]["random", "types"]["shootout"]["simd"]["sort", "insertionsort"]["sort", "issorted"]["sort", "issues"]["sort", "length = 10"]["sort", "length = 100"]["sort", "length = 1000"]["sort", "length = 10000"]["sort", "length = 3"]["sort", "length = 30"]["sort", "mergesort"]["sort", "quicksort"]["sparse", "arithmetic"]["sparse", "constructors"]["sparse", "index"]["sparse", "matmul"]["sparse", "sparse matvec"]["sparse", "sparse solves"]["sparse", "transpose"]["string", "==(::AbstractString, ::AbstractString)"]["string", "==(::SubString, ::String)"]["string", "findfirst"]["string"]["string", "readuntil"]["string", "repeat"]["tuple", "index"]["tuple", "linear algebra"]["tuple", "misc"]["tuple", "reduction"]["union", "array"]
Julia Version 1.11.0-DEV.1087
Commit 548b7ba291 (2023-12-12 19:58 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 22.04.3 LTS
uname: Linux 5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz:
speed user nice sys idle irq
#1 800 MHz 638382 s 182 s 174725 s 136706299 s 0 s
#2 3500 MHz 12139735 s 172 s 325007 s 125078938 s 0 s
#3 2500 MHz 599319 s 157 s 148766 s 136697185 s 0 s
#4 800 MHz 492646 s 181 s 159488 s 136739375 s 0 s
#5 800 MHz 491212 s 97 s 163829 s 136328625 s 0 s
#6 800 MHz 515809 s 136 s 158359 s 136800058 s 0 s
#7 800 MHz 546456 s 95 s 179494 s 136787630 s 0 s
#8 800 MHz 526163 s 98 s 143916 s 136845222 s 0 s
Memory: 31.301593780517578 GB (18302.15234375 MB free)
Uptime: 1.376546331e7 sec
Load Avg: 1.0 1.0 1.0
WORD_SIZE: 64
LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
Threads: 1 on 8 virtual cores
Julia Version 1.11.0-DEV.1085
Commit eba10ddfbb (2023-12-12 17:03 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
Ubuntu 22.04.3 LTS
uname: Linux 5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 x86_64 x86_64
CPU: Intel(R) Xeon(R) CPU E3-1241 v3 @ 3.50GHz:
speed user nice sys idle irq
#1 900 MHz 639093 s 182 s 174883 s 136807912 s 0 s
#2 3510 MHz 12239441 s 172 s 326959 s 125079932 s 0 s
#3 3500 MHz 599707 s 157 s 148784 s 136799420 s 0 s
#4 3900 MHz 492933 s 181 s 159500 s 136841639 s 0 s
#5 800 MHz 491298 s 97 s 163834 s 136431098 s 0 s
#6 800 MHz 515885 s 136 s 158363 s 136902622 s 0 s
#7 2500 MHz 546550 s 95 s 179499 s 136890176 s 0 s
#8 800 MHz 526332 s 98 s 143923 s 136947684 s 0 s
Memory: 31.301593780517578 GB (18431.23828125 MB free)
Uptime: 1.377572853e7 sec
Load Avg: 1.0 1.0 1.0
WORD_SIZE: 64
LLVM: libLLVM-15.0.7 (ORCJIT, haswell)
Threads: 1 on 8 virtual cores