Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable github action for experimental tests #273

Merged
merged 1 commit into from
Jan 30, 2025

Conversation

sunxd3
Copy link
Member

@sunxd3 sunxd3 commented Jan 30, 2025

No description provided.

@sunxd3 sunxd3 marked this pull request as ready for review January 30, 2025 20:51
Copy link
Contributor

Benchmark results on macOS (aarch64)

BridgeStan not found at location specified by $BRIDGESTAN environment variable, downloading version 2.6.1 to /Users/runner/.bridgestan/bridgestan-2.6.1
Done!
Model dogs produces error: ErrorException("log_density() failed with unknown exception\n")

Model Parameter Count Data Count Stan Density Time (µs) Stan Density Gradient Time (µs) JuliaBUGS Density Time with Graph Walk (µs) JuliaBUGS Density Gradient Time with ReverseDiff.jl(compiled tape) (µs)
rats 65 150 5.4666 7.639 80.917 339.312
pumps 12 10 0.931 1.08496 10.084 22.208
dogs 2 720 NA NA 196.125 330.416
seeds 26 21 2.0 2.39018 33.875 71.2705
surgical_realistic 14 12 1.24432 1.38428 15.917 29.8955
magnesium 108 96 10.625 11.542 106.645 219.646
salm 22 18 3.67271 4.26486 17.667 45.166
equiv 15 20 3.65283 4.22917 16.916 56.875
dyes 9 30 1.625 1.76947 11.292 50.042
stacks 6 21 1.22396 1.55094 18.542 52.625
epil 303 236 34.416 38.958 204.166 680.208
blockers 47 44 2.86914 3.09375 55.416 89.5415
oxford 244 240 11.9585 14.167 328.334 545.209
lsat 1006 5000 106.458 154.584 2841.75 3259.12
bones 33 422 82.4795 99.375 396.833 390.271
mice 20 65 7.0625 8.31933 32.5 103.5
kidney 64 58 8.94433 12.1875 54.7705 203.875
leuk 18 714 17.709 23.125 281.167 535.667
leukfr 40 714 24.083 30.542 321.917 700.271

Benchmark results on Ubuntu (x64)

BridgeStan not found at location specified by $BRIDGESTAN environment variable, downloading version 2.6.1 to /home/runner/.bridgestan/bridgestan-2.6.1
Done!
Model dogs produces error: ErrorException("log_density() failed with exception: Exception: bernoulli_lpmf: Probability parameter is inf, but must be in the interval [0, 1] (in '/home/runner/work/JuliaBUGS.jl/JuliaBUGS.jl/benchmark/stan/bugs_examples/vol1/dogs/dogs.stan', line 37, column 6 to line 38, column 62)\n")

Model Parameter Count Data Count Stan Density Time (µs) Stan Density Gradient Time (µs) JuliaBUGS Density Time with Graph Walk (µs) JuliaBUGS Density Gradient Time with ReverseDiff.jl(compiled tape) (µs)
rats 65 150 5.2898 7.51733 65.407 105.657
pumps 12 10 0.947258 1.13208 11.9525 6.61225
dogs 2 720 NA NA 172.226 167.732
seeds 26 21 1.93827 2.47042 27.081 19.686
surgical_realistic 14 12 1.327 1.50968 15.158 8.636
magnesium 108 96 10.3395 11.797 123.991 75.1295
salm 22 18 2.25842 2.8052 21.7 13.049
equiv 15 20 2.552 3.3175 19.075 15.098
dyes 9 30 1.01638 1.1914 11.867 13.099
stacks 6 21 1.04625 1.40024 22.723 14.778
epil 303 236 27.731 34.224 274.431 259.904
blockers 47 44 3.07356 3.41638 59.711 31.1075
oxford 244 240 13.991 16.47 358.507 184.123
lsat 1006 5000 165.018 205.974 1885.2 1244.4
bones 33 422 72.926 90.429 418.719 185.836
mice 20 65 7.26875 9.24367 29.785 37.68
kidney 64 58 11.0905 16.611 70.682 83.335
leuk 18 714 22.081 28.072 211.193 197.342
leukfr 40 714 25.888 33.041 236.269 234.887

@sunxd3 sunxd3 merged commit 54dc71c into master Jan 30, 2025
6 of 15 checks passed
@sunxd3 sunxd3 deleted the sunxd/enable_experimental_tests branch January 30, 2025 21:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant