Skip to content

Regression tests

altarchess edited this page Jun 12, 2022 · 47 revisions

Regression tests:

  • We run 20k stc games for all regression tests after 5.5. All tests using 4moves_noob.epd

Koivisto Dev vs 8.0

8.13 - 8.0

ELO | 51.14 +- 2.70 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 4694 L: 1771 D: 13535

8.10 - 8.0

ELO | 47.30 +- 2.71 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 4597 L: 1891 D: 13512

8.5 - 8.0

ELO | 9.42 +- 2.34 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 2651 L: 2109 D: 15240

8.3 - 8-0

ELO | 7.02 +- 2.35 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20008 W: 2592 L: 2188 D: 15228

Koivisto Dev vs 7.0

7.21 - 7.0

ELO | 151.93 +- 3.24 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 8925 L: 697 D: 10378

7.19 - 7.0

ELO | 142.68 +- 3.22 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 8602 L: 821 D: 10577

7.18 - 7.0

ELO | 139.22 +- 3.19 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 8451 L: 840 D: 10709

7.17 - 7.0

ELO | 124.34 +- 3.13 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 7889 L: 1022 D: 11089

7.16 - 7.0

ELO | 120.20 +- 3.11 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 7730 L: 1074 D: 11196

7.13 - 7.0

ELO | 108.47 +- 3.06 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 7271 L: 1222 D: 11507

7.11 - 7.0

ELO | 90.45 +- 2.98 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 6548 L: 1456 D: 11996

7.9 - 7.0

ELO | 49.85 +- 2.74 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 4735 L: 1885 D: 13380

7.7 - 7.0

ELO | 43.31 +- 2.74 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20008 W: 4536 L: 2055 D: 13417

7.4 - 7.0

ELO | 32.79 +- 2.73 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 4183 L: 2301 D: 13516

7.2 - 7.0

ELO | 7.71 +- 2.42 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 2765 L: 2321 D: 14914

Koivisto Dev vs 6.0

6.30 - 6.0

ELO | 106.83 +- 3.11 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 7334 L: 1371 D: 11295

6.28 - 6.0

ELO | 101.97 +- 3.11 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 7174 L: 1467 D: 11359

6.26 - 6.0

ELO | 95.97 +- 3.10 (95%) CONF | 8.0+0.08s Threads=1 Hash=8MB GAMES | N: 20000 W: 6984 L: 1596 D: 11420

6.14 - 6.0

ELO | 38.16 +- 2.76 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 4426 L: 2238 D: 13336

6.8 - 6.0

ELO | 24.57 +- 2.73 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 3936 L: 2524 D: 13540

6.5 - 6.0

ELO | 19.49 +- 2.72 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 3766 L: 2645 D: 13589

6.4 - 6.0

ELO | 10.93 +- 2.72 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 3510 L: 2881 D: 13609

6.3 - 6.0

ELO | 5.06 +- 2.68 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 3255 L: 2964 D: 13781

6.1 - 6.0

ELO | 2.92 +- 2.70 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 3247 L: 3079 D: 13674

Koivisto Dev vs 5.0

5.14 - 5.0

ELO | 199.07 +- 7.17 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 6216 W: 3568 L: 351 D: 2297

5.13 - 5.0

ELO | 88.83 +- 3.46 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 7664 L: 2659 D: 9677

5.12 - 5.0

ELO | 83.94 +- 3.47 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 7547 L: 2807 D: 9646

5.10 - 5.0

ELO | 77.41 +- 3.47 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 7361 L: 2977 D: 9662

5.9 - 5.0

ELO | 61.86 +- 3.39 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 6722 L: 3198 D: 10080

5.8 - 5.0

ELO | 62.33 +- 3.41 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 6781 L: 3231 D: 9988

5.7 - 5.0

ELO | 64.36 +- 3.41 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 20000 W: 6859 L: 3196 D: 9945

5.5 - 5.0

ELO | 58.50 +- 4.83 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 10000 W: 3345 L: 1677 D: 4978

5.3 - 5.0

ELO | 49.07 +- 4.82 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 10000 W: 3204 L: 1801 D: 4995

5.1 - 5.0

ELO | 30.09 +- 4.81 (95%) CONF | 10.0+0.10s Threads=1 Hash=16MB GAMES | N: 10000 W: 2925 L: 2061 D: 5014