Разные матчи и турниры движков

[Владимир001]

Ongoing (10x128) policy head championship results:
openingbook: jhorthos "book-ply8-unifen-Q-0.40-1.0" (each player plays each opening as both colors )
time controls: 1npm
version: 0.27.0
hardware: irrelevant

# PLAYER                                                     :  RATING  ERROR  POINTS  PLAYED   (DRAW%)
   1 lc0.v27.0.703810.10x128                                  :       0     --      7693.0    15026    51.2
   2 lc0.v27.0.T59.591226.10x128                         :      -1      7       7670.0    15026    51.0
   3 lc0.v27.0.T60.jh.j104.1-30.10x128                 :      -1      6       7666.0    15024    51.0
   4 lc0.v27.0.T60.sv.2990.10x128                       :     -25     7      7021.0     15024    46.7

White advantage = 86.37 +/- 1.99
Draw rate (equal opponents) = 15.54 % +/- 0.22

https://pixeldrain.com/u/8AHidMrg

[Владимир001]

Hardware: i5-8400 CPU @ 2.80GHz, 6 cores, 32GB, gpu RTX 2060, 6GB
Gauntlet: SF-dev vs. LC0 384x30b nets
Network IDs: J94-100, 67646, 67831, 67892, 67925, 67971, 67996, 68059, 68112, 68169, 68207, 68242, 68285, 68326, 68363, 68405, 68446
LC0-version: v0.27.0
LC0-options: minibatch-size=90
SF-version: SF-dev 20120516
SF-options: 4 Threads, 512MB Hash
Software: Cutechess-CLI
Time control: LC0: 1,500 nodes/move, SF-dev: 500,000 nodes/move
Book: Chad's 8-ply book with 10000 positions, order=sequential
Tablebases: 6-men
Adjudication: -draw movenumber=50 movecount=5 score=8 -resign movecount=5 score=1000
Ordo: -a 0 -A "Stockfish.dev" -W -D -U "0,1,2,3,4,5,6,7,8,9,10" -s 2000 -n 1
Comment:

# PLAYER             :  RATING  ERROR    POINTS  PLAYED   (%)  CFS(%)      W       D      L  D(%)
-  1 lc0.net.J94-100    :    29.4    3.0   10817.5   20000    54      51   4562   12511   2927    63
   2 lc0.net.68405      :    29.4    3.0   10815.5   20000    54      64   4698   12235   3067    61
   3 lc0.net.68285      :    28.6    3.0   10793.5   20000    54      52   4644   12299   3057    61
   4 lc0.net.67892      :    28.4    3.0   10790.0   20000    54      58   4646   12288   3066    61
+  5 lc0.net.68446      :    28.0    3.0   10778.5   20000    54      62   4666   12225   3109    61
   6 lc0.net.67646      :    27.3    3.0   10759.5   20000    54      63   4589   12341   3070    62
   7 lc0.net.68326      :    26.7    3.0   10740.5   20000    54      50   4593   12295   3112    61
   8 lc0.net.68242      :    26.7    2.9   10740.5   20000    54      50   4573   12335   3092    62
   9 lc0.net.68207      :    26.6    2.9   10740.0   20000    54      51   4615   12250   3135    61
  10 lc0.net.67831      :    26.6    3.1   10738.0   20000    54      56   4601   12274   3125    61
  11 lc0.net.68169      :    26.2    3.0   10729.0   20000    54      62   4554   12350   3096    62
  12 lc0.net.68059      :    25.6    3.0   10711.5   20000    54      61   4587   12249   3164    61
  13 lc0.net.68363      :    25.0    2.9   10694.5   20000    53      63   4626   12137   3237    61
  14 lc0.net.67925      :    24.3    2.9   10675.5   20000    53      56   4512   12327   3161    62
  15 lc0.net.67971      :    24.0    3.0   10667.0   20000    53      68   4543   12248   3209    61
  16 lc0.net.68112      :    23.0    3.0   10638.0   20000    53      54   4486   12304   3210    62
  17 lc0.net.67996      :    22.7    3.0   10631.5   20000    53     100   4539   12185   3276    61
- 18 Stockfish.dev      :     0.0   ----  157539.5  340000    46     ---  53113  208853  78034    61

White advantage = 55.50 +/- 0.37
Draw rate (equal opponents) = 64.01 % +/- 0.09

https://pixeldrain.com/u/T3bm3BQh

[Владимир001]

Stockfish 13 wins Lucas Chess Tournament 10-11.04.2021

Temp 3' + 3" GUI-LucasChess 72 games

[Владимир001]

Stockfish 060421 Ivec wins JCER Test New Engines 2021.04.09 - 2021.04.11

Temp 3' + 3"

[Владимир001]

Stash 29.0 wins JCER - Arena new amateur engines, 2021.04.07 - 2021.04.12

Temp 3' + 3" *GUI-Arena *112 games

[Владимир001]

Blitz 1.0min+0.2sec 2 core frıtz17 gui syzgyz 3-4-5 i7 3820 4ghz play 324 games

1   Cfish 240321 64 POPCNT NUMA   27.5 - 26.527.0 - 27.029.0 - 25.0   83.5/162
2   Cfish 110421 64 POPCNT NUMA   26.5 - 27.528.0 - 26.028.0 - 26.0   82.5/162  6636.75
3   Cfish 110421 64 POPCNT NUMAm  27.0 - 27.026.0 - 28.029.5 - 24.5   82.5/162  6626.75
4   Eman 6.95 64-bit SSE2         25.0 - 29.026.0 - 28.024.5 - 29.5   75.5/162

games
https://pixeldrain.com/u/67pR8TRe

[Владимир001]

Stockfish 080421 Ivec wins JCER - Test Top Engines, 2021.04.10-12

Temp 3' + 3" *GUI-Fritz 17 *240 games

[Владимир001]

Hardware: i5-8400 CPU @ 2.80GHz, 6 cores, 32GB, gpu RTX 2060, 6GB
Gauntlet: SF-dev vs. LC0 384x30b nets
Network IDs: J94-100, 67646, 67831, 67892, 67925, 67971, 67996, 68059, 68112, 68169, 68207, 68242, 68285, 68326, 68363, 68405, 68446, 68497
LC0-version: v0.27.0
LC0-options: minibatch-size=90
SF-version: SF-dev 20120516
SF-options: 4 Threads, 512MB Hash
Software: Cutechess-CLI
Time control: LC0: 1,500 nodes/move, SF-dev: 500,000 nodes/move
Book: Chad's 8-ply book with 10000 positions, order=sequential
Tablebases: 6-men
Adjudication: -draw movenumber=50 movecount=5 score=8 -resign movecount=5 score=1000
Ordo: -a 0 -A "Stockfish.dev" -W -D -U "0,1,2,3,4,5,6,7,8,9,10" -s 2000 -n 1
Comment:

 # PLAYER             :  RATING  ERROR    POINTS  PLAYED   (%)  CFS(%)      W       D      L  D(%)
-  1 lc0.net.J94-100    :    29.4    3.0   10817.5   20000    54      51   4562   12511   2927    63
   2 lc0.net.68405      :    29.4    3.0   10815.5   20000    54      64   4698   12235   3067    61
   3 lc0.net.68285      :    28.6    3.0   10793.5   20000    54      52   4644   12299   3057    61
   4 lc0.net.67892      :    28.4    2.9   10790.0   20000    54      51   4646   12288   3066    61
+  5 lc0.net.68497      :    28.4    2.9   10788.5   20000    54      57   4611   12355   3034    62
   6 lc0.net.68446      :    28.0    3.0   10778.5   20000    54      63   4666   12225   3109    61
   7 lc0.net.67646      :    27.3    2.9   10759.5   20000    54      62   4589   12341   3070    62
   8 lc0.net.68242      :    26.7    3.1   10740.5   20000    54      50   4573   12335   3092    62
   9 lc0.net.68326      :    26.7    3.0   10740.5   20000    54      50   4593   12295   3112    61
  10 lc0.net.68207      :    26.6    3.0   10740.0   20000    54      51   4615   12250   3135    61
  11 lc0.net.67831      :    26.6    3.0   10738.0   20000    54      56   4601   12274   3125    61
  12 lc0.net.68169      :    26.2    3.0   10729.0   20000    54      61   4554   12350   3096    62
  13 lc0.net.68059      :    25.6    3.0   10711.5   20000    54      61   4587   12249   3164    61
  14 lc0.net.68363      :    25.0    3.0   10694.5   20000    53      63   4626   12137   3237    61
  15 lc0.net.67925      :    24.3    3.0   10675.5   20000    53      56   4512   12327   3161    62
  16 lc0.net.67971      :    24.0    2.9   10667.0   20000    53      69   4543   12248   3209    61
  17 lc0.net.68112      :    23.0    2.9   10638.0   20000    53      54   4486   12304   3210    62
  18 lc0.net.67996      :    22.7    3.0   10631.5   20000    53     100   4539   12185   3276    61
- 19 Stockfish.dev      :     0.0   ----  166751.0  360000    46     ---  56147  221208  82645    61

White advantage = 55.44 +/- 0.36
Draw rate (equal opponents) = 64.03 % +/- 0.09

https://pixeldrain.com/u/MuiUA91j

[Владимир001]

Match: Ceres, Lc0 and Komodo vs Stockfish 13
Time control: 5m + 3s
Hardware: 10900kf @ 3.7 Ghz, RTX 3080

Развернуть для просмотра

Openings: 250 positions (depth=10) from selected Morozevich's games
TBs and adj.: Syzygy 5-men, resign movecount=5 score=500, draw movenumber=50 movecount=5 score=5
Stockfish 13 and Komodo Dragon: threads=20, hash=4096
Lc0 27.0: backend=cuda-fp16, nncache=10000000 (20000000 for PS), minibatch-size=112 (96 for PS), max-collision-events=917, max-collision-visits=1000, max-out-of-order-evals-factor=2.4, moves-left-threshold=1.0 (PS only)
Ceres v0.80 & v0.88 = defaults
MG: multi-gather=true
Kd14: Kiudee's with policy-softmax-temp=1.4
Kd (Kiudee's): cpuct=2.15, cpuct-at-root=2.15, cpuct-base=18368, cpuct-base-at-root=18368, cpuct-factor=2.82, cpuct-factor-at-root=2.82, policy-softmax-temp=1.607, fpu-value=0.443
Benchmarks (15 sec from startposition with gameplay settings): Stockfish-13 bmi2 20T = 17 400 knps, Komodo Dragon avx2 20T = 14 600 knps, Ceres v0.80 67850 = 22 600 nps, Lc0 27.0 67850 = 24 500 nps, Lc0 27.0 J94-100 = 23 400 nps, Lc0 27.0 (Kd14+MG) PS-81000g = 52 900 nps, Ceres v0.88 (Kd) LS-15 = 76 900 nps, Ceres v0.88 J104.1-30 = 206 000 nps
Comments: - I verified that on CCRL 40/40 list, "Stockfish 13 4CPU" and "Komodo Dragon 4CPU" are 53 elo apart. So the results here make sense (hopefully) as the diff is 56 elo.
- In CEGT 40/20, LS-15 is 15-20 elo behind the big nets (with different binaries though) which is similar to what I got here with Ceres (diff = 18 elo).
- I replayed 7 pairs of games from PS + Lc0 (with multi-gather) as there were 7 disconnects("connection stalls" message and a time forfeit at the beginning of the game). I used Cutechess GUI. With 10x128 nets, the number of disconnects with multi-gather gets more important (maybe once every 15 games). I verified that the problem doesn't occur in Fritz GUI (which I didn't use).

[свернуть]

# PLAYER                       : RATING  ERROR  PLAYED  (%)   CFS   W     D    L    D(%)
1 Stockfish 13 20T             :    0.0   ----   3500  54.84   73  570  2699  231  77.11
2 Lc0 27.0 67850               :   -4.3   13.6    500  49.40   83   42   410   48  82.00
3 Lc0 27.0 J94-100             :  -13.7   13.5    500  48.10   50   42   397   61  79.40
4 Ceres v0.80 67850            :  -13.7   13.8    500  48.10   97   40   401   59  80.20
5 Ceres v0.88 (Kd) LS-15       :  -31.8   13.8    500  45.60   98   35   386   79  77.20
6 Lc0 27.0 (Kd14+MG) PS-81000g :  -52.3   14.0    500  42.80   64   30   368  102  73.60
7 Komodo Dragon 20T            :  -56.0   14.1    500  42.30   96   23   377  100  75.40
8 Ceres v0.88 J104.1-30        :  -74.7   14.5    500  39.80  ---   19   360  121  72.00

White advantage = 60.43 +/- 2.77, Draw rate (equal opponents) = 86.00 % +/- 0.77

Engine                        Depth    MIDG   EARLY   ENDG    LATE
Ceres v0.80 67850              6.83    8.60 | 8.19  |  7.02 | 6.58
Ceres v0.88 (Kd) LS-15         8.69    9.80 | 8.99  |  7.48 | 7.30
Ceres v0.88 J104.1-30          8.91   10.16 | 8.68  |  7.57 | 7.24
Lc0 27.0 67850                13.07   15.79 | 15.99 | 11.25 | 8.32
Lc0 27.0 J94-100              13.28   15.66 | 15.49 | 11.77 | 9.01
Lc0 27.0 (Kd14+MG) PS-81000g  15.86   18.11 | 18.49 | 14.07 |10.87
Komodo Dragon 20T             32.19   28.96 | 30.49 | 33.47 |44.99
Stockfish-13-20T              44.37   38.96 | 39.33 | 47.33 |57.83

https://pixeldrain.com/u/MxZWgb2i

[Владимир001]

Intel i5 Quad
ChessGUI
256mb hash each
3-4-5 piece tablebases
Ponder off
GBSelect2019.cgb book
40 moves in 25 minutes repeating (adapted for the CCRL)
4 cycles 36 rounds
All engines 64-bit where available


Final Standings

22.5 - Velvet 1.2.0 64-bit
21.5 - Fridolin 3.10 64-bit
20.5 - K2 0.99
19.5 - CM10th Ogre
19.5 - Shield 2.1 64-bit
17.0 - Shallow 2020-09-09 64-bit
17.0 - Chess Tiger 2007.1
16.5 - Supernova 2.3 64-bit
14.5 - Drofa 2.2.0 64-bit
11.5 - Drosophila 1.6 64-bit


The complete tournament pgn (zipped) can be downloaded here:
http://kirill-kryukov.com/chess/disc...e.php?id=48188

[Владимир001]

CorChess 080421 wins JCER - New Engines Tournament, 2021.04.11-12

Temp 3' + 3" *GUI-Fritz 17