Развернуть для просмотра

Владимир001 · 21.10.2020, 22:36

Tune of: CPuct, CPuctAtRoot, FpuValue
LC0 version: 0.26.3
SF version: 12
LC0 options: threads=1, minibatch-size=96, root-has-own-cpuct-params=false, moves-left-max-effect=0.2, moves-left-threshold=0, moves-left-slope=0.004, moves-left-quadratic-factor=0, moves-left-scaled-factor=1, move-overhead-ms=0
SF options: contempt=0, moveoverhead=0
Tuning ranges: CPuct: Real(0.5, 2.5), FpuValue: Real(-0.25, 1.0)
Tuning configuration: acq_function: vr/ei, rounds: 10
Time control (LC0): 0.07s per move
Time control (SF): 0.04s per move
Net (LC0): 703810
Net (SF): nn-eba324f53044.nnue
Book: custom-3k (1-3 ply)
Hardware: gtx970 + i5-4570
Tablebases: syzygy 5-man
Adjudication: -draw movenumber=50 movecount=5 score=10 -resign movecount=5 score=1000
Software: chess-tuning-tools
Comment: stc tune of these params. full config json is attached. @zz4032 409 iterations and median lc0 npm should be ~1100

Optimums found:

Код:

Cpuct            1.5674
CPuctAtRoot      1.5674
FpuValue         0.242

90.0% confidence intervals of the parameters:

Код:

Parameter  Lower bound  Upper bound
-----------------------------------
CPuct             1.41         2.28
FpuValue        -0.071        0.324

Развернуть для просмотра

[свернуть]

Владимир001 · 21.10.2020, 22:43

Развернуть для просмотра

Gauntlet: Lc0 26.3 cuda + J92-270 vs SF-12 and SF Classical
Time control: 300s + 3s, Ryzen 9 4900H, RTX 2060 mobile
Openings: TCEC-19 (50 pos.)
Stockfish: threads=8, hash=1024
Lc0 26.3: --nncache=1000000 --threads=2 --minibatch-size=112 --max-prefetch=50 --max-collision-events=50 --moves-left-max-effect=0.2 --moves-left-threshold=0.0 --moves-left-slope=0.004 --moves-left-constant-factor=0.0 --moves-left-scaled-factor=1.0 --moves-left-quadratic-factor=0.0
Bench startpos (15s): J92-270 (cuda-fp16) = 6.4 knps, SF-12 (avx2) = 8100 knps, SF Classical (stockfish_20073110_x64_modern) = 13 000 knps.
TBs and adj.: Syzygy 5-men, resign (two-sided) movecount=5 score=600, draw movenumber=35 movecount=5 score=5
Comments: Results looks good for J92-270. +45, =55, -0 with the white pieces!

Код:

Score of lc0-26.3-cuda-J92-270 vs Stockfish 12 8CPU: 16 - 18 - 66 [0.490]
...      lc0-26.3-cuda-J92-270 playing White: 15 - 0 - 35  [0.650] 50
...      lc0-26.3-cuda-J92-270 playing Black: 1 - 18 - 31  [0.330] 50
...      White vs Black: 33 - 1 - 66  [0.660] 100
Elo difference: -6.9 +/- 39.8, LOS: 36.6 %, DrawRatio: 66.0 %
100 of 100 games finished.

Score of lc0-26.3-cuda-J92-270 vs Stockfish Classical 8CPU: 34 - 12 - 54 [0.610]
...      lc0-26.3-cuda-J92-270 playing White: 30 - 0 - 20  [0.800] 50
...      lc0-26.3-cuda-J92-270 playing Black: 4 - 12 - 34  [0.420] 50
...      White vs Black: 42 - 4 - 54  [0.690] 100
Elo difference: 77.7 +/- 46.2, LOS: 99.9 %, DrawRatio: 54.0 %
100 of 100 games finished.

[свернуть]

Games: https://gofile.io/d/EwxnSI

SergeyMZ · 22.10.2020, 12:40

Подскажите пожалуйста, какая сейчас нейросетка предпочтительна для анализа шахматных позиций на 30-180 минут движком Лилка 26.3?
А также, какой параметр NNCache для карты Nvidia RTX 2080 с указанным выше движком и ОЗУ=32 Гб является оптимальным?

Maratka · 22.10.2020, 13:28

Я бы сказал, что лучше всего анализировать последними версиями SF'ша.

А так вообще - ну вот тесты сетей:

Цитата: Сообщение от Владимир001

Match: combined results (314 positions) of ERET test + Vesely 203 positions testset
time control: analysis with time limit of 60s per move/position
AB engine options: threads=4, hash=4096 MB
Lc0-version: v0.26.2 + v0.26.3
LC0-options: -Backend=cudnn -NNcache=3000000 -MaxCcollisionEvents=256
MLH-settings S19 SuFi: -MovesLeftMaxEffect=0.2 -MovesLeftSlope=0.004 -MovesLeftThreshold=0.0 -MovesQuadraticFactor=0.0 -MovesScaledFactor=1.0
hardware: notebook with mobile i7-7700HQ 4x2.8GHz, mobile Geforce GTX 1050 TI 4GB
software: Arena GUI, "Automatic Analysis" feature with EPD file (Vesely_testsuiteLC0.epd).
Tablebases: Syzygy 5-men on SSD
Comments: For J92 so far those results fit nicely to the results of the test gauntet against SF Dev at 5min+5s TC (280 not tested there yet).

Код:

A) CPU engines (mobile i7-7700HQ 4x2.8GHz):
Cfish 161020 NNUE 4CPU : 280/314 = 89.2% <== new, *net: nn-04cf2b4ed1da.nnue*

B) GPU engines (mobile Geforce GTX 1050 TI 4GB):
Lc0.net.JH.J92-280 (30x384) : 220/314 = 70.0% <== new
Lc0.net.JH.J92-260 (30x384) : 218/314 = 69.4% <== new
Lc0.net.JH.J92-270 (30x384) : 217/314 = 69.1% <== new
Lc0.net.JH.J92-210 (30x384) : 216/314 = 68.8%
Lc0.net.JH.J92-240 (30x384) : 215/314 = 68.5%
Lc0-0.22.0-dev.Leelenstein 14.3 : 215/314 = 68.5%
Lc0.net.JH.J92-190 (30x384) : 214/314 = 68.2% ** TCEC S19 SuFi net **
Lc0.net.65162 : 213/314 = 67.8%
Lc0.net.65411 : 205/314 = 65.3% <== new

SergeyMZ · 22.10.2020, 13:37

С сетями понял, спасибо. У меня самого стоит 190-ая. Попробую 280-ую. Только с параметром NNCache так и неясно: у Владимира карта намного слабее моей.

Maratka · 22.10.2020, 16:41

Я думаю, Вы сами быстрее проверите, чем ответ получите.
Начните с настройки по умолчанию.

Владимир001 · 22.10.2020, 21:27

Развернуть для просмотра

Match Gauntlet
LC0-version: lc0-v0.26.3 cudnn-version
LC0 options: Standard option except Threads=1, NNCacheSize=0, MinibatchSize=1.
Time control: 1 Node/move
Hardware: i7-4790 with 16 GByte RAM + GTX1650
Speed: Not important for this type of testing.
Book: Chad-opening book with 100 000 different openings with the most popular human openings.
Book options: Opening order: Sequential. Play each opening twice. Play all opening in the book both for White and Black.
Tablebases: No Tablebases.
Adjudication: Only 5-men syzygy
Software: CuteChess 1.2.0 https://github.com/cutechess/cutechess/releases / Graphic tools is programmed by glbchess64, in Python programming tools.
Comment: This is result out of Ordo 1.2.6 https://github.com/michiguel/Ordo/releases/tag/v1.2.6
Ordo string: ordo.exe -Q -N 0 -D -a 0 -A "J92-145" -W -n4 -s500 -G -V -U "0,1,2,3,4,5,6,7,8,9,10" -j stats.txt -o rating.txt -p games.pgn
Results: pgn-file: https://ufile.io/3n3m9l9h
Explanation: Trying to find the best net in clean policy Elo.

Код:

   # PLAYER     :  RATING  ERROR    POINTS  PLAYED   (%)  CFS(%)      W      D      L  D(%)
   1 J92-280    :      11      1  103100.0  200000  51.5     100  66752  72696  60552  36.3
   2 J92-145    :       0      1   96900.0  200000  48.5     ---  60552  72696  66752  36.3

White advantage = 23.98 +/- 0.57
Draw rate (equal opponents) = 36.51 % +/- 0.10

My list until now (Elo against J92-145) 1 Node/move:

Код:

White advantage = 23.98 +/- 0.57
Draw rate (equal opponents) = 36.51 % +/- 0.10
J92-280:             11     Elo    (Test with 200k games)
J92-260:             11     Elo    (Test with 200k games)
J92-240:              8     Elo    (Test with 200k games)
J92-210:              5     Elo    (Test with 200k games)
J92-220:              3     Elo    (Test with 200k games)
J92-205:              3     Elo    (Test with 200k games)
J92-230:              2     Elo    (Test with 200k games)
J92-190:              1     Elo    (Test with 200k games)
J92-145:              0     Elo    (Reference)
J92-100:             -2     Elo    (Test with 200k games)

[свернуть]

Владимир001 · 22.10.2020, 21:31

Развернуть для просмотра

Match: gauntlet of SF Dev 20092822 4CPU vs Lc0 J92-280/270/260/240/220/210/190 (S19 SuFi1 MLH) + Cfish NNUE + SF11
Lc0-version: v0.26.2 + v0.26.3 (J92-270/260)
Lc0-options : -Backend=cudnn -NNCacheSize=2000000 -MaxOutOfOrderEvalsFactor=2.4 -MaxCollisionEvents=256 -TwoFoldDraws=true
MLH-settings S19 SuFi: -MovesLeftMaxEffect=0.2 -MovesLeftSlope=0.004 -MovesLeftThreshold=0.0 -MovesQuadraticFactor=0.0 -MovesScaledFactor=1.0
SF-version: Stockfish 20092822 x64 bmi2 (date: 28.09.2020)
SF/Cfish-options: threads=4 hash=2048 MB, contempt=24, NNUE=true, net=nn-baeb9ef2d183.nnue (default)
Time control: 5min + 5s
Hardware: notebook with mobile i7-7700HQ 4x2.8GHz (8 threads with HT on), mobile Geforce GTX 1050 TI 4GB
Book: Balsa_Special.pgn, 10 plies, sequentially, colors reversed
Tablebases: Syzygy 5-men on SSD
Speed: J92: 961 nps, SF Dev NNUE 4CPU: 3680k nps, Cfish NNUE 4CPU: 4198k nps
Adjudication: Draw at 50 moves rule, 3-fold repetition, after 200 moves, at 50 moves with eval = 0.00 ; 5-men Gaviota tablebase adjudication
Software: Arena 3.5.1, ponder = off
Elo rating: Ordo 1.2.6
Comments: J92-280 added. The table includes the ERET test results (60s time limit).

Код:

  # PLAYER                  :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W    D    L  D(%)  ERET test
   1 Cfish-NNUE 071020_4CPU  :     7.1   21.5    51.0     100  51.0      74    2   98    0  98.0  96/111
   2 Stockfish_20092822_4CPU :     0.0   ----   520.0     900  57.8     100  151  738   11  82.0  95/111
   3 Lc0.net.JH.J92-280      :   -46.1   25.1    43.5     100  43.5      58    3   81   16  81.0  80/111    <= NEW
   4 Lc0.net.JH.J92-260      :   -49.7   25.6    43.0     100  43.0      58    1   84   15  84.0  81/111
   5 Lc0.net.JH.J92-210      :   -53.3   26.3    42.5     100  42.5      50    1   83   16  83.0  81/111
   6 Lc0.net.JH.J92-270      :   -53.3   25.7    42.5     100  42.5      77    1   83   16  83.0  81/111
   7 Lc0.net.JH.J92-220      :   -67.9   28.7    40.5     100  40.5      57    2   77   21  77.0  79/111
   8 Lc0.net.JH.J92-190      :   -71.5   29.4    40.0     100  40.0      57    1   78   21  78.0  79/111
   9 Lc0.net.JH.J92-240      :   -75.2   29.1    39.5     100  39.5      75    0   79   21  79.0  80/111
  10 Stockfish_11_4CPU       :   -90.1   32.4    37.5     100  37.5     ---    0   75   25  75.0  91/111

https://dropmefiles.com/aUSZe

[свернуть]

Владимир001 · 22.10.2020, 21:34

Владимир001 · Вчера, 00:47

Владимир001 · Вчера, 01:00

Championship Chess Match after 60/100 games

Код:

   # PLAYER               :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W    D    L  D(%)
   1 Lc0-Sufi             :       3     10    30.5      60  50.8      72    2   57    1  95.0
   2 stockfish-Sufi 19    :      -3     10    29.5      60  49.2     ---    1   57    2  95.0

White advantage = 0.00 +/- 0.00
Draw rate (equal opponents) = 95.27 % +/- 3.34


Medians
Name                     Games    Depth       NPS           Nodes
-------------------------------------------------------------------------------------
stockfish-Sufi 19    :      60     54        34829194   3006149734
Lc0-Sufi             :      60     17           31537      7364415

Владимир001 · Вчера, 01:05

Подача заявки на ICLR 2021 | «Лямбда-сети» обеспечивают точность SOTA, экономят большую память

https://syncedreview.com/2020/10/21/...ve-memory/amp/

Владимир001 · Вчера, 16:49

Владимир001 · Вчера, 20:03

Цитата: Сообщение от Владимир001

https://www.twitch.tv/VendableBee420

Владимир001 · Сегодня, 09:12

Цитата: Сообщение от Владимир001

Championship Chess Match after 60/100 games

Код:

   # PLAYER               :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W    D    L  D(%)
   1 Lc0-Sufi             :       3     10    30.5      60  50.8      72    2   57    1  95.0
   2 stockfish-Sufi 19    :      -3     10    29.5      60  49.2     ---    1   57    2  95.0

White advantage = 0.00 +/- 0.00
Draw rate (equal opponents) = 95.27 % +/- 3.34


Medians
Name                     Games    Depth       NPS           Nodes
-------------------------------------------------------------------------------------
stockfish-Sufi 19    :      60     54        34829194   3006149734
Lc0-Sufi             :      60     17           31537      7364415

Championship Chess Match 74/100 games

Код:

   # PLAYER               :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W    D    L  D(%)
   1 Lc0-Sufi             :       2      8    37.5      74  50.7      72    2   71    1  95.9
   2 stockfish-Sufi 19    :      -2      8    36.5      74  49.3     ---    1   71    2  95.9

White advantage = 0.00 +/- 0.00
Draw rate (equal opponents) = 96.17 % +/- 2.73

Medians
Name                     Games    Depth       NPS           Nodes
-------------------------------------------------------------------------------------
stockfish-Sufi 19    :      74     55        34623844   3018981086
Lc0-Sufi             :      74     17           31396      7528856

Владимир001 · Сегодня, 09:21

Развернуть для просмотра

Match: ERET test (Eigenmann Rapid Engine Test) with 111 test positions
time control: analysis with time limit of 60s per move/position
LC0-version: v0.21.2 up to v0.26.3
LC0-options: -Backend=cudnn -NNcache=3000000 -MaxCcollisionEvents=256
MLH-settings S19 SuFi: -MovesLeftMaxEffect=0.2 -MovesLeftSlope=0.004 -MovesLeftThreshold=0.0 -MovesQuadraticFactor=0.0 -MovesScaledFactor=1.0
AB engine options: threads=4, hash=4096 MB
hardware: mobile Geforce GTX 1050 TI 4GB, mobile i7-7700HQ 4x2.8GHz (8 threads with HT)
software: Arena GUI, "Automatic Analysis" feature with EPD file.
Tablebases: Syzygy 5-men on SSD
Results (solutions, percent):

Код:

A) CPU engines (mobile i7-7700HQ 4x2.8GHz):
Cfish 221020 NNUE 4CPU          :  97 = 87.4%   <== new, *net: nn-eba324f53044.nnue*
CorChess NNUE 1.3_201021 4CPU   :  97 = 87.4%   <== new, *net: nn-eba324f53044.nnue*
Stockfish 20102220 NNUE 4CPU    :  95 = 85.6%   <== new, *net: nn-eba324f53044.nnue*
Stockfish 20092822 NNUE 4CPU    :  95 = 85.6%   ** TCEC S19 Champion ** (net: nn-baeb9ef2d183.nnue)
Stockfish 12 4CPU (NNUE)        :  94 = 84.7%   *net: nn-82215d0fd0df.nnue*
BrainFish_200724_4CPU           :  92 = 82.9%   *last version before NNUE support is added*
Stockfish 20073110 4CPU         :  92 = 82.9%   *last version before NNUE support was added*
Stockfish 11 4CPU               :  91 = 82.9%
Stockfish 10 4CPU               :  90 = 81.1%
Komodo-13.2.5_4CPU              :  88 = 79.3%
Komodo 11.01 4CPU (freeware)    :  84 = 75.7%
Nemorino 6.00 NNUE 4CPU         :  77 = 69.4%   *net: nemorino_net_6.nnue*
SlowChess Classic 2.2 4CPU      :  77 = 69.4%
Xiphos 0.6 4CPU                 :  76 = 68.4%
Ethereal 12.75 pext-avx2 4CPU   :  73 = 65.8%
Igel 2.8.0 NNUE 4CPU            :  72 = 64.9%   *default net (night nurse v0.2.5b)*
Laser 1.7 4CPU                  :  72 = 64.9%
Komodo-MCTS-13.2.5_4CPU         :  62 = 55.9%
Lc0.net.703350-blas_4CPU        :  60 = 54.1%
Lc0.net.591003-blas_kiudee_4CPU :  60 = 54.1%
Fire 7.1 4CPU                   :  60 = 54.1%
Lc0.net.11258-112x9se_blas_4CPU :  59 = 53.2%
Lc0.net.DK.Bad_Gyal_7_blas_4CPU :  57 = 51.4%
Lc0.net.LD2_blas_4CPU  (10x128) :  56 = 50.4%

Код:

B) GPU engines (mobile Geforce GTX 1050 TI 4GB):
Lc0.net.65162  (24x320)         :  83 = 74.8%   *current record for T60 nets*
Lc0-0.22.0-dev.Leelenstein 14.3 :  83 = 74.8%
Lc0.net.JH.J92-270  (30x384)    :  81 = 73.0%   *record for 384x30 nets*
Lc0.net.JH.J92-260  (30x384)    :  81 = 73.0%   *record for 384x30 nets*
Lc0.net.JH.J92-210  (30x384)    :  81 = 73.0%   *record for 384x30 nets*
Lc0.net.JH.J92-280  (30x384)    :  80 = 72.1%
Lc0.net.JH.J92-240  (30x384)    :  80 = 72.1%
Lc0.net.65500 (24x320)          :  80 = 72.1%   <== new
Lc0.net.JH.J92-250  (30x384)    :  79 = 71.2%
Lc0.net.JH.J92-230  (30x384)    :  79 = 71.2%
Lc0.net.JH.J92-220  (30x384)    :  79 = 71.2%
Lc0.net.JH.J92-205  (30x384)    :  79 = 71.2%
Lc0.net.JH.J92-190  (30x384)    :  79 = 71.2%   ** TCEC S19 SuFi net **
Lc0.net.JH.J92-180  (30x384)    :  78 = 70.3%
Lc0.net.64460                   :  77 = 69.4%
Allie-v0.7.Leelenstein 14.3     :  77 = 69.4%
Lc0.net.JH.J92-290  (30x384)    :  76 = 68.4%   <== new
Lc0.net.65411                   :  76 = 68.4%
Lc0.net.65297                   :  76 = 68.4%
Lc0.net.42810                   :  76 = 68.4%
Lc0.net.JH.J92-100  (30x384)    :  75 = 67.6%   ** TCEC S19 DivP net **
Lc0.net.SV.384x30-T60-4619      :  75 = 67.6%
Lc0.net.SV.384x30-T60-4229      :  75 = 67.6%   ** TCEC Cup 6 net **
Lc0.net.JH.T40B.4-160           :  75 = 67.6%   ** S16 DivP net **
Lc0.net.JH.T40B.4-260           :  75 = 67.6%
Lc0.net.703810  (10x128)        :  75 = 67.6%
Lc0.net.JH.J13B.2-136  (24x320) :  74 = 66.7%   *Terminator 2 net*
Lc0.net.SV.256x20-T40-1541      :  74 = 66.7%
Lc0.net.591003_kiudee  (10x128) :  74 = 66.7%
Lc0.net.42850                   :  73 = 65.8%
Lc0.net.11248                   :  69 = 62.2%
Lc0.net.LD2          (10x128)   :  67 = 60.4%
Lc0.net.32930                   :  66 = 59.4%
Lc0.net.DK.Bad_Gyal_9  (10x128) :  65 = 58.6%

[свернуть]

Comment: EPD file:
https://glarean-magazin.ch/wp-conten...gine-Chess.zip

Владимир001 · Сегодня, 09:24

jhorthos:

Развернуть для просмотра

Match: T73 vs T70 best network
Lc0-version: 26.1
Lc0 options: FpuStrategy="reduction" FpuValue=0.23 FpuStrategyAtRoot="absolute" FpuValueAtRoot=1.0 CPuct=1.3 CPuctAtRoot=1.9 PolicyTemperature=1.4 MovesLeftMaxEffect=0.2 MovesLeftThreshold=0.0 MovesLeftSlope=0.0007 MovesLeftQuadraticFactor=0.85 MovesLeftScaledFactor=0.15 MovesLeftConstantFactor=0.0 MoveOverheadMs=0
Time/Node control: 2+0.04s
Hardware: RTX 2080, AMD 2950X
Book: book-ply12-unifen-Q-0.0-0.4.pgn, random with reverse.
Tablebases: 6-man Syzygy
Adjudication: 6-man Syzygy and -draw movenumber=50 movecount=6 score=10 -resign movecount=5 score=500 twosided=true
Chess Interface: cutechess-cli, time forfeit disabled
Comments: Ongoing test to see if the added blocks in T73 (128x14b) improve or degrade performance relative to T70 (128x10b). [Not properly comparable, but FYI T70 gained 127 self-Elo after the current T73 LR (0.004).]
Results:

Код:

# PLAYER : RATING ERROR POINTS PLAYED (%) W L D D(%) CFS(%)
1 lc0.net.703810 : 0.0 ---- 11033.0 18000 61 5384 1318 11298 63 100
2 lc0.net.730218.tc2 : -58.5 8.6 836.5 2000 42 174 501 1325 66 61
3 lc0.net.730248.tc2 : -60.3 8.9 831.5 2000 42 168 505 1327 66 98 << latest
4 lc0.net.730196.tc2 : -74.3 9.2 793.5 2000 40 160 573 1267 63 82
5 lc0.net.730173.tc2 : -80.4 9.4 777.0 2000 39 161 607 1232 62 51
6 lc0.net.730153.tc2 : -80.6 9.0 776.5 2000 39 155 602 1243 62 98
7 lc0.net.730131.tc2 : -91.9 6.5 1492.5 4000 37 258 1273 2469 62 61
8 lc0.net.730112.tc2 : -93.5 9.6 742.0 2000 37 113 629 1258 63 91
9 lc0.net.730096.tc2 : -102.9 9.4 717.5 2000 36 129 694 1177 59 ---

(games too big to attach)

[свернуть]

Alvir · Сегодня, 10:14

Встречаем следующую сеть J92 384x30b от jhorthos, J92-290 :
https://storage.lczero.org/files/net...ontrib/J92-290

Владимир001 · Сегодня, 15:18

Match: PR963 (betamcts) vs baseline
LC0 version (both): deeabd7
LC0 options (both): threads=1, minibatch-size=192, cpuct=1.32, cpuct-at-root=1.9, cpuct-factor=2.815, cpuct-factor-at-root=2.815, fpu-value=0.23, fpu-strategy-at-root=absolute, policy-softmax-temp=1.4
LC0 options (betamcts): betamcts-level=2, betamcts-trust=4.2, betamcts-prior=0, lcb-percentile=0.2, betamcts-update-interval=10, april-factor=0, april-factor-parent=0
LC0 options (baseline): betamcts-level=0, betamcts-trust=0, betamcts-prior=0, lcb-percentile=0, betamcts-update-interval=10, april-factor=0, april-factor-parent=0
MLH options (both): moves-left-max-effect=0.2, moves-left-threshold=0, moves-left-slope=0.007, moves-left-scaled-factor=0.15, moves-left-quadratic-factor=0.85
Time control: 800 nodes/move
Net: 703810
Book: custom-3k (1-3 ply)
Hardware: gtx970 + i5-4570
Tablebases: syzygy 5-man
Adjudication: -draw movenumber=50 movecount=5 score=10 -resign movecount=5 score=700 twosided=true
Software: cutechess-cli
Comment: best result so far at fixed npm similar to training environment @Naphthalin

Код:

# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%)
1 lc0-703810-betamcts : 26.9 9.6 969.0 1800 54 100 386 1166 248 65
2 lc0-703810 : 0.0 ---- 831.0 1800 46 --- 248 1166 386 65

White advantage = -2.35 +/- 5.01
Draw rate (equal opponents) = 65.33 % +/- 1.09

https://pixeldrain.com/u/mNv2iULm

Владимир001 · Сегодня, 15:21

Цитата: Сообщение от Alvir

Встречаем следующую сеть J92 384x30b от jhorthos, J92-290 :
https://storage.lczero.org/files/net...ontrib/J92-290

https://youtu.be/cqPSHH-YWMk

21.10.2020, 22:43	#7172
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero Развернуть для просмотра Gauntlet: Lc0 26.3 cuda + J92-270 vs SF-12 and SF Classical Time control: 300s + 3s, Ryzen 9 4900H, RTX 2060 mobile Openings: TCEC-19 (50 pos.) Stockfish: threads=8, hash=1024 Lc0 26.3: --nncache=1000000 --threads=2 --minibatch-size=112 --max-prefetch=50 --max-collision-events=50 --moves-left-max-effect=0.2 --moves-left-threshold=0.0 --moves-left-slope=0.004 --moves-left-constant-factor=0.0 --moves-left-scaled-factor=1.0 --moves-left-quadratic-factor=0.0 Bench startpos (15s): J92-270 (cuda-fp16) = 6.4 knps, SF-12 (avx2) = 8100 knps, SF Classical (stockfish_20073110_x64_modern) = 13 000 knps. TBs and adj.: Syzygy 5-men, resign (two-sided) movecount=5 score=600, draw movenumber=35 movecount=5 score=5 Comments: Results looks good for J92-270. +45, =55, -0 with the white pieces! Код: Score of lc0-26.3-cuda-J92-270 vs Stockfish 12 8CPU: 16 - 18 - 66 [0.490] ... lc0-26.3-cuda-J92-270 playing White: 15 - 0 - 35 [0.650] 50 ... lc0-26.3-cuda-J92-270 playing Black: 1 - 18 - 31 [0.330] 50 ... White vs Black: 33 - 1 - 66 [0.660] 100 Elo difference: -6.9 +/- 39.8, LOS: 36.6 %, DrawRatio: 66.0 % 100 of 100 games finished. Score of lc0-26.3-cuda-J92-270 vs Stockfish Classical 8CPU: 34 - 12 - 54 [0.610] ... lc0-26.3-cuda-J92-270 playing White: 30 - 0 - 20 [0.800] 50 ... lc0-26.3-cuda-J92-270 playing Black: 4 - 12 - 34 [0.420] 50 ... White vs Black: 42 - 4 - 54 [0.690] 100 Elo difference: 77.7 +/- 46.2, LOS: 99.9 %, DrawRatio: 54.0 % 100 of 100 games finished. [свернуть] Games: https://gofile.io/d/EwxnSI

22.10.2020, 12:40	#7173
SergeyMZ Гроссмейстер Регистрация: 28.05.2016 Сообщений: 2,462 Сказал(а) спасибо: 9,358 Поблагодарили 4,690 раз(а) в 1,884 сообщениях Репутация: Награды пользователя: Всего наград: 1	Re: LCZero Подскажите пожалуйста, какая сейчас нейросетка предпочтительна для анализа шахматных позиций на 30-180 минут движком Лилка 26.3? А также, какой параметр NNCache для карты Nvidia RTX 2080 с указанным выше движком и ОЗУ=32 Гб является оптимальным?

22.10.2020, 13:28	#7174
Maratka Эксперт Регистрация: 11.04.2017 Адрес: РФ, Крым, Севастополь. Сообщений: 9,968 Сказал(а) спасибо: 2,687 Поблагодарили 5,148 раз(а) в 3,702 сообщениях Репутация: 169	Re: LCZero Я бы сказал, что лучше всего анализировать последними версиями SF'ша. А так вообще - ну вот тесты сетей: Цитата: Сообщение от Владимир001 Match: combined results (314 positions) of ERET test + Vesely 203 positions testset time control: analysis with time limit of 60s per move/position AB engine options: threads=4, hash=4096 MB Lc0-version: v0.26.2 + v0.26.3 LC0-options: -Backend=cudnn -NNcache=3000000 -MaxCcollisionEvents=256 MLH-settings S19 SuFi: -MovesLeftMaxEffect=0.2 -MovesLeftSlope=0.004 -MovesLeftThreshold=0.0 -MovesQuadraticFactor=0.0 -MovesScaledFactor=1.0 hardware: notebook with mobile i7-7700HQ 4x2.8GHz, mobile Geforce GTX 1050 TI 4GB software: Arena GUI, "Automatic Analysis" feature with EPD file (Vesely_testsuiteLC0.epd). Tablebases: Syzygy 5-men on SSD Comments: For J92 so far those results fit nicely to the results of the test gauntet against SF Dev at 5min+5s TC (280 not tested there yet). Код: A) CPU engines (mobile i7-7700HQ 4x2.8GHz): Cfish 161020 NNUE 4CPU : 280/314 = 89.2% <== new, net: nn-04cf2b4ed1da.nnue B) GPU engines (mobile Geforce GTX 1050 TI 4GB): Lc0.net.JH.J92-280 (30x384) : 220/314 = 70.0% <== new Lc0.net.JH.J92-260 (30x384) : 218/314 = 69.4% <== new Lc0.net.JH.J92-270 (30x384) : 217/314 = 69.1% <== new Lc0.net.JH.J92-210 (30x384) : 216/314 = 68.8% Lc0.net.JH.J92-240 (30x384) : 215/314 = 68.5% Lc0-0.22.0-dev.Leelenstein 14.3 : 215/314 = 68.5% Lc0.net.JH.J92-190 (30x384) : 214/314 = 68.2% TCEC S19 SuFi net Lc0.net.65162 : 213/314 = 67.8% Lc0.net.65411 : 205/314 = 65.3% <== new

22.10.2020, 13:37	#7175
SergeyMZ Гроссмейстер Регистрация: 28.05.2016 Сообщений: 2,462 Сказал(а) спасибо: 9,358 Поблагодарили 4,690 раз(а) в 1,884 сообщениях Репутация: Награды пользователя: Всего наград: 1	Re: LCZero С сетями понял, спасибо. У меня самого стоит 190-ая. Попробую 280-ую. Только с параметром NNCache так и неясно: у Владимира карта намного слабее моей.

22.10.2020, 16:41	#7176
Maratka Эксперт Регистрация: 11.04.2017 Адрес: РФ, Крым, Севастополь. Сообщений: 9,968 Сказал(а) спасибо: 2,687 Поблагодарили 5,148 раз(а) в 3,702 сообщениях Репутация: 169	Re: LCZero Я думаю, Вы сами быстрее проверите, чем ответ получите. Начните с настройки по умолчанию.

22.10.2020, 21:27	#7177
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero Развернуть для просмотра Match Gauntlet LC0-version: lc0-v0.26.3 cudnn-version LC0 options: Standard option except Threads=1, NNCacheSize=0, MinibatchSize=1. Time control: 1 Node/move Hardware: i7-4790 with 16 GByte RAM + GTX1650 Speed: Not important for this type of testing. Book: Chad-opening book with 100 000 different openings with the most popular human openings. Book options: Opening order: Sequential. Play each opening twice. Play all opening in the book both for White and Black. Tablebases: No Tablebases. Adjudication: Only 5-men syzygy Software: CuteChess 1.2.0 https://github.com/cutechess/cutechess/releases / Graphic tools is programmed by glbchess64, in Python programming tools. Comment: This is result out of Ordo 1.2.6 https://github.com/michiguel/Ordo/releases/tag/v1.2.6 Ordo string: ordo.exe -Q -N 0 -D -a 0 -A "J92-145" -W -n4 -s500 -G -V -U "0,1,2,3,4,5,6,7,8,9,10" -j stats.txt -o rating.txt -p games.pgn Results: pgn-file: https://ufile.io/3n3m9l9h Explanation: Trying to find the best net in clean policy Elo. Код: # PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%) 1 J92-280 : 11 1 103100.0 200000 51.5 100 66752 72696 60552 36.3 2 J92-145 : 0 1 96900.0 200000 48.5 --- 60552 72696 66752 36.3 White advantage = 23.98 +/- 0.57 Draw rate (equal opponents) = 36.51 % +/- 0.10 My list until now (Elo against J92-145) 1 Node/move: Код: White advantage = 23.98 +/- 0.57 Draw rate (equal opponents) = 36.51 % +/- 0.10 J92-280: 11 Elo (Test with 200k games) J92-260: 11 Elo (Test with 200k games) J92-240: 8 Elo (Test with 200k games) J92-210: 5 Elo (Test with 200k games) J92-220: 3 Elo (Test with 200k games) J92-205: 3 Elo (Test with 200k games) J92-230: 2 Elo (Test with 200k games) J92-190: 1 Elo (Test with 200k games) J92-145: 0 Elo (Reference) J92-100: -2 Elo (Test with 200k games) [свернуть]

22.10.2020, 21:31	#7178
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero Развернуть для просмотра Match: gauntlet of SF Dev 20092822 4CPU vs Lc0 J92-280/270/260/240/220/210/190 (S19 SuFi1 MLH) + Cfish NNUE + SF11 Lc0-version: v0.26.2 + v0.26.3 (J92-270/260) Lc0-options : -Backend=cudnn -NNCacheSize=2000000 -MaxOutOfOrderEvalsFactor=2.4 -MaxCollisionEvents=256 -TwoFoldDraws=true MLH-settings S19 SuFi: -MovesLeftMaxEffect=0.2 -MovesLeftSlope=0.004 -MovesLeftThreshold=0.0 -MovesQuadraticFactor=0.0 -MovesScaledFactor=1.0 SF-version: Stockfish 20092822 x64 bmi2 (date: 28.09.2020) SF/Cfish-options: threads=4 hash=2048 MB, contempt=24, NNUE=true, net=nn-baeb9ef2d183.nnue (default) Time control: 5min + 5s Hardware: notebook with mobile i7-7700HQ 4x2.8GHz (8 threads with HT on), mobile Geforce GTX 1050 TI 4GB Book: Balsa_Special.pgn, 10 plies, sequentially, colors reversed Tablebases: Syzygy 5-men on SSD Speed: J92: 961 nps, SF Dev NNUE 4CPU: 3680k nps, Cfish NNUE 4CPU: 4198k nps Adjudication: Draw at 50 moves rule, 3-fold repetition, after 200 moves, at 50 moves with eval = 0.00 ; 5-men Gaviota tablebase adjudication Software: Arena 3.5.1, ponder = off Elo rating: Ordo 1.2.6 Comments: J92-280 added. The table includes the ERET test results (60s time limit). Код: # PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%) ERET test 1 Cfish-NNUE 071020_4CPU : 7.1 21.5 51.0 100 51.0 74 2 98 0 98.0 96/111 2 Stockfish_20092822_4CPU : 0.0 ---- 520.0 900 57.8 100 151 738 11 82.0 95/111 3 Lc0.net.JH.J92-280 : -46.1 25.1 43.5 100 43.5 58 3 81 16 81.0 80/111 <= NEW 4 Lc0.net.JH.J92-260 : -49.7 25.6 43.0 100 43.0 58 1 84 15 84.0 81/111 5 Lc0.net.JH.J92-210 : -53.3 26.3 42.5 100 42.5 50 1 83 16 83.0 81/111 6 Lc0.net.JH.J92-270 : -53.3 25.7 42.5 100 42.5 77 1 83 16 83.0 81/111 7 Lc0.net.JH.J92-220 : -67.9 28.7 40.5 100 40.5 57 2 77 21 77.0 79/111 8 Lc0.net.JH.J92-190 : -71.5 29.4 40.0 100 40.0 57 1 78 21 78.0 79/111 9 Lc0.net.JH.J92-240 : -75.2 29.1 39.5 100 39.5 75 0 79 21 79.0 80/111 10 Stockfish_11_4CPU : -90.1 32.4 37.5 100 37.5 --- 0 75 25 75.0 91/111 https://dropmefiles.com/aUSZe [свернуть]

22.10.2020, 21:34	#7179
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero

Вчера, 00:47	#7180
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero

Вчера, 01:05	#7182
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero Подача заявки на ICLR 2021 \| «Лямбда-сети» обеспечивают точность SOTA, экономят большую память https://syncedreview.com/2020/10/21/...ve-memory/amp/

Вчера, 16:49	#7183
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero

Вчера, 20:03	#7184
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero Цитата: Сообщение от Владимир001 https://www.twitch.tv/VendableBee420

Сегодня, 09:24	#7187
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero jhorthos: Развернуть для просмотра Match: T73 vs T70 best network Lc0-version: 26.1 Lc0 options: FpuStrategy="reduction" FpuValue=0.23 FpuStrategyAtRoot="absolute" FpuValueAtRoot=1.0 CPuct=1.3 CPuctAtRoot=1.9 PolicyTemperature=1.4 MovesLeftMaxEffect=0.2 MovesLeftThreshold=0.0 MovesLeftSlope=0.0007 MovesLeftQuadraticFactor=0.85 MovesLeftScaledFactor=0.15 MovesLeftConstantFactor=0.0 MoveOverheadMs=0 Time/Node control: 2+0.04s Hardware: RTX 2080, AMD 2950X Book: book-ply12-unifen-Q-0.0-0.4.pgn, random with reverse. Tablebases: 6-man Syzygy Adjudication: 6-man Syzygy and -draw movenumber=50 movecount=6 score=10 -resign movecount=5 score=500 twosided=true Chess Interface: cutechess-cli, time forfeit disabled Comments: Ongoing test to see if the added blocks in T73 (128x14b) improve or degrade performance relative to T70 (128x10b). [Not properly comparable, but FYI T70 gained 127 self-Elo after the current T73 LR (0.004).] Results: Код: # PLAYER : RATING ERROR POINTS PLAYED (%) W L D D(%) CFS(%) 1 lc0.net.703810 : 0.0 ---- 11033.0 18000 61 5384 1318 11298 63 100 2 lc0.net.730218.tc2 : -58.5 8.6 836.5 2000 42 174 501 1325 66 61 3 lc0.net.730248.tc2 : -60.3 8.9 831.5 2000 42 168 505 1327 66 98 << latest 4 lc0.net.730196.tc2 : -74.3 9.2 793.5 2000 40 160 573 1267 63 82 5 lc0.net.730173.tc2 : -80.4 9.4 777.0 2000 39 161 607 1232 62 51 6 lc0.net.730153.tc2 : -80.6 9.0 776.5 2000 39 155 602 1243 62 98 7 lc0.net.730131.tc2 : -91.9 6.5 1492.5 4000 37 258 1273 2469 62 61 8 lc0.net.730112.tc2 : -93.5 9.6 742.0 2000 37 113 629 1258 63 91 9 lc0.net.730096.tc2 : -102.9 9.4 717.5 2000 36 129 694 1177 59 --- (games too big to attach) [свернуть]

Сегодня, 10:14	#7188
Alvir 3 разряд Регистрация: 09.04.2019 Сообщений: 135 Сказал(а) спасибо: 638 Поблагодарили 140 раз(а) в 70 сообщениях Репутация: 34	Re: LCZero Встречаем следующую сеть J92 384x30b от jhorthos, J92-290 : https://storage.lczero.org/files/net...ontrib/J92-290

Сегодня, 15:18	#7189
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero Match: PR963 (betamcts) vs baseline LC0 version (both): deeabd7 LC0 options (both): threads=1, minibatch-size=192, cpuct=1.32, cpuct-at-root=1.9, cpuct-factor=2.815, cpuct-factor-at-root=2.815, fpu-value=0.23, fpu-strategy-at-root=absolute, policy-softmax-temp=1.4 LC0 options (betamcts): betamcts-level=2, betamcts-trust=4.2, betamcts-prior=0, lcb-percentile=0.2, betamcts-update-interval=10, april-factor=0, april-factor-parent=0 LC0 options (baseline): betamcts-level=0, betamcts-trust=0, betamcts-prior=0, lcb-percentile=0, betamcts-update-interval=10, april-factor=0, april-factor-parent=0 MLH options (both): moves-left-max-effect=0.2, moves-left-threshold=0, moves-left-slope=0.007, moves-left-scaled-factor=0.15, moves-left-quadratic-factor=0.85 Time control: 800 nodes/move Net: 703810 Book: custom-3k (1-3 ply) Hardware: gtx970 + i5-4570 Tablebases: syzygy 5-man Adjudication: -draw movenumber=50 movecount=5 score=10 -resign movecount=5 score=700 twosided=true Software: cutechess-cli Comment: best result so far at fixed npm similar to training environment @Naphthalin Код: # PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%) 1 lc0-703810-betamcts : 26.9 9.6 969.0 1800 54 100 386 1166 248 65 2 lc0-703810 : 0.0 ---- 831.0 1800 46 --- 248 1166 386 65 White advantage = -2.35 +/- 5.01 Draw rate (equal opponents) = 65.33 % +/- 1.09 https://pixeldrain.com/u/mNv2iULm

Сегодня, 15:21	#7190
Владимир001 Гроссмейстер Регистрация: 19.12.2019 Сообщений: 2,370 Сказал(а) спасибо: 2,961 Поблагодарили 2,411 раз(а) в 1,175 сообщениях Репутация: 102	Re: LCZero Цитата: Сообщение от Alvir Встречаем следующую сеть J92 384x30b от jhorthos, J92-290 : https://storage.lczero.org/files/net...ontrib/J92-290 https://youtu.be/cqPSHH-YWMk

Здесь присутствуют: 7 (пользователей: 0 , гостей: 7)

Опции темы
Версия для печати Отправить по электронной почте
Опции просмотра
Линейный вид Комбинированный вид Древовидный вид