forked from LeelaChessZero/lczero-training
-
Notifications
You must be signed in to change notification settings - Fork 0
T60 supplemental self Elo
James Horsfall Thomas edited this page Oct 11, 2020
·
32 revisions
Using a book with no temp and noise, but otherwise similar to the client self-Elo matches. Full cutechess-cli command below.
Matches are all currently anchored by net 65280, with its Elo set at the server self-Elo value.
Completed: costly and this served the purpose of clarifying the influence of temp and noise on self-Elo accuracy.
It appears that client match self-Elo has an exaggerated drop in recent values, though possibly (barely) within error.
# PLAYER : RATING ERROR POINTS PLAYED (%) W L D D(%) CFS(%)
1 lc0.net.65380 : 2994 5 3048.0 6000 51 1003 907 4090 68 67
5 lc0.net.65350 : 2990 5 3018.5 6000 50 972 935 4093 68 69
3 lc0.net.65330 : 2991 5 3026.5 6000 50 972 919 4109 68 54
7 lc0.net.65280 : 2988 ---- 46381.5 90000 52 16284 13521 60195 67 79
4 lc0.net.65250 : 2991 5 3023.0 6000 50 980 934 4086 68 56
6 lc0.net.65240 : 2988 5 3002.5 6000 50 965 960 4075 68 55
2 lc0.net.65230 : 2992 5 3034.0 6000 51 962 894 4144 69 60
8 lc0.net.65180 : 2986 5 2982.5 6000 50 968 1003 4029 67 65
10 lc0.net.65100 : 2984 5 2969.0 6000 49 936 998 4066 68 100
9 lc0.net.65000 : 2985 5 2971.0 6000 50 950 1008 4042 67 53
12 lc0.net.64845 : 2964 5 2803.5 6000 47 797 1190 4013 67 70
11 lc0.net.64500 : 2965 5 2809.5 6000 47 849 1230 3921 65 58
14 lc0.net.64250 : 2959 5 2755.5 6000 46 791 1280 3929 65 84
16 lc0.net.64020 : 2948 5 2663.5 6000 44 784 1457 3759 63 ---
15 lc0.net.63960 : 2955 5 2724.5 6000 45 786 1337 3877 65 97
13 lc0.net.63820 : 2962 5 2787.0 6000 46 806 1232 3962 66 85
Green is standard self-Elo, blue is data from above: .
E:\cutechess-cli\cutechess-cli -engine conf=Lc0.26.1 name=lc0.net.65280 nodes=800 option.WeightsFile="C:/Lc0_nets/net65280" option.FpuValue=0.3 option.FpuStrategyAtRoot="absolute" option.FpuValueAtRoot=1.0 option.CPuct=1.3 option.CPuctAtRoot=2.5 option.PolicyTemperature=1.4 option.MovesLeftMaxEffect=0.1 option.MovesLeftThreshold=0.0 option.MovesLeftSlope=0.0004 option.MovesLeftQuadraticFactor=1.0 option.MovesLeftConstantFactor=0.0 option.SyzygyPath="D:/tb" option.Backend="cudnn-fp16" option.BackendOptions="gpu=1" -engine conf=Lc0.26.1 name=lc0.net.65330 nodes=800 option.WeightsFile="C:/Lc0_nets/net65330" option.FpuValue=0.3 option.FpuStrategyAtRoot="absolute" option.FpuValueAtRoot=1.0 option.CPuct=1.3 option.CPuctAtRoot=2.5 option.PolicyTemperature=1.4 option.MovesLeftMaxEffect=0.1 option.MovesLeftThreshold=0.0 option.MovesLeftSlope=0.0004 option.MovesLeftQuadraticFactor=1.0 option.MovesLeftConstantFactor=0.0 option.SyzygyPath="D:/tb" option.Backend="cudnn-fp16" option.BackendOptions="gpu=1" -site Hephaestus -tb "D:/tb" -openings file=book-ply12-unifen-Q-0.1-0.5.pgn order=random -repeat -draw movenumber=40 movecount=5 score=10 -resign movecount=5 score=500 twosided=true -each tc=inf -concurrency 1 -games 2 -rounds 3000 -pgnout lc0_match.1A_Hephaestus.pgn 1> lc0_match.1A_Hephaestus.log