Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🔍 Improve TT replacement scheme: add required conditions for always replace #526

Merged
merged 16 commits into from
Dec 8, 2023

Conversation

eduherminio
Copy link
Member

@eduherminio eduherminio commented Dec 7, 2023

Exact || higher depth || different key 👍🏽

Score of Lynx-tt-replacement-scheme-2066-win-x64 vs Lynx 2063 - main: 3210 - 3014 - 4051  [0.510] 10275
...      Lynx-tt-replacement-scheme-2066-win-x64 playing White: 2170 - 936 - 2032  [0.620] 5138
...      Lynx-tt-replacement-scheme-2066-win-x64 playing Black: 1040 - 2078 - 2019  [0.399] 5137
...      White vs Black: 4248 - 1976 - 4051  [0.611] 10275
Elo difference: 6.6 +/- 5.2, LOS: 99.4 %, DrawRatio: 39.4 %
SPRT: llr 2.9 (100.4%), lbound -2.25, ubound 2.89 - H1 was accepted

Reduce TT entry size by only storing the 32 most significative bits of the key 👍🏽 [-5, 0]

Score of Lynx-tt-replacement-scheme-2070-win-x64-ageing vs Lynx-tt-replacement-scheme-2066-win-x64: 2276 - 2203 - 2755  [0.505] 7234
...      Lynx-tt-replacement-scheme-2070-win-x64-ageing playing White: 1490 - 738 - 1389  [0.604] 3617
...      Lynx-tt-replacement-scheme-2070-win-x64-ageing playing Black: 786 - 1465 - 1366  [0.406] 3617
...      White vs Black: 2955 - 1524 - 2755  [0.599] 7234
Elo difference: 3.5 +/- 6.3, LOS: 86.2 %, DrawRatio: 38.1 %
SPRT: llr 2.91 (100.6%), lbound -2.25, ubound 2.89 - H1 was accepted

Ageing impl, including the previous change (04ae2a1) 👎🏽

Score of Lynx-tt-replacement-scheme-2069-win-x64-ageing vs Lynx-tt-replacement-scheme-2066-win-x64: 899 - 973 - 1182  [0.488] 3054
...      Lynx-tt-replacement-scheme-2069-win-x64-ageing playing White: 600 - 328 - 599  [0.589] 1527
...      Lynx-tt-replacement-scheme-2069-win-x64-ageing playing Black: 299 - 645 - 583  [0.387] 1527
...      White vs Black: 1245 - 627 - 1182  [0.601] 3054
Elo difference: -8.4 +/- 9.6, LOS: 4.4 %, DrawRatio: 38.7 %
SPRT: llr -2.25 (-78.0%), lbound -2.25, ubound 2.89 - H0 was accepted

Ageing without shrinking the key 👎🏽

Score of Lynx-tt-replacement-scheme-2071-win-x64 vs Lynx-tt-replacement-scheme-2066-win-x64: 2621 - 2625 - 3414  [0.500] 8660
...      Lynx-tt-replacement-scheme-2071-win-x64 playing White: 1772 - 857 - 1701  [0.606] 4330
...      Lynx-tt-replacement-scheme-2071-win-x64 playing Black: 849 - 1768 - 1713  [0.394] 4330
...      White vs Black: 3540 - 1706 - 3414  [0.606] 8660
Elo difference: -0.2 +/- 5.7, LOS: 47.8 %, DrawRatio: 39.4 %
SPRT: llr -1.58 (-54.5%), lbound -2.25, ubound 2.89

Progress check 👍🏽

Score of Lynx-tt-replacement-scheme-2073-win-x64 vs Lynx 2063 - main: 258 - 235 - 337  [0.514] 830
...      Lynx-tt-replacement-scheme-2073-win-x64 playing White: 173 - 84 - 159  [0.607] 416
...      Lynx-tt-replacement-scheme-2073-win-x64 playing Black: 85 - 151 - 178  [0.420] 414
...      White vs Black: 324 - 169 - 337  [0.593] 830
Elo difference: 9.6 +/- 18.2, LOS: 85.0 %, DrawRatio: 40.6 %
SPRT: llr 0.413 (14.3%), lbound -2.25, ubound 2.89

Depth > depth >= entry.Depth + 2; 👎🏽

Score of Lynx-tt-replacement-scheme-2074-win-x64 vs Lynx-tt-replacement-scheme-2073-win-x64: 59 - 98 - 103  [0.425] 260
...      Lynx-tt-replacement-scheme-2074-win-x64 playing White: 41 - 41 - 49  [0.500] 131
...      Lynx-tt-replacement-scheme-2074-win-x64 playing Black: 18 - 57 - 54  [0.349] 129
...      White vs Black: 98 - 59 - 103  [0.575] 260
Elo difference: -52.5 +/- 33.0, LOS: 0.1 %, DrawRatio: 39.6 %
SPRT: llr -0.992 (-34.3%), lbound -2.25, ubound 2.89

Depth > depth >= entry.Depth + 3; 👎🏽

Score of Lynx-tt-replacement-scheme-2074-win-x64 vs Lynx-tt-replacement-scheme-2073-win-x64: 62 - 110 - 118  [0.417] 290
...      Lynx-tt-replacement-scheme-2074-win-x64 playing White: 42 - 34 - 69  [0.528] 145
...      Lynx-tt-replacement-scheme-2074-win-x64 playing Black: 20 - 76 - 49  [0.307] 145
...      White vs Black: 118 - 54 - 118  [0.610] 290
Elo difference: -58.0 +/- 31.0, LOS: 0.0 %, DrawRatio: 40.7 %
SPRT: llr -1.24 (-43.0%), lbound -2.25, ubound 2.89

Depth > depth >= entry.Depth + 1; 👎🏽

Score of Lynx-tt-replacement-scheme-2074-win-x64 vs Lynx-tt-replacement-scheme-2073-win-x64: 104 - 138 - 158  [0.458] 400
...      Lynx-tt-replacement-scheme-2074-win-x64 playing White: 68 - 46 - 87  [0.555] 201
...      Lynx-tt-replacement-scheme-2074-win-x64 playing Black: 36 - 92 - 71  [0.359] 199
...      White vs Black: 160 - 82 - 158  [0.598] 400
Elo difference: -29.6 +/- 26.5, LOS: 1.4 %, DrawRatio: 39.5 %
SPRT: llr -0.882 (-30.5%), lbound -2.25, ubound 2.89

Ageing + Depth > depth >= entry.Depth + 3; 👎🏽

Score of Lynx-tt-replacement-scheme-2077-win-x64 vs Lynx-tt-replacement-scheme-2073-win-x64: 62 - 102 - 116  [0.429] 280
...      Lynx-tt-replacement-scheme-2077-win-x64 playing White: 40 - 38 - 62  [0.507] 140
...      Lynx-tt-replacement-scheme-2077-win-x64 playing Black: 22 - 64 - 54  [0.350] 140
...      White vs Black: 104 - 60 - 116  [0.579] 280
Elo difference: -50.0 +/- 31.3, LOS: 0.1 %, DrawRatio: 41.4 %
SPRT: llr -1.05 (-36.4%), lbound -2.25, ubound 2.89

Ageing + Depth > depth >= entry.Depth + 2;

Score of Lynx-tt-replacement-scheme-2077-win-x64-mod vs Lynx-tt-replacement-scheme-2073-win-x64: 449 - 531 - 654  [0.475] 1634
...      Lynx-tt-replacement-scheme-2077-win-x64-mod playing White: 292 - 187 - 339  [0.564] 818
...      Lynx-tt-replacement-scheme-2077-win-x64-mod playing Black: 157 - 344 - 315  [0.385] 816
...      White vs Black: 636 - 344 - 654  [0.589] 1634
Elo difference: -17.5 +/- 13.0, LOS: 0.4 %, DrawRatio: 40.0 %
SPRT: llr -2.25 (-78.0%), lbound -2.25, ubound 2.89 - H0 was accepted

Ageing + Depth > depth >= entry.Depth + 1; 👎🏽

Score of Lynx-tt-replacement-scheme-2077-win-x64-mod vs Lynx-tt-replacement-scheme-2073-win-x64: 307 - 389 - 444  [0.464] 1140
...      Lynx-tt-replacement-scheme-2077-win-x64-mod playing White: 205 - 125 - 241  [0.570] 571
...      Lynx-tt-replacement-scheme-2077-win-x64-mod playing Black: 102 - 264 - 203  [0.358] 569
...      White vs Black: 469 - 227 - 444  [0.606] 1140
Elo difference: -25.0 +/- 15.8, LOS: 0.1 %, DrawRatio: 38.9 %
SPRT: llr -2.13 (-73.8%), lbound -2.25, ubound 2.89

@eduherminio eduherminio changed the title Improve TT replacement scheme 🔍 Improve TT replacement scheme: add required conditions for always replace Dec 8, 2023
@eduherminio eduherminio marked this pull request as ready for review December 8, 2023 22:37
@eduherminio eduherminio enabled auto-merge (squash) December 8, 2023 22:37
@eduherminio eduherminio merged commit 42b74b5 into main Dec 8, 2023
21 checks passed
@eduherminio eduherminio deleted the tt-replacement-scheme branch December 8, 2023 22:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant