bood / go-test Goto Github PK

View Code? Open in Web Editor NEW

8.0 8.0 5.0 90 KB

Scenario based strength test tool for Go programs

License: MIT License

Python 100.00%

go-test's People

Contributors

Stargazers

Watchers

Forkers

odeint thoravatahr guitanj pangafu ttl

go-test's Issues

help

if I give you access to a server remetloy can you log in on my behalf and set up training for me?

I wish to net2net Leela zero current net (#116) to a 256f 20b (or 40blocks) network (new net) and then backtrain the last 2 million games.

Can you help

Missing SGF: race4 "12383186-296-inelasticneutron-RoyalZero.sgf"

The SGF appears to be missing for race4. This is the filename:

12383186-296-inelasticneutron-RoyalZero.sgf

Add OGS 12496265 lizf123 4d vs RoyalZero 8d 8a045bce

https://online-go.com/game/12496265

Seems like there was a mistake earlier as win rate drops from 52.4% to 35.4% after a potential ladder starting at move 58.

But at least for move 123 Q3, it wasn't expected for rotation 2 with only a 11.71% prior policy (whereas other rotations were ~25-40%):

expect: Q3, move: 123, who: b
weight: 8a045bce, visit: 250
rotation: 0, seed: 22
  Q3 ->     236 (V: 95.16%) (N: 29.38%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 M1 L1 N1
  T2 ->       5 (V: 49.29%) (N: 20.93%) PV: T2 R3 S5
  S5 ->       5 (V: 48.89%) (N: 20.01%) PV: S5 T3 Q3 Q2 T2
  T3 ->       3 (V: 47.46%) (N: 11.95%) PV: T3 R3 S5
= Q3
rotation: 1, seed: 6
  Q3 ->     163 (V: 77.27%) (N: 38.97%) PV: Q3 Q2 R3 T3 S2 O1 S5 N2 M3 L2 M2 M1 N3 N1
  T2 ->      58 (V: 56.80%) (N: 21.66%) PV: T2 S2 S5 R3 T6 L3 S1 T3 E14
  T3 ->      16 (V: 51.99%) (N: 14.53%) PV: T3 R3 S5 S2 K4 K3
  S5 ->       8 (V: 52.96%) (N:  6.74%) PV: S5 T3 Q3 Q2 T2 T4
  R3 ->       4 (V: 42.98%) (N:  6.04%) PV: R3 Q3 T2 S2
= Q3
rotation: 2, seed: 2
  T3 ->     122 (V: 57.84%) (N: 11.71%) PV: T3 R3 S5 S2 L8 L3 S17 N14 M15
  T2 ->      69 (V: 47.93%) (N: 58.36%) PV: T2 O1 S5 N2 M3 N3 O4 M2 L3 L2 K3 K2 J3 J2 G2 H2 L8
  Q3 ->      56 (V: 56.23%) (N: 11.93%) PV: Q3 Q2 T2 R3 S5 S2 T6 L3 L8
  S5 ->       2 (V: 44.02%) (N:  2.91%) PV: S5 T3
= T3
rotation: 3, seed: 11
  Q3 ->     239 (V: 95.42%) (N: 43.42%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 N1 H10 L8 M7
  T2 ->       4 (V: 48.27%) (N: 16.76%) PV: T2 S2 S5 R3
  S5 ->       4 (V: 45.58%) (N: 18.30%) PV: S5 T3 Q3 Q2
  T3 ->       2 (V: 48.52%) (N:  9.26%) PV: T3 R3
= Q3
rotation: 4, seed: 3
  Q3 ->     197 (V: 90.05%) (N: 28.35%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 N1 H10 L8 M7
  T2 ->      45 (V: 56.60%) (N: 38.65%) PV: T2 O1 S5 N2 M3 L2 M2 M1 N3 N1
  S5 ->       5 (V: 46.47%) (N: 10.26%) PV: S5 T3 Q3 Q2 T6
  O1 ->       2 (V: 46.87%) (N:  5.27%) PV: O1 R3
= Q3
rotation: 5, seed: 4
  Q3 ->     237 (V: 94.63%) (N: 25.97%) PV: Q3 Q2 R3 T3 S2 O1 S5 N2 M3 M2 L3 L2 K3
  T2 ->       7 (V: 49.77%) (N: 27.99%) PV: T2 R3 S5 S2
  S5 ->       3 (V: 47.19%) (N: 15.47%) PV: S5 T3 Q3
  T3 ->       2 (V: 41.81%) (N: 10.33%) PV: T3 R3
= Q3
rotation: 6, seed: 12
  Q3 ->     217 (V: 87.48%) (N: 29.44%) PV: Q3 Q2 R3 T3 S2 O1 S5 S1 T4 L2 N2 M2 N1 S17 S18 T18
  T2 ->      14 (V: 54.26%) (N: 18.25%) PV: T2 R3 S5 S2 T6
  S5 ->       8 (V: 51.46%) (N: 11.99%) PV: S5 T3 Q3 Q2 T6 T4
  T3 ->       8 (V: 48.88%) (N: 16.69%) PV: T3 S2 S5 R3
  T6 ->       2 (V: 43.91%) (N:  6.07%) PV: T6 T3
= Q3
rotation: 7, seed: 1
  Q3 ->     203 (V: 60.17%) (N: 39.11%) PV: Q3 Q2 T2 T3 E14 D14 T4 R3 S5 T3 D15
  T2 ->      27 (V: 52.56%) (N: 21.08%) PV: T2 O1 S5 N2 M2 N3 O4
  S5 ->      11 (V: 51.53%) (N:  9.84%) PV: S5 T3 Q3 Q2 T2 R3 T4 S2
  T3 ->       5 (V: 47.56%) (N:  6.42%) PV: T3 R3 S5 S2
  R3 ->       3 (V: 33.11%) (N:  5.93%) PV: R3 Q3 T2
= Q3

Add OGS 12435854 huhoho 2d vs RoyalZero 9d 8c67ecdc

https://online-go.com/game/12435854

This game has RZ dropping from 60% winrate after move 148. Analyzing the game with the net used (8c67ecdc-120), the now best (5d6d9c5b-121), and current best 256x20 (1629cbfd-V5) for move 150 with 32000 visits seems to show the live eval thought the win rate of 48% for playing K2 was not actually as good.

weight: 8c67ecdc, visit: 32000
  L2 ->   11132 (V: 43.14%) (N:  1.53%) PV: L2 L4 K5 H2 K2 P5 P4 P6 Q7 O3 N6 L6 J7 K6 O7 J5 B10 L12 C11 D11 G17 M11 H10 O12 S15 S16 T16 T17 T15 S18 F18
  Q1 ->    6024 (V: 49.93%) (N:  0.03%) PV: Q1 R2 P1 R1 L4 P7 O8 L2 M2 H2 K2 L3 K5 K4 K6 J5 L6 J7 L1 K1 J1 H1 M1 F1 B10
  K2 ->    4656 (V: 42.85%) (N: 10.96%) PV: K2 L3 Q1 R2 P1 S2 L4 L2 M2 H2 L1 H1 E1 K1 K4 J3 D1 A5 K5 J5
  H2 ->    3323 (V: 43.02%) (N:  3.22%) PV: H2 L4 L3 P6 P4 O8 P7 Q6 R6 Q7 R2 S2 R3 S3 O3 R1 P1 Q2 S15 S16
  L4 ->    2985 (V: 40.35%) (N: 64.84%) PV: L4 L2 M2 H2 K2 L3 L1 H1 E1 K1 K5 K4 K6 J5 L6 J7
  R2 ->    1495 (V: 43.06%) (N:  1.12%) PV: R2 S2 L4 L2 M2 H2 K2 L3 L1 H1 R3 S3 E1 K1 K4 J3

weight: 5d6d9c5b, visit: 32000
  L4 ->    7914 (V: 40.18%) (N: 64.82%) PV: L4 L2 R2 R3 M2 P5 P4 P6 R6 O3 S2 P1 T3 T4 N4 R1 S1 T2 Q1 Q2 O1 S3 K2
  K2 ->    6567 (V: 41.13%) (N: 10.26%) PV: K2 L3 Q1 R2 P1 S2 L4 L2 M2 H2 K5 K4 K6 J5 L6 J7 L1 K1 J1 H1 K1 F1 B10
  R2 ->    3778 (V: 41.31%) (N:  1.16%) PV: R2 S2 R3 S3 L4 L2 M2 H2 K5 K4 K2 L3 L6 K6 L1 P7 O8 R6 Q6 Q7 P5 P9 S7
  L2 ->    3741 (V: 41.29%) (N:  1.71%) PV: L2 L4 K5 P5 P4 P6 R6 O3 H2 J5 G17 F18 G16 H17 S15 S16 T16 T17 T15 S18 B10 C11 A6
  R3 ->    3531 (V: 41.34%) (N:  0.28%) PV: R3 S3 L4 L2 R2 S2 M2 H2 K2 L3 K5 J5 L1 K1 J1 H1 K6 J7 M1 F1 S15 S16
  H2 ->    3456 (V: 41.24%) (N:  2.83%) PV: H2 L4 K5 P7 O8 J5 K6 L6 J7 M5 N6 N4 P4 O3 R3 S3 R2 M2 S2 R6 Q6 Q7 S7 P5 T6 L8 S15 S16

weight: 1629cbfd, visit: 32000
  R2 ->    7510 (V: 42.65%) (N:  2.40%) PV: R2 S2 Q1 R3 P1 S1 L4 L2 M2 H2 K2 L3 L1 K1 K5 K4 J1 H1 K6 J5 L6 J7
  L4 ->    5970 (V: 41.24%) (N: 60.58%) PV: L4 L2 R2 S2 R3 S3 Q1 Q2 K2 L3 H2 M2 O3 N1 N4 O1 P4 R1 G17 F18 G16 H17 S15
  P1 ->    4986 (V: 42.69%) (N:  0.04%) PV: P1 Q1 L4 L2 M2 H2 K2 L3 K5 J5 L1 H1 E1 K1 J1 J3 M1 K1 G17
  H2 ->    4062 (V: 42.45%) (N:  6.85%) PV: H2 L4 L3 L6 J3 P6 P4 O3 N6 P5 Q7 J7 K5 K4 K2 J5 G17 F18 G16 H17 S15
  K2 ->    3912 (V: 42.36%) (N:  8.97%) PV: K2 L3 R2 S2 Q1 R3 P1 S1 L4 L2 M2 H2 L1 K1 K5 K4 J1 H1 K6 J5 L6 J7
  R3 ->    2884 (V: 42.68%) (N:  0.11%) PV: R3 S3 L4 L2 R2 S2 Q1 Q2 K2 L3 H2 M2 O3 N1 N4 O1 P4 R1 G17 F18 G16 H17 S15
…
  L2 ->      23 (V: 32.23%) (N:  1.68%) PV: L2 L4 K5 H2 K2 J5 G17

I'm not really sure what's the right play here. Or maybe there is no definitive right or wrong play at this point? Notably the 256x20 didn't think very highly of the best move 150 L2 of the first network.

As a sanity check, move 148 E5 is generally good with all 3 networks although not quite the 60% win rate from the live game:

weight: 8c67ecdc, visit: 32000
 B10 ->   13554 (V: 51.08%) (N:  0.26%) PV: B10 L12 C11 D11 C12 G16 M11 E5 D12 E14 F15 G14 E12 D14 E11
  A6 ->    7745 (V: 50.79%) (N:  0.20%) PV: A6 H2 K3 E5 A4 C1 A2 L12 B10 M11 H10 C11 G17 F18 G16 H17 S15 O12 S17
  E5 ->    3387 (V: 50.49%) (N:  7.20%) PV: E5 K3 K2 L3 L4 L2 M2 H2 L1 H1 E1 K1 J1 J3 D1 A5
  F7 ->    2702 (V: 50.75%) (N:  0.80%) PV: F7 K3 L4 L2 M2 H2 K2 L3 K5 J5 L1 K1 J1 H1 E1 J3 D1 A5 S15
  L6 ->    2086 (V: 47.85%) (N: 43.65%) PV: L6 E5 G4 H2 K3 E7 A6 G7 A4 C1 A2 B3 A3 E1 B10 B9 C9 C10 B11

weight: 5d6d9c5b, visit: 32000
  A6 ->   15661 (V: 48.35%) (N:  0.26%) PV: A6 H2 K3 E5 A4 C1 F7 F6 B10 L12 A2 M11 H10 C11 G17 F18 G16 H17 S15 S16 T16 T17
 B10 ->    3480 (V: 48.33%) (N:  0.36%) PV: B10 L12 M11 H2 K3 E5 C11 D11 S15 S16 T16 T17 T15 S18 G17 F18 G16
  L6 ->    3126 (V: 46.37%) (N: 43.14%) PV: L6 E5 G4 H2 K3 E7 A6 G8 H8 G7 K6 J7 A4 C1 A2
  E5 ->    2988 (V: 48.02%) (N:  6.89%) PV: E5 K3 L4 L2 M2 H2 K2 L3 L1 H1 E1 K1 J1 J3 D1 A5 S15
  J7 ->    2463 (V: 48.18%) (N:  2.86%) PV: J7 E5 G4 H2 K3 E7 K4 K5 F7 D8 D9 C8 C9 B8 E8 B9
  F7 ->    1521 (V: 48.26%) (N:  0.75%) PV: F7 K3 R2 S2 L4 L2 M2 H2 K2 L3 L1 K1 R3 S3 J1 H1 E1 J3

weight: 1629cbfd, visit: 32000
  F7 ->   13345 (V: 52.09%) (N:  0.26%) PV: F7 L6 G17 F18 G16 H17 J7 K3 H2 P7 O8 R6 Q6 P5 N6 O7 Q7 P4 L2
 G17 ->    4557 (V: 52.07%) (N:  0.52%) PV: G17 L12 M11 H2 K3 E5 B10 C11 S15 S16 T16 T17 T15 S18 H17 H18 J17 J18 K17
 B10 ->    4011 (V: 52.08%) (N:  0.12%) PV: B10 L12 M11 H2 K3 E5 G17 M12 N13 N12 O13 C10 B9 B11 S15 S16 T16 T17 T15
  A6 ->    3738 (V: 52.08%) (N:  0.02%) PV: A6 L12 A4 C1 M11 H2 K3 E5 A2 M12 E1 A3 B3 B17 B18 A3 R2 S2 B3
  E5 ->    2792 (V: 51.97%) (N:  2.25%) PV: E5 K3 K2 L4 L3 P7 O8 P5 P4 R6 P6 Q6 P5 Q7 O7 J3 R2 R3 S2 R8 S8 S7 S9 T2

All 3 networks do have the PV: E5 K3 K2, but comparing the win rates from move 148 (50.49%, 48.02%, 51.97%) to the above move 150 K2 (after black plays K3): 42.85%, 41.13%, 42.36%. So even when playing the expected variation, the win rate drops by about 8% for each network, so it seems like the value head is off… ?

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.