thomas-schweich commited on
Commit
7a2ac03
·
verified ·
1 Parent(s): c62ea6a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +15 -15
README.md CHANGED
@@ -113,15 +113,15 @@ Linear probes trained on frozen hidden states measure how well the model's inter
113
 
114
  | Probe | Metric | Description |
115
  |-------|--------|-------------|
116
- | Piece type | 91.9% | Per-square piece type (13 classes x 64 squares) |
117
  | Side to move | 100.0% | Whose turn it is |
118
  | Is check | 95.0% | Whether the side to move is in check |
119
  | Castling rights | 99.3% | KQkq castling availability |
120
  | En passant square | 99.9% | En passant target square (64 + none) |
121
- | Material count | R² 0.84 (MAE 4.0) | Piece counts per type per color |
122
- | Legal move count | R² 0.68 (MAE 5.1) | Number of legal moves available |
123
- | Halfmove clock | R² 0.49 (MAE 10.7) | Plies since last capture or pawn move |
124
- | Game phase | 96.0% | Opening / middlegame / endgame |
125
 
126
 
127
 
@@ -132,16 +132,16 @@ Edge-case diagnostics measure the model's legal move rate in specific tactical s
132
 
133
  | Category | Positions | Legal Rate |
134
  |----------|-----------|------------|
135
- | In check | 1000 | 97.7% |
136
- | Double check | 71 | 91.2% |
137
- | Pin restricts movement | 1000 | 97.2% |
138
- | En passant available | 940 | 99.2% |
139
- | Castling legal (kingside) | 1000 | 99.7% |
140
- | Castling legal (queenside) | 1000 | 99.6% |
141
- | Castling blocked by check | 892 | 99.4% |
142
- | Promotion available | 1000 | 99.4% |
143
- | Checkmate (terminal) | 276 | 91.2% |
144
- | Stalemate (terminal) | 41 | 84.2% |
145
 
146
 
147
 
 
113
 
114
  | Probe | Metric | Description |
115
  |-------|--------|-------------|
116
+ | Piece type | 91.8% | Per-square piece type (13 classes x 64 squares) |
117
  | Side to move | 100.0% | Whose turn it is |
118
  | Is check | 95.0% | Whether the side to move is in check |
119
  | Castling rights | 99.3% | KQkq castling availability |
120
  | En passant square | 99.9% | En passant target square (64 + none) |
121
+ | Material count | R² 0.84 (MAE 4.1) | Piece counts per type per color |
122
+ | Legal move count | R² 0.68 (MAE 5.2) | Number of legal moves available |
123
+ | Halfmove clock | R² 0.47 (MAE 10.4) | Plies since last capture or pawn move |
124
+ | Game phase | 95.8% | Opening / middlegame / endgame |
125
 
126
 
127
 
 
132
 
133
  | Category | Positions | Legal Rate |
134
  |----------|-----------|------------|
135
+ | In check | 10000 | 99.1% |
136
+ | Double check | 10000 | 96.8% |
137
+ | Pin restricts movement | 10000 | 98.9% |
138
+ | En passant available | 10000 | 99.6% |
139
+ | Castling legal (kingside) | 10000 | 99.8% |
140
+ | Castling legal (queenside) | 10000 | 99.7% |
141
+ | Castling blocked by check | 10000 | 99.6% |
142
+ | Promotion available | 10000 | 99.7% |
143
+ | Checkmate (terminal) | 10000 | 91.5% |
144
+ | Stalemate (terminal) | 10000 | 96.7% |
145
 
146
 
147