Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -113,15 +113,15 @@ Linear probes trained on frozen hidden states measure how well the model's inter
|
|
| 113 |
|
| 114 |
| Probe | Metric | Description |
|
| 115 |
|-------|--------|-------------|
|
| 116 |
-
| Piece type | 91.
|
| 117 |
| Side to move | 100.0% | Whose turn it is |
|
| 118 |
| Is check | 95.0% | Whether the side to move is in check |
|
| 119 |
| Castling rights | 99.3% | KQkq castling availability |
|
| 120 |
| En passant square | 99.9% | En passant target square (64 + none) |
|
| 121 |
-
| Material count | R² 0.84 (MAE 4.
|
| 122 |
-
| Legal move count | R² 0.68 (MAE 5.
|
| 123 |
-
| Halfmove clock | R² 0.
|
| 124 |
-
| Game phase |
|
| 125 |
|
| 126 |
|
| 127 |
|
|
@@ -132,16 +132,16 @@ Edge-case diagnostics measure the model's legal move rate in specific tactical s
|
|
| 132 |
|
| 133 |
| Category | Positions | Legal Rate |
|
| 134 |
|----------|-----------|------------|
|
| 135 |
-
| In check |
|
| 136 |
-
| Double check |
|
| 137 |
-
| Pin restricts movement |
|
| 138 |
-
| En passant available |
|
| 139 |
-
| Castling legal (kingside) |
|
| 140 |
-
| Castling legal (queenside) |
|
| 141 |
-
| Castling blocked by check |
|
| 142 |
-
| Promotion available |
|
| 143 |
-
| Checkmate (terminal) |
|
| 144 |
-
| Stalemate (terminal) |
|
| 145 |
|
| 146 |
|
| 147 |
|
|
|
|
| 113 |
|
| 114 |
| Probe | Metric | Description |
|
| 115 |
|-------|--------|-------------|
|
| 116 |
+
| Piece type | 91.8% | Per-square piece type (13 classes x 64 squares) |
|
| 117 |
| Side to move | 100.0% | Whose turn it is |
|
| 118 |
| Is check | 95.0% | Whether the side to move is in check |
|
| 119 |
| Castling rights | 99.3% | KQkq castling availability |
|
| 120 |
| En passant square | 99.9% | En passant target square (64 + none) |
|
| 121 |
+
| Material count | R² 0.84 (MAE 4.1) | Piece counts per type per color |
|
| 122 |
+
| Legal move count | R² 0.68 (MAE 5.2) | Number of legal moves available |
|
| 123 |
+
| Halfmove clock | R² 0.47 (MAE 10.4) | Plies since last capture or pawn move |
|
| 124 |
+
| Game phase | 95.8% | Opening / middlegame / endgame |
|
| 125 |
|
| 126 |
|
| 127 |
|
|
|
|
| 132 |
|
| 133 |
| Category | Positions | Legal Rate |
|
| 134 |
|----------|-----------|------------|
|
| 135 |
+
| In check | 10000 | 99.1% |
|
| 136 |
+
| Double check | 10000 | 96.8% |
|
| 137 |
+
| Pin restricts movement | 10000 | 98.9% |
|
| 138 |
+
| En passant available | 10000 | 99.6% |
|
| 139 |
+
| Castling legal (kingside) | 10000 | 99.8% |
|
| 140 |
+
| Castling legal (queenside) | 10000 | 99.7% |
|
| 141 |
+
| Castling blocked by check | 10000 | 99.6% |
|
| 142 |
+
| Promotion available | 10000 | 99.7% |
|
| 143 |
+
| Checkmate (terminal) | 10000 | 91.5% |
|
| 144 |
+
| Stalemate (terminal) | 10000 | 96.7% |
|
| 145 |
|
| 146 |
|
| 147 |
|