diff options
| author | tslil <tslil@posteo.de> | 2026-09-11 12:56:12 +0100 |
|---|---|---|
| committer | tslil <tslil@posteo.de> | 2026-09-11 17:00:18 +0100 |
| commit | 6e90f1145b2c5c0f2dcc82d21ec45432274b8cad (patch) | |
| tree | 18db1c03ea7c3c4724028fc5154d4bca3d7200a5 /include/weights_5.h | |
| parent | 220a4b79e4b6d742a9ca7c278a1962b870500fbc (diff) | |
move from single candidate td-leaf with gating to tournament of a population
The goal in this change was to overcome the rock-paper-scissors phenomenon that was happening in capability space by having on a single candidate learn to beat the most recent version of itself. In some sense this lead to rotating around in capability space instead of chasing monotonic improvements.
I hope that flipping to a system in which many (N=5) candidates play each other and learn from their own set of diverse games in this pool, combined with --replay-iters, will lead to a given network having to have a much more comprehensive understanding of the space of tactics. I haven't yet had time to train this thorougly, will run those experiments on my desktop computer.
Diffstat (limited to 'include/weights_5.h')
| -rw-r--r-- | include/weights_5.h | 10 |
1 files changed, 5 insertions, 5 deletions
diff --git a/include/weights_5.h b/include/weights_5.h index 8ad9d1b..d48a05a 100644 --- a/include/weights_5.h +++ b/include/weights_5.h @@ -24,11 +24,11 @@ // this does some kind of magic vectorisation #define NN_ALIGNED __attribute__((aligned(16))) -extern const float five_embedding[7]; -extern const float five_dense_weights[FIVE_DENSE_NUM][FIVE_INP_NUM] NN_ALIGNED; -extern const float five_dense_biases[FIVE_DENSE_NUM]; -extern const float five_logit_weights[FIVE_DENSE_NUM] NN_ALIGNED; -extern const float five_logit_bias; +extern const float FIVE_embedding[7]; +extern const float FIVE_dense_weights[FIVE_DENSE_NUM][FIVE_INP_NUM] NN_ALIGNED; +extern const float FIVE_dense_biases[FIVE_DENSE_NUM]; +extern const float FIVE_logit_weights[FIVE_DENSE_NUM] NN_ALIGNED; +extern const float FIVE_logit_bias; #endif |