diff options
| author | tslil clingman <tslil@posteo.de> | 2021-02-10 20:07:24 -0500 |
|---|---|---|
| committer | tslil <tslil@posteo.de> | 2026-08-28 19:37:41 +0100 |
| commit | 890eb8d7f4a8c46eae18283ca5ac9c61fd41ed97 (patch) | |
| tree | e0239b7d48b83fce4f9107ed553717b14042646a /resources/extract.sh | |
| parent | ce09b6d94ac3dbf426e959b14fd7731001a003d1 (diff) | |
Change the training data generation a little
Although it pains me to say it, ``label smoothing'' appears to be
actually work. I'm also currently experimenting with training simply
against _all_ games, instead of only bot matches. Once the training
finishes i'll pit cttei against itself with old and new weights,
hopefully there'll be a noticeable improvement.
Diffstat (limited to 'resources/extract.sh')
| -rwxr-xr-x | resources/extract.sh | 8 |
1 files changed, 6 insertions, 2 deletions
diff --git a/resources/extract.sh b/resources/extract.sh index fb2c30d..b413d46 100755 --- a/resources/extract.sh +++ b/resources/extract.sh @@ -2,7 +2,8 @@ db_file=games_anon.db -chosen_players="AaaarghBot Tiltak_Bot TakticianBot" +#chosen_players="AaaarghBot Tiltak_Bot TakticianBot" +chosen_players="" query() { query="(size == $1) and (result != '1-0') and (result != '0-1') and (result != '0-0') and (result != '1/2-1/2')" @@ -34,7 +35,10 @@ process() { ./pptdb "$size" "data/playtak-$size" > "data/check-$size" tail -n22 "data/check-$size" echo -ne "\tStripping overflows and illegal games... " - grep -Fvxf "data/check-$size" "data/playtak-$size" > "data/good-playtak-$size" + grep -Fvxf "data/check-$size" "data/playtak-$size" > "data/good-playtak-$size-all" + + shuf "data/good-playtak-$size-all" > "data/good-playtak-$size" + rm "data/good-playtak-$size-all" echo -en "Done.\n\tGenerating training data... " ./pptdb "$size" "data/good-playtak-$size" generate |