search

lightvector / KataGo

GTP engine and self-play learning in Go
https://katagotraining.org/
Other
3.56k stars 564 forks source link

Not tfrecord but npz #888

Open Harder-Run opened 9 months ago

Harder-Run commented 9 months ago

When I ran shuffle.sh, the result was: Number of rows by output file: [('D:/KataGo/python/shuffleddata/20240120-093419/train\data0.npz', 75008), ('D:/KataGo/python/shuffleddata/20240120-093419/train\data1.npz', 74752), ('D:/KataGo/python/shuffleddata/20240120-093419/train\data2.npz', 74752), ('D:/KataGo/python/shuffleddata/20240120-093419/train\data3.npz', 74752)] The output files are't tfrecord. How could I resolve it?

lightvector commented 9 months ago

Tensorflow training is no longer implemented or supported. If you need to train with Tensorflow, you need to use a much older version of the repo. Pytorch training uses the npz files.

Harder-Run commented 9 months ago

Thanks. But it seemed to be wrong. When I exported the weight model.bin.gz, the weight size was only 12KB(b5c192nbt) and then the load failed.

Harder-Run commented 9 months ago

model.bin.gz error