KaTrain.exe crashes

[PiotrKoller]

Hi, I have a problem with KaTrain crashing. I'm using version 1.14 on Windows 11. I was using this software for a while and I had no problems, but suddenly it started crashing. Re-installation is not helping.

I'm posting log from a console:

Using user config file C:\Users\pittb\.katrain\config.json
2024-05-30 13:22:05+0200: Running with following config:
conservativePass = true
homeDataDir = C:\Users\pittb/.katrain
maxVisits = 500
nnCacheSizePowerOfTwo = 20
nnMaxBatchSize = 96
nnMutexPoolSizePowerOfTwo = 16
nnRandomize = true
numSearchThreads = 8
reportAnalysisWinratesAs = BLACK

2024-05-30 13:22:05+0200: Analysis Engine starting...
2024-05-30 13:22:05+0200: KataGo v1.13.0
2024-05-30 13:22:05+0200: nnRandSeed0 = 9277581862715595423
2024-05-30 13:22:05+0200: After dedups: nnModelFile0 = C:\Users\pittb\OneDrive\Dokumenty\KaTrain\katrain\models/kata1-b18c384nbt-s6582191360-d3422816034.bin.gz useFP16 auto useNHWC auto
2024-05-30 13:22:05+0200: Initializing neural net buffer to be size 19 * 19 allowing smaller boards
2024-05-30 13:22:06+0200: Found OpenCL Platform 0: AMD Accelerated Parallel Processing (Advanced Micro Devices, Inc.) (OpenCL 2.1 AMD-APP (3584.0))
2024-05-30 13:22:06+0200: Found 1 device(s) on platform 0 with type CPU or GPU or Accelerator
2024-05-30 13:22:06+0200: Found OpenCL Device 0: gfx90c (Advanced Micro Devices, Inc.) (score 11000200)
2024-05-30 13:22:06+0200: Creating context for OpenCL Platform: AMD Accelerated Parallel Processing (Advanced Micro Devices, Inc.) (OpenCL 2.1 AMD-APP (3584.0))
2024-05-30 13:22:07+0200: Using OpenCL Device 0: gfx90c (Advanced Micro Devices, Inc.) OpenCL 2.0 AMD-APP (3584.0) (Extensions: cl_khr_fp64 cl_amd_fp64 cl_khr_global_int32_base_atomics cl_khr_global_int32_extended_atomics cl_khr_local_int32_base_atomics cl_khr_local_int32_extended_atomics cl_khr_int64_base_atomics cl_khr_int64_extended_atomics cl_khr_3d_image_writes cl_khr_byte_addressable_store cl_khr_fp16 cl_khr_gl_sharing cl_amd_device_attribute_query cl_amd_vec3 cl_amd_printf cl_amd_media_ops cl_amd_media_ops2 cl_amd_popcnt cl_khr_d3d10_sharing cl_khr_d3d11_sharing cl_khr_dx9_media_sharing cl_khr_image2d_from_buffer cl_khr_subgroups cl_khr_gl_event cl_khr_depth_images cl_khr_mipmap_image cl_khr_mipmap_image_writes cl_amd_copy_buffer_p2p cl_amd_planar_yuv)
2024-05-30 13:22:07+0200: Loaded tuning parameters from: C:\Users\pittb/.katrain/opencltuning/tune11_gpugfx90c_x19_y19_c384_mv14.txt
2024-05-30 13:22:10+0200: OpenCL backend thread 0: Model version 14
2024-05-30 13:22:10+0200: OpenCL backend thread 0: Model name: kata1-b18c384nbt-s6582191360-d3422816034
2024-05-30 13:22:11+0200: OpenCL backend thread 0: FP16Storage true FP16Compute true FP16TensorCores false FP16TensorCoresFor1x1 false
2024-05-30 13:22:11+0200: Loaded config C:\Users\pittb\OneDrive\Dokumenty\KaTrain\katrain\KataGo/analysis_config.cfg and/or command-line and query overrides
2024-05-30 13:22:11+0200: Loaded model C:\Users\pittb\OneDrive\Dokumenty\KaTrain\katrain\models/kata1-b18c384nbt-s6582191360-d3422816034.bin.gz
2024-05-30 13:22:11+0200: Config override: homeDataDir = C:\Users\pittb/.katrain
2024-05-30 13:22:11+0200: Analyzing up to 12 positions at a time in parallel
2024-05-30 13:22:11+0200: Started, ready to begin handling requests
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Got nonfinite for policy sum'
2024-05-30 13:22:11+0200: ERROR: Search thread failed: Got nonfinite for policy sum
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'HASH: AA374DC2C7229A26780AEDD3220369B6'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'A B C D E F G H J K L M N O P Q R S T'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'19 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'18 . . . . . . . . . . . . . . . . . . X'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'17 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'16 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'15 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'14 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'13 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'12 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'11 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 4 (char 3) while processing KataGo output b'10 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'9 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'8 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'7 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'6 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'5 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'4 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'3 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'2 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Extra data: line 1 column 3 (char 2) while processing KataGo output b'1 . . . . . . . . . . . . . . . . . . .'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 340, in decode
 json.decoder.JSONDecodeError: Extra data: line 1 column 3 (char 2)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Initial pla Black'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Encore phase 0'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Turns this phase 1'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Rules koSIMPLEscoreTERRITORYtaxSEKIsui0komi6.5'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Ko recap block hash 00000000000000000000000000000000'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'White bonus score 1'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'White handicap bonus score 0'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Has button 0'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Presumed next pla White'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Past normal phase end 0'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Game result 0 Empty 0 0 0 0'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Unexpected exception Expecting value: line 1 column 1 (char 0) while processing KataGo output b'Last moves T18'
 Traceback (most recent call last):
   File "katrain\core\engine.py", line 280, in _analysis_read_thread
   File "json\__init__.py", line 357, in loads
   File "json\decoder.py", line 337, in decode
   File "json\decoder.py", line 355, in raw_decode
 json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
ERROR: Engine died unexpectedly without sending output:  status 3221226505
ERROR: Engine died unexpectedly without sending output:  status 3221226505

[github-actions[bot]]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 10 days.