Closed dennismenze closed 1 year ago
When starting training, I got the following error:
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 238339: character maps to <undefined>
By adding an encoding parameter, the error was resolved:
D = json.load(open(os.path.join(self.output_path, f'{split}.json'), encoding="utf-8"))
Although I did not have this encoding issue on my end, it is great that this simple fix worked for you. Thanks for posting it!
When starting training, I got the following error:
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 238339: character maps to <undefined>
By adding an encoding parameter, the error was resolved:
D = json.load(open(os.path.join(self.output_path, f'{split}.json'), encoding="utf-8"))