On launch, I got the following error:
UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 3565933: character maps to
For a quick fix, in item_processor.py, line 89, I made this change, but I don't know if it's an issue for other OS however.
json.load(open("./ckpts/chameleon/tokenizer/text_tokenizer.json", encoding="utf8"))["model"]["vocab"]
On launch, I got the following error: UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 3565933: character maps to
For a quick fix, in item_processor.py, line 89, I made this change, but I don't know if it's an issue for other OS however.
json.load(open("./ckpts/chameleon/tokenizer/text_tokenizer.json", encoding="utf8"))["model"]["vocab"]