Failed To Load Tokenizer: EOF

[artforlife]

I have installed Refact as a self-hosted instance. It mostly appears to work, but there is an issue. When using the model combination below and typing code, the VS Code plugin returns the following error

failed to load tokenizer: EOF while parsing a value at line 1 column 0

Upon inspecting the logs, one can discover that this happens because instead of getting a tokenizer file with JSON in it, the file is empty or does not exist. For instance, for the model named StarCoder and for the VSCodium web version, the following file would be missing

/home/coder/.cache/refact/tokenizers/starcoder/15b/plus/tokenizer.json

That is, it appears that the Refact plugin is somehow not loading the tokenizers correctly. Whenever the file is added manually, requests begin working without error.

[olegklimov]

We've seen something like this before. But I thought it was fixed, with a change that adds .flush() when downloading a tokenizer file.

[mitya52]

@artforlife we need your plugin version, this should be be fixed in the latest one

[hazratisulton]

• Checked plugin v2.0.127 with broken, empty and non existing tokenizer.json - new tokenizer is downloading without problems.