Open hnauto opened 6 days ago
Make sure that the Joy-Caption-alpha-two model files have been completely downloaded and are placed in the correct directory (models/Joy_caption_two). Also, double-check that the BASE_MODEL_PATH variable in joy_caption_two_node.py is pointing to the directory where the model files are located.
Suggestion 3:
Older versions of the Transformers library may not support tiktoken encoding or may have errors during the conversion process. Try upgrading the Transformers library to the latest version or use the specific version specified in requirements.txt.
You can also add the following to your reply:
If you have already checked these suggestions, please provide more information so I can assist you further. This information could include:
The version of ComfyUI you are using.
The version of Python you are using.
The specific download source for the model.
Issue Description
When attempting to convert a slow tokenizer to a fast tokenizer using the
transformers
library, an error occurred due to the inability to convert from Tiktoken. The error suggests that if a converter for SentencePiece is available, a model path with a SentencePiecetokenizer.model
file should be provided.Error Log