marella / chatdocs

Chat with your documents offline using AI.
MIT License
683 stars 97 forks source link

pad_token errors #86

Open tomgelu opened 10 months ago

tomgelu commented 10 months ago

Trying to run chatdocs on windows, with gpu, model mistralai/Mistral-7B-Instruct-v0.1 but same error on default models..

ValueError: Pipeline with tokenizer without pad_token cannot do batching. You can try to set it with pipe.tokenizer.pad_token_id = model.config.eos_token_id.

Anyone can help ?