Device map passed multiple times into the llm

snexus / llm-search

Querying local documents, powered by LLM

MIT License

421 stars 51 forks source link

Closed adi-kmt closed 4 months ago

adi-kmt commented 4 months ago

Issue occurring when generating with hf transformers library version 4.39+. No error occurred while indexing documents.

snexus commented 4 months ago

Hi,

Can you elaborate please on how to reproduce the issue?

Thanks

mohammad-yousuf commented 4 months ago

@snexus there is some issue with Huggingface template (model.yaml). It gives this error