[Feature] Add support for local Nomic Text Embed models compatible models for local docs

nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

https://nomic.ai/gpt4all

MIT License

69.72k stars 7.63k forks source link

Open dwindibank opened 4 months ago

dwindibank commented 4 months ago

I would like to use a local version nomic-ai/nomic-embed-text-v1.5 or a custom fine tuning for local docs.

The Nomic model is available via API. but having it locally allow users to:

Have local docs that work policies or legislation would otherwise not permit sharing (i.e. sending documents to an API is not acceptable)
Use custom trained versions based on nomic contrastors [https://github.com/nomic-ai/contrastors]

dwindibank commented 4 months ago

Related feature requests:

cercata commented 3 months ago

I have read in another issue that they plan to implement Nomic Embed for local models, they will even remove SBERT support after that.