multi-user querying - Githubissues

WEHI-ResearchComputing / rag

RAG toy example to build on. Copied from https://github.com/pixegami/rag-tutorial-v2

0 stars 1 forks source link

multi-user querying #3

Closed edoyango closed 3 months ago

edoyango commented 5 months ago

Current setup only allows one connection at a time. I believe this is a configurable when starting the Ollama server. Probably more important once #2 is implemented.

edoyango commented 3 months ago

Ollama already has in-built capability to handle multiple concurrent users. No longer considering huggingface as the backend.