search

severian42 / GraphRAG-Local-UI

GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.
MIT License
1.51k stars 173 forks source link

port 11435 used for ? #68

Closed Tovi163 closed 1 month ago

Tovi163 commented 1 month ago

python embedding_proxy.py --port 11435 --host http://localhost:11434

severian42 commented 1 month ago

This is to host a separate embeddings for Ollama since their API is strictly /api/embeddings

Tovi163 commented 1 month ago

This is to host a separate embeddings for Ollama since their API is strictly /api/embeddings

port 11435 used for ? I do not see anywhere use the port of 11435 @severian42

havvk commented 1 month ago

This is to host a separate embeddings for Ollama since their API is strictly /api/embeddings

port 11435 used for ? I do not see anywhere use the port of 11435 @severian42

You need it only for embeddings with Ollama. It will not be used when you do embeddings through openai API.

Tovi163 commented 1 month ago

This is to host a separate embeddings for Ollama since their API is strictly /api/embeddings

Get it, thanks again