AUTODETECT models doesn't filter or detect properly - Githubissues

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

https://docs.continue.dev/

Apache License 2.0

19.43k stars 1.69k forks source link

AUTODETECT models doesn't filter or detect properly #3028

Open RomneyDa opened 13 hours ago

RomneyDa commented 13 hours ago

Before submitting your bug report

[ ] I believe this is a bug. I'll try to join the Continue Discord for questions
[ ] I'm not able to find an open issue that reports the same bug
[ ] I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

OS: Ubuntu 22.04
Continue Version: v0.9.231 (pre-release)
IDE Version: VSCode 1.95.2
Model: nomic-embed-text

  "embeddingsProvider": {
    "provider": "ollama",
    "model": "nomic-embed-text",
    "apiBase": "https://internal-redacted-system/ollama",
  }



### Description

seems like
- autodetect doesn't filter properly for chat-only models, e.g. chat titles was attempting to use embeddings model with the above config
- we could set up to work for autocomplete, embeddings, reranking, etc.

### To reproduce

_No response_

### Log output

_No response_