search

Luan-vP / ai_journal

0 stars 0 forks source link

design: architecture for deployment #22

Open Luan-vP opened 1 month ago

Luan-vP commented 1 month ago
Luan-vP commented 1 month ago

On web, use LLama 3.2 1B by default

On desktop, allow the use of llama3.2 11B through Ollama.

How to do embeddings? Can I always use the in-browser 3.2 so they stay consistent? What does colbert do?