dannyl1u / doppelganger

flags duplicate issues & PRs using embeddings
15 stars 1 forks source link

feat: openai api compatible model presets (profiles) #18

Closed dannyl1u closed 4 months ago

dannyl1u commented 4 months ago

Is your feature request related to a problem? Please describe. As the modelfiles from the hub are pretty good, it would be nice if we could use also them with external models from openAI api compatible services.

Describe the solution you'd like Option A: When adding a modelfile, we could check that it should use a model from the external provider and select it. Option B: When selecting a modelfile, we should be able to exchange then the actual model to one from the external service.

Describe alternatives you've considered Setting the default prompt according to the modelfile works for now, just the profile pick and name is wrong and the extra settings.

Additional context My ollama instance has limited vram available. External services can provide bigger models. I think it would be good if the same characters would be usable when using an external service.

dannyl1u-doppelganger[bot] commented 4 months ago

Closed due to high similarity with issue #85 with title 'feat: collections/docs for modelfiles with models'

dannyl1u commented 4 months ago

issue #18