Is your feature request related to a problem? Please describe.
As the modelfiles from the hub are pretty good, it would be nice if we could use also them with external models from openAI api compatible services.
Describe the solution you'd like
Option A:
When adding a modelfile, we could check that it should use a model from the external provider and select it.
Option B:
When selecting a modelfile, we should be able to exchange then the actual model to one from the external service.
Describe alternatives you've considered
Setting the default prompt according to the modelfile works for now, just the profile pick and name is wrong and the extra settings.
Additional context
My ollama instance has limited vram available. External services can provide bigger models. I think it would be good if the same characters would be usable when using an external service.
Is your feature request related to a problem? Please describe. As the modelfiles from the hub are pretty good, it would be nice if we could use also them with external models from openAI api compatible services.
Describe the solution you'd like Option A: When adding a modelfile, we could check that it should use a model from the external provider and select it. Option B: When selecting a modelfile, we should be able to exchange then the actual model to one from the external service.
Describe alternatives you've considered Setting the default prompt according to the modelfile works for now, just the profile pick and name is wrong and the extra settings.
Additional context My ollama instance has limited vram available. External services can provide bigger models. I think it would be good if the same characters would be usable when using an external service.