Not strictly a requirement that the server be local, but since there is no setting for an API key it's assumed to be at least a private instance.
The main difference is that the provider is more configurable, allowing selection of chat or completion endpoints and a customisable prompt template (TBD whether this is useful).
The provider handles its own requests using httpx, which means it is not dependent on any specific provider's SDK being installed.
Not strictly a requirement that the server be local, but since there is no setting for an API key it's assumed to be at least a private instance.
The main difference is that the provider is more configurable, allowing selection of chat or completion endpoints and a customisable prompt template (TBD whether this is useful).
The provider handles its own requests using httpx, which means it is not dependent on any specific provider's SDK being installed.