Implement the first release version of akasha-whisper as an OpenAI compatible service endpoint provider
Reference: [akasha-whisper]
Summary
Implement the initial version of the Akasha-Whisper backend component, which will be compatible with OpenAI APIs. This component will interact with the Akasha-Agent and will include API key validation, user permission checks, and an automatic multi-service endpoint rotation mechanism to optimize cost and availability.
Function expected
Successfully validate API keys and user permissions.
Return appropriate error messages in the choice field of the chat/complete endpoint when permissions are invalid.
Implement a mechanism to automatically select the most cost-effective and available OpenAI-compatible service endpoint.
Notify developers when the balance of any service provider falls below a specified threshold.
Logic of service endpoint rotation mechanism
Implement the logic to choose the most cost-effective service provider under normal conditions.
Develop a weighted round-robin mechanism based on the balance-to-price ratio of each service provider.
Implement retry logic to switch to the next provider if the current one is unavailable, up to a configured number of retries.
Return an error message if all retries are exhausted.
Implement a notification system to alert developers when a provider's balance falls below a set threshold.
Implement the first release version of akasha-whisper as an OpenAI compatible service endpoint provider
Reference: [akasha-whisper]
Summary
Implement the initial version of the Akasha-Whisper backend component, which will be compatible with OpenAI APIs. This component will interact with the Akasha-Agent and will include API key validation, user permission checks, and an automatic multi-service endpoint rotation mechanism to optimize cost and availability.
Function expected
Logic of service endpoint rotation mechanism