search

RemainSoftware / AiChat

Issue tracker for the Remain Ai Chat Client
4 stars 0 forks source link

Alter the endpoints to custom endpoints for Azure #13

Open ITMentalist opened 1 year ago

ITMentalist commented 1 year ago

Hi Wim,

Is it possible to alter the endpoints to non OpenAPI endpoints?

(corporate policies that are blocking the Open API endpoints might have custom endpoints)

wimjongman commented 1 year ago

Do you mean OpenAI?

It is a good idea! We will implement it in the preferences.

ITMentalist commented 1 year ago

yes Azure's OpenAI instances (private instances)

wimjongman commented 1 year ago

This is fixed. Please update! Thanks for reporting.

ITMentalist commented 1 year ago

wim,

finally managed to get access.

Problem with the api's that is appending the completions tag ( image

Config: image

Reference to this URL: https://learn.microsoft.com/en-us/azure/ai-services/openai/quickstart?pivots=rest-api&tabs=command-line (look at command line python example)

I assume the path needs to be :

https://XXXXXCOMPANYXXXXX.openai.azure.com/openai/deployments/completions?api-version=2023-05-15 (also note the API-VERSION query Parameter)

and not : https://XXXXXCOMPANYXXXXX.openai.azure.com/openai/deployments/completions?api-version=2023-05-15/chat/completions

lastly, I think only the ORG KEY is needed for custom endpoint (but not sure in your code). can we make it either OR situation?

wimjongman commented 11 months ago

Did you get this to work? Looking at the Azure docs you provided, only the API_KEY is needed not the org. You might get away by using any org key. I have just updated the code to not care about an org key if it is not filled in.

ITMentalist commented 11 months ago

Hi Wim,

didn't look at it again for a few months back, I have tried again , not seeing any errors after update except this

image

settings as : image

Question: is there a way to log exactly what is going to OpenAPI Azure Endpoint? (HTTP Request / Response?) somewhere?

wimjongman commented 11 months ago

Yes, please run Eclipse like outlined in the comment below.

https://github.com/RemainSoftware/AiChat/issues/14#issuecomment-1766797046

ITMentalist commented 10 months ago

Hi Wim,

I started Eclipse as suggested in #14 , though I cant find any errors generated in the log on settings page: image

Is there a different Log location where I should look ?

Tx

wimjongman commented 10 months ago

It should be dumped in your command line window.

ITMentalist commented 10 months ago

no dice still unfortunately. image

is there perhaps something else that I need to do on RDI 9.6 version?

wimjongman commented 10 months ago

Ok, we got accepted as Azure service providers. We will work on this. Please allow us a week or so to get this sorted.