GPT-4o Global Standard stand

dto-btn / ssc-assistant

Second iteration of the SSC chatbot/assistant

MIT License

2 stars 1 forks source link

GPT-4o Global Standard stand #201

Open GuillaumeTurcotte opened 2 weeks ago

GuillaumeTurcotte commented 2 weeks ago

Summary

GPT-4o is currently on the of available model moving forward for Azure OpenAI however it is not deployed using a standard deployment, it's using global standard. This means:

Data at REST remains in location of service (Canada for us)
Data in transit might be "processed for inferencing in any Azure OpenAI location"

GuillaumeTurcotte commented 2 weeks ago

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/deployment-types#global-standard

GuillaumeTurcotte commented 2 weeks ago

CTO are currently discussing with mgmt to see if it's okay to use it as is or if there is a need to move to RTU in regional location.

GuillaumeTurcotte commented 1 week ago

As long as data is unclass it seems to be okay since only data in transit can have a different entry point.