search

microsoft / AzureTRE

An accelerator to help organizations build Trusted Research Environments on Azure.
https://microsoft.github.io/AzureTRE
MIT License
169 stars 133 forks source link

Azure Open AI deployability as a workspace service within Azure TRE #3810

Open andrewsoltan opened 6 months ago

andrewsoltan commented 6 months ago

Requesting ability to deploy the Azure OpenAI service as a service (e.g. as a workspace service) within an Azure TRE workspace, including secure networking within the TRE boundary

marrobi commented 6 months ago

@SvenAelterman was any progress made by your team in finding resource to do this? I know it was on a list somewhere.

If not @andrewsoltan have you people who could build this out with our assistance? What's the timescales you need this within?

andrewsoltan commented 6 months ago

Thanks all- we would be hoping to use this for a project funded by the MSR Accelerating Foundation models research grant (https://www.microsoft.com/en-us/research/collaboration/accelerating-foundation-models-research/phase-ii/ ) with an end date of end-Jan 2024, but appreciate that's quite tight! Including @JaimieWi too for info

SvenAelterman commented 6 months ago

This did not make it in our scope, unfortunately.

marrobi commented 6 months ago

@JaimieWi if I make a start on something are you able to test and refine so we can hopefully get it merged into the project?

SvenAelterman commented 6 months ago

I would be happy to participate too. I don't have the availability to do the whole thing, but happy to test and review and help with design.

JaimieWi commented 6 months ago

@marrobi Yes, very happy to help where I can

marrobi commented 6 months ago

Ok, I've made a start here - https://github.com/microsoft/AzureTRE/pull/3812

I can't test myself due to subscription limits - I have no OpenAI capacity where I have my TRE deployed (and I'm currently travelling), but hopefully enough for @JaimieWi and @SvenAelterman to give it a test and feedback.

martysharkey commented 1 month ago

@marrobi did this get completed?

marrobi commented 1 month ago

@martysharkey I'm not sure if it got tested/used by @JaimieWi ?

It needs picking up at some point in the future, testing and merging into the repo.

JaimieWi commented 1 month ago

Hi @marrobi @martysharkey Apologies, we didn't get time to work on this and the team had to move onto other projects. I'm not sure when/if we'll be able to pick it up.

martysharkey commented 1 month ago

thanks both.