search

Azure / azure-sdk

This is the Azure SDK parent repository and mostly contains documentation around guidelines and policies as well as the releases for the various languages supported by the Azure SDK.
http://azure.github.io/azure-sdk
MIT License
472 stars 291 forks source link

Azure SDK Review - [Introduction to MaaS Client Library (SDK)] #7385

Open azure-sdk opened 3 months ago

azure-sdk commented 3 months ago

New SDK Review meeting has been requested.

Service Name: MaaS Client Library (SDK) Review Created By: Darren Cohen Review Date: 04/11/2024 02:05 PM PT

Release Plan:1253 Hero Scenarios Link: Not Provided Architecture Diagram Link: Not Provided Core Concepts Doc Link: Not Provided APIView Links:

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

Detailed meeting information and documents provided can be accessed here

azure-sdk commented 3 months ago

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK) Review Created By: Darren Cohen Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here Architecture Diagram Link: Not Provided Core Concepts Doc Link: here APIView Links:

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

Detailed meeting information and documents provided can be accessed here

azure-sdk commented 3 months ago

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK) Review Created By: Darren Cohen Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here Architecture Diagram Link: Not Provided Core Concepts Doc Link: here APIView Links:

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

TypeSpec PR: https://github.com/Azure/azure-rest-api-specs/pull/28438 Python client library PR: https://github.com/Azure/azure-sdk-for-python/pull/34937

Detailed meeting information and documents provided can be accessed here

azure-sdk commented 3 months ago

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK) Review Created By: Darren Cohen Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here Architecture Diagram Link: Not Provided Core Concepts Doc Link: here APIView Links: Python,

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

TypeSpec PR: https://github.com/Azure/azure-rest-api-specs/pull/28438 Python client library PR: https://github.com/Azure/azure-sdk-for-python/pull/34937

Detailed meeting information and documents provided can be accessed here

azure-sdk commented 2 months ago

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK) Review Created By: Darren Cohen Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here Architecture Diagram Link: Not Provided Core Concepts Doc Link: here APIView Links: Python,

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through formal review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

TypeSpec PR: https://github.com/Azure/azure-rest-api-specs/pull/28438

Python client library PR: https://github.com/Azure/azure-sdk-for-python/pull/34937

A few slides I will show at the start of the meeting: https://microsoft-my.sharepoint.com/:p:/p/dcohen/EejE6eAFKMtNqDncs6FAZ3gBbEaXXwfA1TLaUCsePPbbFQ?e=btDPst

Detailed meeting information and documents provided can be accessed here