There is a lack of samples and examples on how to use Azure Data Share in an automated way. In a scenario where a company wants to share data with another company, the Data Share service makes it very easy accomplish that goal but the actual process of setting up the data share involves a lot of steps:
creating a data share on an origin Azure Data Share account
creating a data share on a destination Azure Data Share account
creating a dataset to be shared on the source data share account (ADLS as an example)
sending an invitation to an email address or a service principal
accepting the invitation and creating a share subscription on the destination data share account - this step is manual unless a service principal is the recipient of the invitation
mapping the incoming dataset to a destination ADLS file system
Sending an invitation to a service principal allows to fully automate the scenario on both the source and destination as we can have an Azure Function ready to accept invitations sent to a specific service principal or its managed identity.
While this is discoverable by exploring the Invitations API, it is not trivial to implement.
Proposed Solution
A working sample of a fully automated Azure Data share process under /single_tech_samples/datashare that fully implements the steps outlined above and includes step-by-step documentation on how to run the code and adapt it to other scenarios.
Additional Context
I already have a full working sample written in Python that includes simple scripts for sending/receiving invitations and an Azure Function that automates the invitation acceptance and mapping of the incoming data in a destination Data Share account. I will submit it as a PR if this is accepted.
Problem Statement
There is a lack of samples and examples on how to use Azure Data Share in an automated way. In a scenario where a company wants to share data with another company, the Data Share service makes it very easy accomplish that goal but the actual process of setting up the data share involves a lot of steps:
Sending an invitation to a service principal allows to fully automate the scenario on both the source and destination as we can have an Azure Function ready to accept invitations sent to a specific service principal or its managed identity.
While this is discoverable by exploring the Invitations API, it is not trivial to implement.
Proposed Solution
A working sample of a fully automated Azure Data share process under
/single_tech_samples/datasharethat fully implements the steps outlined above and includes step-by-step documentation on how to run the code and adapt it to other scenarios.Additional Context
I already have a full working sample written in Python that includes simple scripts for sending/receiving invitations and an Azure Function that automates the invitation acceptance and mapping of the incoming data in a destination Data Share account. I will submit it as a PR if this is accepted.
Next Steps