search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.28k stars 21.47k forks source link

Not able to set Input with my blob storage account #34803

Closed vikrantminhas closed 5 years ago

vikrantminhas commented 5 years ago

I keep getting this error while trying to add input stream from my blob storage, Feature or property 'partitionKey' is not supported in API version 2018-11-01. Please use API version 2017-04-01-preview. Can you please help in setting up the input correctly?

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

kobulloc-MSFT commented 5 years ago

@vikrantminhas Thank you for the feedback! We are investigating this and will get back to you shortly.

vikrantminhas commented 5 years ago

Thanks for looking into the issue.

Here are some addition details about my blob storage is generated in this format

Path prefix microsoft authenticator ios - store_6385e6d87ad84642b21853eed0eecf76/Event/{date}/{time} Date format is YYYY-MM-DD

My goal is to move this data from Application Insights to AzureDateLake storage. Thanks Vikrant From: kobulloc-MSFT notifications@github.com Sent: Tuesday, July 9, 2019 4:36 PM To: MicrosoftDocs/azure-docs azure-docs@noreply.github.com Cc: Vikrant Minhas vikrantm@microsoft.com; Mention mention@noreply.github.com Subject: Re: [MicrosoftDocs/azure-docs] Not able to set Input with my blob storage account (#34803)

@vikrantminhashttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fvikrantminhas&data=02%7C01%7Cvikrantm%40microsoft.com%7C18e32e9ba98349ecf9ae08d704c63246%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636983121609296545&sdata=KA8JEd%2B%2BRHMhO8J0cg8EYJZ%2BvJASZtiE5gev%2FvipLmw%3D&reserved=0 Thank you for the feedback! We are investigating this and will get back to you shortly.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fazure-docs%2Fissues%2F34803%3Femail_source%3Dnotifications%26email_token%3DADSLACEU455PYBL723ROQ2TP6UOF5A5CNFSM4H7J2I62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODZR2ZJY%23issuecomment-509848743&data=02%7C01%7Cvikrantm%40microsoft.com%7C18e32e9ba98349ecf9ae08d704c63246%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636983121609306544&sdata=gsxZ2nk1e8DukCmcRV3AjXoDGBxeTF8vv777zd3Vipg%3D&reserved=0, or mute the threadhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FADSLACESITCDMR57KUWXBZ3P6UOF5ANCNFSM4H7J2I6Q&data=02%7C01%7Cvikrantm%40microsoft.com%7C18e32e9ba98349ecf9ae08d704c63246%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636983121609306544&sdata=HpjLe%2FOa7bC0MPavQuyuHioUetYdI3zkNkJcxcCBfDs%3D&reserved=0.

donschia commented 5 years ago

Vikrant, I was able to resolve this by changing the Compatibility Level to 1.2 (preview). It is on the side menu under Configure. Then I had to recreate my Stream Input and this time it had a Partition Key field that I left blank.
Cheers! Don

vikrantminhas commented 5 years ago

Thanks Don, you suggestion unblocked me on the fixing the Input stream. However I couldn’t use the stream analytics as my output is an ADL stream in different Tenant. Looks like stream analytics only supports this type of data move with in same Tenants only.

Appreciate you help, I will try to see if I can somehow use Azure Data Factory to copy blobs data into our ADL cluster. I just need some in between functionality to rename the blobs from GUID prefix to some Date or Num prefix for ADL to consume it.

Thanks Vikrant

From: donschia notifications@github.com Sent: Thursday, July 11, 2019 8:11 AM To: MicrosoftDocs/azure-docs azure-docs@noreply.github.com Cc: Vikrant Minhas vikrantm@microsoft.com; Mention mention@noreply.github.com Subject: Re: [MicrosoftDocs/azure-docs] Not able to set Input with my blob storage account (#34803)

Vikrant, I was able to resolve this by changing the Compatibility Level to 1.2 (preview). It is on the side menu under Configure. Then I had to recreate my Stream Input and this time it had a Partition Key field that I left blank. Cheers! Don

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fazure-docs%2Fissues%2F34803%3Femail_source%3Dnotifications%26email_token%3DADSLACFTLFEZ25H5TZSCFB3P65EPDA5CNFSM4H7J2I62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODZXAMQQ%23issuecomment-510527042&data=02%7C01%7Cvikrantm%40microsoft.com%7Cde399cf39db54dc42f7008d70611f140%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636984546440804382&sdata=kfWCS499jKBHneNgpAr5D%2BwzYJqi5dZIHblepmdfz2Y%3D&reserved=0, or mute the threadhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FADSLACBZM3KJJRZ7TRUZPH3P65EPDANCNFSM4H7J2I6Q&data=02%7C01%7Cvikrantm%40microsoft.com%7Cde399cf39db54dc42f7008d70611f140%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636984546440814378&sdata=FXhQVUVwBiP8PIemR3DdrU%2FW8ZoXYGIAPcNK40%2F2vb4%3D&reserved=0.

kobulloc-MSFT commented 5 years ago

@vikrantminhas Unfortunately, you are correct in that you cannot use another tenant:

https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-managed-identities-adls#limitations

Multi-tenant access: The Service principal created for a given Stream Analytics job will reside on the Azure Active Directory tenant on which the job was created, and cannot be used against a resource that resides on a different Azure Active Directory tenant. Therefore, you can only use MSI on ADLS Gen 1 resources that are within the same Azure Active Directory tenant as your Azure Stream Analytics job.

If you need additional help configuring your setup, please feel free to reach out to us on the MSDN forums, or on Stack Overflow. We monitor these forums and would be happy to help you.

We are going to close this thread as resolved but if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.