search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.28k stars 21.47k forks source link

Need Azure Data Lake Store Gen2 #41150

Closed sthoward0914 closed 4 years ago

sthoward0914 commented 5 years ago

We really need to call out the capacity (or unlimited capacity) for Azure Data Lake Gen2. We're out of preview with this now, and there is a lot of confusion on whether or not it has unlimited storage specifically because you provision it as Azure Storage which definitely DOES have a capacity limit. It is finding its way to errant teaching by instructors as well.

About the only place I find it called out as unlimited capacity is in James Serra's blog - I can't find it in our documentation at all. It's left completely ambiguous and our documentation just seems to dance around definitively answering the question people have which is "Is there a maximum capacity for Azure Data Lake Storage Gen2 account? Can I store very large files in an Azure Data Lake Storage Gen2 account?"

Can we please answer this in a document about Azure capacities?

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

VikasPullagura-MSFT commented 5 years ago

@sthoward0914 Thanks for the feedback! We are currently investigating and will update you shortly.

ChiragMishra-MSFT commented 5 years ago

@sthoward0914 Please refer the following doc for the limits for Storage accounts (including Data Lake Store Gen2) : https://docs.microsoft.com/en-us/azure/storage/common/storage-scalability-targets#storage-account-scale-limits Please note that these are default limits and can be expanded by raising a support request.

sthoward0914 commented 5 years ago

Here's the problem: Azure Data Lake Gen 2 is only mentioned one time in this article, and that mention is not about storage capacity. Nothing calls out a storage capacity for it.

Steve

Get Outlook for Androidhttps://aka.ms/ghei36

From: ChiragMishra-MSFT notifications@github.com Sent: Wednesday, October 23, 2019 2:42:32 AM To: MicrosoftDocs/azure-docs azure-docs@noreply.github.com Cc: Steve Howard sthoward@microsoft.com; Mention mention@noreply.github.com Subject: Re: [MicrosoftDocs/azure-docs] Need Azure Data Lake Store Gen2 (#41150)

@sthoward0914https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsthoward0914&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539069989&sdata=vxR5uDkqbhNwAUPvV4c3CZYout%2F%2FdlXQhLoF%2FAGBCNw%3D&reserved=0 Please refer the following doc for the limits for Storage accounts (including Data Lake Store Gen2) : https://docs.microsoft.com/en-us/azure/storage/common/storage-scalability-targets#storage-account-scale-limitshttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fstorage%2Fcommon%2Fstorage-scalability-targets%23storage-account-scale-limits&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539079987&sdata=8UyGr9gNWNmK8YuZ1vkykrh%2B1%2Beb8iU5CXAk82P4R84%3D&reserved=0 Please note that these are default limits and can be expanded by raising a support request.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fazure-docs%2Fissues%2F41150%3Femail_source%3Dnotifications%26email_token%3DAB7KXECZMOLKDAKDN3ROMATQQAMARA5CNFSM4JDCGYE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECAYX5I%23issuecomment-545360885&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539079987&sdata=3DswYIsxIi9jme9uNnsoqX4g8f2uQQWiSrALNCPhMhM%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAB7KXEAOIXEHYPJEA3FNRA3QQAMARANCNFSM4JDCGYEQ&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539089977&sdata=UL9bMwuNlpVi5IEs7RLk9GYXHx0WES3c2zKzR7QU08s%3D&reserved=0.

sthoward0914 commented 5 years ago

The point I'm making is that, at best, it is ambiguous whether or not that article applies to ADLS Gen 2. From blog entries from our community to other discussions with other Microsoft employees, I can tell you with absolute certainty: People ARE NOT SURE. If that capacity applies to ADLS Gen 2, then we need to specify that IN THIS ARTICLE, and we have a few contradictions with other articles that we need to address. If those limits do not apply to ADLS Gen 2 (which seems to be the predominant view from the community), then we need a section that gives the limits for ADLS Gen 2.

It's a simple fix in the documentation either way. It addresses a big uncertainty among the consumers of the documentation.

Thank you,

Steve

From: Steve Howard sthoward@microsoft.com Sent: Wednesday, October 23, 2019 6:47 AM To: MicrosoftDocs/azure-docs reply@reply.github.com; MicrosoftDocs/azure-docs azure-docs@noreply.github.com Cc: Mention mention@noreply.github.com Subject: Re: [MicrosoftDocs/azure-docs] Need Azure Data Lake Store Gen2 (#41150)

Here's the problem: Azure Data Lake Gen 2 is only mentioned one time in this article, and that mention is not about storage capacity. Nothing calls out a storage capacity for it. Steve Get Outlook for Androidhttps://aka.ms/ghei36

From: ChiragMishra-MSFT notifications@github.com<mailto:notifications@github.com> Sent: Wednesday, October 23, 2019 2:42:32 AM To: MicrosoftDocs/azure-docs azure-docs@noreply.github.com<mailto:azure-docs@noreply.github.com> Cc: Steve Howard sthoward@microsoft.com<mailto:sthoward@microsoft.com>; Mention mention@noreply.github.com<mailto:mention@noreply.github.com> Subject: Re: [MicrosoftDocs/azure-docs] Need Azure Data Lake Store Gen2 (#41150)

@sthoward0914https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsthoward0914&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539069989&sdata=vxR5uDkqbhNwAUPvV4c3CZYout%2F%2FdlXQhLoF%2FAGBCNw%3D&reserved=0 Please refer the following doc for the limits for Storage accounts (including Data Lake Store Gen2) : https://docs.microsoft.com/en-us/azure/storage/common/storage-scalability-targets#storage-account-scale-limitshttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fstorage%2Fcommon%2Fstorage-scalability-targets%23storage-account-scale-limits&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539079987&sdata=8UyGr9gNWNmK8YuZ1vkykrh%2B1%2Beb8iU5CXAk82P4R84%3D&reserved=0 Please note that these are default limits and can be expanded by raising a support request.

- You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fazure-docs%2Fissues%2F41150%3Femail_source%3Dnotifications%26email_token%3DAB7KXECZMOLKDAKDN3ROMATQQAMARA5CNFSM4JDCGYE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECAYX5I%23issuecomment-545360885&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539079987&sdata=3DswYIsxIi9jme9uNnsoqX4g8f2uQQWiSrALNCPhMhM%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAB7KXEAOIXEHYPJEA3FNRA3QQAMARANCNFSM4JDCGYEQ&data=02%7C01%7Csthoward%40microsoft.com%7C95dd3223167b40c7b54d08d7579d53f9%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637074205539089977&sdata=UL9bMwuNlpVi5IEs7RLk9GYXHx0WES3c2zKzR7QU08s%3D&reserved=0.

ChiragMishra-MSFT commented 5 years ago

@sthoward0914 I understand the ambiguity. I am assigning the issue to the content owner to review and update as appropriate.

Thanks again for bringing this to our notice.

SamirFarhat commented 4 years ago

Bump

normesta commented 4 years ago

Thank you @sthoward0914 for raising this. The article Scalability and performance targets for standard storage accounts has been updated to apply to Data Lake Storage Gen2 as well. Thank you!

normesta commented 4 years ago

please-close