search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.23k stars 21.39k forks source link

Copy file size limit #47279

Closed mganeshphani closed 4 years ago

mganeshphani commented 4 years ago

the 15MB limit on the copy file is no longer a hard limit, looks like one of the project teams I work with successfully copied 45MB file

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

Mike-Ubezzi-MSFT commented 4 years ago

@mganeshphani Thank you for providing feedback with this level of detail. I will have the content team evaluate this information and make an update as appropriate.

mganeshphani commented 4 years ago

Thanks Mike

ecfan commented 4 years ago

@divyaswarnkar, please confirm? Thanks!

divyaswarnkar commented 4 years ago

@mganeshphani could you please confirm if this was SFTP-SSH connector ?

ecfan commented 4 years ago

Hi @mganeshphani, as @divyaswarnkar requested, please confirm that this behavior happened for you with the SFTP-SSH connector? Thanks!

mganeshphani commented 4 years ago

Yes this is SFTP-SSH connector

Get Outlook for Androidhttps://aka.ms/ghei36

ecfan commented 4 years ago

@divyaswarkar, could you please respond to this customer's question after they've confirmed using the SFTP-SSHconnector?

divyaswarnkar commented 4 years ago

@mganeshphani thanks for the confirmation. Your observation is valid, the copy file operation can transfer file size upto the size of the chunk which could be upto 50 MB. We are updating the documentation to correct the limits and clarify this behavior.

mganeshphani commented 4 years ago

Thankyou @divyaswarnkar .. it would be impossible for customers to ignore Logicapps for their solution by checking documentation. are your PM's we trying to make sure the docs are updated in a timely fashion?

divyaswarnkar commented 4 years ago

We are committed to providing our customers with continuous improvement in our offerings, including documentation.

ecfan commented 4 years ago

Hi @mganeshphani,

A doc update should appear today. Here's a preview:

SFTP-SSH actions that support chunking can handle files up to 1 GB, while SFTP-SSH actions that don't support chunking can handle files up to 50 MB. Although the default chunk size is 15 MB, this size can dynamically change, starting from 5 MB and gradually increasing to the 50 MB maximum, based on factors such as network latency, server response time, and so on.

[!NOTE] For logic apps in an integration service environment (ISE), this connector's ISE-labeled version uses the ISE message limits instead.

Chunk size is associated with a connection, which means that you can use the same connection for actions that support chunking and then for actions that don't support chunking. In this case, the chunk size for actions that don't support chunking ranges from 5 MB to 50 MB. This table shows which SFTP-SSH actions support chunking:

Action Chunking support
Copy file No
Create file Yes
Create folder Not applicable
Delete file Not applicable
Extract archive to folder Not applicable
Get file content Yes
Get file content using path Yes
Get file metadata Not applicable
Get file metadata using path Not applicable
List files in folder Not applicable
Rename file Not applicable
Update file No
ecfan commented 4 years ago

Hi @mganeshphani, this doc update is now live:

https://docs.microsoft.com/azure/connectors/connectors-sftp-ssh#limits

I hope this information helps explain the behavior that you're seeing. I'll now proceed with closing this issue, but if you have more questions about this subject, please tag me and @divyaswarnkar in your reply. We'll gladly continue the discussion and reopen the issue.

@Mike-Ubezzi-MSFT: #please-close