search

Azure / azure-cli-extensions

Public Repository for Extensions of Azure CLI.
https://docs.microsoft.com/en-us/cli/azure
MIT License
383 stars 1.24k forks source link

Stream blob upload OOM #5107

Open baelter opened 2 years ago

baelter commented 2 years ago

Trying to use this now, and the az process is OOMing even with a tiny "length"

Related command

pg_basebackup -D - -X fetch --format tar --gzip --compress=3 --max-rate 2M | \
  az storage blob upload --data @- --length 1024 -c wal -n $(hostname -s)/base.tar.gz

The pg_basebackup process uses 8MB, and az is growing indefinitely until OOM killed (at 2GB on the current VM)

Extension name (the extension in question)

storage-blob-preview

Originally posted here, but extracted to separate issue.

yonzhan commented 2 years ago

storage

ghost commented 2 years ago

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @xgithubtriage.

Issue Details
Trying to use this now, and the az process is OOMing even with a tiny "length" ### Related command ``` pg_basebackup -D - -X fetch --format tar --gzip --compress=3 --max-rate 2M | \ az storage blob upload --data @- --length 1024 -c wal -n $(hostname -s)/base.tar.gz ``` The pg_basebackup process uses 8MB, and az is growing indefinitely until OOM killed (at 2GB on the current VM) ### Extension name (the extension in question) storage-blob-preview Originally posted [here](https://github.com/Azure/azure-cli-extensions/pull/2799#issuecomment-1172221947), but extracted to separate issue.
Author: baelter
Assignees: evelyn-ys
Labels: `customer-reported`, `Storage`, `Service Attention`, `Auto-Assign`, `Azure CLI Team`
Milestone: Backlog