search

vmware-tanzu / velero-plugin-for-vsphere

Plugin to support Velero on vSphere
Other
58 stars 50 forks source link

Thin-provisioned VMDKs inflated during upload process #296

Open dacodas opened 3 years ago

dacodas commented 3 years ago

Overview

It appears that thin-provisioned VMDKs on the datastore are being inflated during upload process to S3-compatible storage.

Is there any roadmap to being able to upload the thin VMDKs or otherwise save space, or have I otherwise misunderstood?

You can see in the logs and the minio snapshot below that 3G has been uploaded whereas in the vSphere snapshot, the different disk components don't sum up to nearly that much.

minio-gateway

datastore-vmdks

Additional information

velero deployment images

image: velero/velero:v1.5.2
image: velero/velero-plugin-for-aws:v1.1.0
image: velero/velero-plugin-for-microsoft-azure:v1.1.0
image: vsphereveleroplugin/velero-plugin-for-vsphere:1.1.0
image: velero/velero-plugin-for-csi:v0.1.2

Persistent volume

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  labels:
    example-vsphere-csi-backup: "yes"
  name: example-vsphere-csi-v2-volume
  namespace: default
spec:
  accessModes:
  - ReadWriteOnce
  resources:
    requests:
      storage: 3Gi
  storageClassName: vsphere-csi-v2

Backup

apiVersion: velero.io/v1
kind: Backup
metadata:
  labels:
    velero.io/storage-location: minio-gateway
  name: example-vsphere-csi-v2-backup-2021-02-02t15-48-08-00
  namespace: backup
spec:
  defaultVolumesToRestic: true
  includedNamespaces:
  - default
  labelSelector:
    matchExpressions:
    - key: example-vsphere-csi-backup
      operator: Exists
  storageLocation: minio-gateway
  ttl: 720h0m0s
  volumeSnapshotLocations:
  - vsl-vsphere

minio pod and service

apiVersion: v1
kind: Pod
metadata:
  labels:
    run: minio-gateway
  name: minio-gateway
  namespace: backup
spec:
  containers:
  - args:
    - gateway
    - azure
    envFrom:
    - secretRef:
        name: minio-azure-credentials
    image: minio/minio
    imagePullPolicy: Always
    name: minio-gateway
---
apiVersion: v1
kind: Service
metadata:
  name: minio-gateway
  namespace: backup
spec:
  selector:
    run: minio-gateway
  ports:
    - protocol: TCP
      port: 80
      targetPort: 9000

BackupStorageLocation

apiVersion: velero.io/v1
kind: BackupStorageLocation
metadata:
  name: minio-gateway
  namespace: backup
spec:
  backupSyncPeriod: 2m0s
  provider: aws
  objectStorage:
    bucket: velero
    prefix: example-prefix
  config:
    region: minio
    s3ForcePathStyle: "true"
    s3Url: http://minio-gateway.backup.svc

    # AWS profile within the credentials file to use for the backup storage location.
    # This is mounted within the velero pod
    profile: default
dacodas commented 3 years ago 
time="2021-02-02T23:41:58Z" level=info msg="Starting data manager server 1.1.0-rc6 (b29517b6a79ced28d8d14d5ab69e38388fec259b-dirty)" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:112"
time="2021-02-02T23:41:58Z" level=info msg="data manager server is started" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:216"
time="2021-02-02T23:41:58Z" level=info msg="VC Configuration will be retrieved from cluster secret" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:237"
time="2021-02-02T23:41:58Z" level=info msg="SnapshotManager: vSphere VC credential is retrieved" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:120"
time="2021-02-02T23:41:58Z" level=info msg="Initializing IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:53"
time="2021-02-02T23:41:58Z" level=info msg="Loading new IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:58"
time="2021-02-02T23:41:58Z" level=info msg="Detected VirtualCenterConfig change during periodic reload." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:303"
time="2021-02-02T23:41:58Z" level=info msg="Attempting login for user: vsphere-velero@vsphere.local" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/virtual_center.go:164"
time="2021-02-02T23:41:58Z" level=info msg="New session ID for 'VSPHERE.LOCAL\\vsphere-velero' = 52e32a27-11a4-a93e-41bd-c78505923a12" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/virtual_center.go:151"
time="2021-02-02T23:41:58Z" level=info msg="Initializing VSLM Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:320"
time="2021-02-02T23:41:58Z" level=info msg="Initializing new VslmManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/vslm_manager.go:24"
time="2021-02-02T23:41:58Z" level=info msg="Initializing CNS Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:331"
time="2021-02-02T23:41:58Z" level=info msg="Initializing new CnsManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/cns_manager.go:20"
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Glibc malloc guards disabled.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Initialized SystemFactory
2021-02-02T23:41:59.148Z warning -[00009] [Originator@6876 sub=Default] Unrecognized log/level '' using 'info'
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Logging uses fast path: true
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Libs] DictionaryLoad: Cannot open file "/etc/vmware/vsphereFeatures/techPreview.cfg": No such file or directory.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Libs] [msg.dictionary.load.openFailed] Cannot open file "/etc/vmware/vsphereFeatures/techPreview.cfg": No such file or directory.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Libs] FeatureStateLib: Error while loading tech preview config file: /etc/vmware/vsphereFeatures/techPreview.cfg, using default (disabled) for all Tech Preview features.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] The bora/lib logs WILL be handled by VmaCore
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Initialized channel manager
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Current working directory: /
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Catch work item exceptions disabled.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=FairScheduler] Priority level 4 is now active.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=WorkQueue.vmacoreDefaultIOCompletionQueue] Created: WorkQueue.vmacoreDefaultIOCompletionQueue, type = fair, priority = 4, itemWeight = 1
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=FairScheduler] Priority level 8 is now active.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=WorkQueue.vmacoreDefaultIOQueue] Created: WorkQueue.vmacoreDefaultIOQueue, type = fair, priority = 8, itemWeight = 1
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=FairScheduler] Priority level 16 is now active.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=WorkQueue.vmacoreDefaultLongTaskQueue] Created: WorkQueue.vmacoreDefaultLongTaskQueue, type = fair, priority = 16, itemWeight = 1
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 1, idle: 0
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 2, idle: 0
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 3, idle: 0
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 4, idle: 0
2021-02-02T23:41:59.148Z info -[00018] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.148Z info -[00018] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00019] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00019] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00020] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00020] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00021] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00021] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00022] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00022] [Originator@6876 sub=ThreadPool] Entering IO thread loop
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=ThreadPool] Thread pool fair initial threads spawned. IO: 2, Min workers: 4, Max workers: 13, Reservation ratio: 9
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00023] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=Default] Syscommand enabled: true
2021-02-02T23:41:59.149Z info -[00023] [Originator@6876 sub=ThreadPool] Entering IO thread loop
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=Default] ReaperManager Initialized
2021-02-02T23:41:59.149Z info -[00024] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00024] [Originator@6876 sub=ThreadPool] Entering fair thread loop
2021-02-02T23:41:59.149Z info -[00018] [Originator@6876 sub=ThreadPool] Spawning additional worker - allocated: 5, idle: 0
time="2021-02-02T23:41:59Z" level=info msg="Initialized VDDK" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:346"
time="2021-02-02T23:41:59Z" level=info msg="Load Config of IVD Protected Entity Manager completed successfully." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:347"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager is initialized with the configuration: map[SnapshotManagerLocation:DataServer]" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:139"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager: Velero Backup Storage Location is retrieved, region=, bucket=velero" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:157"
time="2021-02-02T23:41:59Z" level=info msg="Got  for s3ForcePathStyle, setting s3ForcePathStyle to false" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/utils/utils.go:380"
time="2021-02-02T23:41:59Z" level=info msg="Created S3 repo type=ivd bucket=velero prefix=plugins/vsphere-astrolabe-repo/" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity_type_manager.go:70"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager: Get s3PETM from the params map" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:167"
time="2021-02-02T23:41:59Z" level=info msg="Registered External ProtectedEntityTypeManager: ivd" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/server/direct_protected_entity_manager.go:218"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager is initialized with the configuration: map[SnapshotManagerLocation:DataServer]" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:193"
time="2021-02-02T23:41:59Z" level=info msg="Initializing IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:53"
time="2021-02-02T23:41:59Z" level=info msg="Loading new IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:58"
time="2021-02-02T23:41:59Z" level=info msg="Detected VirtualCenterConfig change during periodic reload." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:303"
time="2021-02-02T23:41:59Z" level=info msg="Attempting login for user: vsphere-velero@vsphere.local" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/virtual_center.go:164"
time="2021-02-02T23:41:59Z" level=info msg="New session ID for 'VSPHERE.LOCAL\\vsphere-velero' = 526c2900-f704-74c5-2adf-e472e8dd305c" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/virtual_center.go:151"
time="2021-02-02T23:41:59Z" level=info msg="Initializing VSLM Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:320"
time="2021-02-02T23:41:59Z" level=info msg="Initializing new VslmManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/vslm_manager.go:24"
time="2021-02-02T23:41:59Z" level=info msg="Initializing CNS Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:331"
time="2021-02-02T23:41:59Z" level=info msg="Initializing new CnsManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/common/vsphere/cns_manager.go:20"
time="2021-02-02T23:41:59Z" level=info msg="Initialized VDDK" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:346"
time="2021-02-02T23:41:59Z" level=info msg="Load Config of IVD Protected Entity Manager completed successfully." logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/ivd/ivd_protected_entity_type_manager.go:347"
time="2021-02-02T23:41:59Z" level=info msg="DataMover: Get ivdPETM from the params map" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:60"
time="2021-02-02T23:41:59Z" level=info msg="DataMover is initialized" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:71"
time="2021-02-02T23:41:59Z" level=info msg="data manager server is up and running" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:163"
time="2021-02-02T23:41:59Z" level=info msg="Checking existence of namespace" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:303" namespace=backup
time="2021-02-02T23:41:59Z" level=info msg="Namespace exists" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:309" namespace=backup
time="2021-02-02T23:41:59Z" level=info msg="Starting data manager controllers" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:327"
time="2021-02-02T23:41:59Z" level=info msg="Registering controllers" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:332"
time="2021-02-02T23:41:59Z" level=info msg="Watching for vc config secret changes." logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:355"
W0202 23:41:59.271937       1 shared_informer.go:432] The specified resyncPeriod 5m0s is invalid because this shared informer doesn't support resyncing
time="2021-02-02T23:41:59Z" level=info msg="Server started successfully" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:385"
time="2021-02-02T23:41:59Z" level=info msg="Starting controller" controller=vc-config logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:77"
time="2021-02-02T23:41:59Z" level=info msg="Waiting for caches to sync" controller=vc-config logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:80"
time="2021-02-02T23:41:59Z" level=info msg="Starting controller" controller=upload logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:77"
time="2021-02-02T23:41:59Z" level=info msg="Waiting for caches to sync" controller=upload logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:80"
time="2021-02-02T23:41:59Z" level=info msg="Starting controller" controller=download logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:77"
time="2021-02-02T23:41:59Z" level=info msg="Waiting for caches to sync" controller=download logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:80"
time="2021-02-02T23:41:59Z" level=info msg="Caches are synced" controller=upload logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:84"
time="2021-02-02T23:41:59Z" level=info msg="Caches are synced" controller=vc-config logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:84"
time="2021-02-02T23:41:59Z" level=info msg="Caches are synced" controller=download logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:84"
2021/02/02 23:48:54 pei = ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f
I0202 23:48:55.046764       1 leaderelection.go:242] attempting to acquire leader lease  backup/upload-lease.upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f...
I0202 23:48:55.060668       1 leaderelection.go:252] successfully acquired lease backup/upload-lease.upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f
time="2021-02-02T23:48:55Z" level=info msg="Lock is acquired by current node - vaultdev-0 to process Upload upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f." controller=upload key=backup/upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/upload_controller.go:255"
time="2021-02-02T23:48:55Z" level=info msg="Upload starting" controller=upload generation=1 logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/upload_controller.go:279" name=upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f namespace=backup phase=New snapshotID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f"
2021/02/02 23:48:55 pei = ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f
time="2021-02-02T23:48:55Z" level=info msg="Upload status updated from New to InProgress" controller=upload generation=1 logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/upload_controller.go:497" name=upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f namespace=backup phase=New snapshotID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f"
2021/02/02 23:48:55 pei = ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f
time="2021-02-02T23:48:55Z" level=info msg="Using explicitly found credentials for S3 repository access." logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/utils/utils.go:357"
time="2021-02-02T23:48:55Z" level=info msg="Got true for s3ForcePathStyle, setting s3ForcePathStyle to true" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/utils/utils.go:377"
time="2021-02-02T23:48:55Z" level=info msg="Created S3 repo type=ivd bucket=velero prefix=plugins/vsphere-astrolabe-repo/" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity_type_manager.go:70"
time="2021-02-02T23:48:55Z" level=info msg="Copying the snapshot from local to remote repository" Local PEID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:103"
time="2021-02-02T23:48:55Z" level=info msg="Registering a in-progress cancel function." Local PEID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:111"
time="2021-02-02T23:48:55Z" level=info msg="Registered a on-going cancel function." PEID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:227"
2021-02-02T23:48:55.495Z warning -[00030] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:55.504Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
2021-02-02T23:48:55.608Z warning -[00025] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:55.618Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
2021-02-02T23:48:56.086Z warning -[00021] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:56.092Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
2021-02-02T23:48:56.145Z warning -[00020] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:56.156Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
time="2021-02-02T23:48:57Z" level=info msg="Found 0 existing segments for bucket: velero name: plugins/vsphere-astrolabe-repo/ivd/data/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.data" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:228"
time="2021-02-02T23:48:57Z" level=info msg="Upload ongoing, Part: 0 Bytes Uploaded: 0 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-02T23:48:57Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=10485760\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-02T23:48:58Z" level=info msg="Upload ongoing, Part: 1 Bytes Uploaded: 10 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-02T23:48:58Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=20971520\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-02T23:48:59Z" level=info msg="Upload ongoing, Part: 2 Bytes Uploaded: 20 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-02T23:48:59Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=31457280\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-02T23:48:59Z" level=info msg="Upload ongoing, Part: 3 Bytes Uploaded: 30 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:384"

...

time="2021-02-03T00:07:47Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=3208642560\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:07:50Z" level=info msg="Upload ongoing, Part: 306 Bytes Uploaded: 3060 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-03T00:07:50Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=3219128320\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:07:54Z" level=info msg="Upload ongoing, Part: 307 Bytes Uploaded: 3070 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-03T00:07:54Z" level=info msg="Read returning 2097152, len(p) = 10485760, offset=3221225472\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:07:54Z" level=info msg="Read returning 0, len(p) = 8388608, offset=3221225472\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:08:32Z" level=info msg="Segment upload completed: {\n  Bucket: \"velero\",\n  ETag: \"\\\"4724f324181272882033a41b2c5279ec-308\\\"\",\n  Key: \"plugins/vsphere-astrolabe-repo/ivd/data/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.data/000000-0000000000000000\",\n  Location: \"http://minio-gateway.backup.svc/velero/plugins/vsphere-astrolabe-repo/ivd/data/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.data/000000-0000000000000000\"\n}" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:507"
time="2021-02-03T00:08:32Z" level=info msg="Found 0 existing segments for bucket: velero name: plugins/vsphere-astrolabe-repo/ivd/md/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.md" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:228"
time="2021-02-03T00:08:32Z" level=info msg="Upload ongoing, Part: 0 Bytes Uploaded: 0 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-03T00:08:33Z" level=info msg="Successfully uploaded to%!(EXTRA string=http://minio-gateway.backup.svc/velero/plugins/vsphere-astrolabe-repo/ivd/md/ivd%3A1fe29249-ba03-44da-b01c-58129c5d23aa%3A323ee907-c5e3-4947-8dfc-73ddfa8e006f.md/000000-0000000000000000)" logSource="/go/pkg/mod/github.com/vmware-tanzu/astrolabe@v0.2.0/pkg/s3repository/repository_protected_entity.go:411"
lintongj commented 3 years ago

Is there any roadmap to being able to upload the thin VMDKs or otherwise save space, or have I otherwise misunderstood?

Your observation is expected. Currently, only full backup is supported. Uploading thin VMDKs or incremental changes of VMDKs will fall into the category of the incremental backup support. We do plan to support the incremental backup. But currently, there is no any concrete plan yet.

vytasvy commented 3 years ago

Is the compression of VMDK backup supported? Would be strange not to have it.

lintongj commented 3 years ago

Is the compression of VMDK backup supported? Would be strange not to have it.

velero-plugin-for-vsphere is still growing and doesn't support it for now.