Ahmadre
commented
3 years ago I forgot to post my HELM-Values here:
#image:
# tag: v1.4.3
initContainers:
- name: velero-plugin-for-aws
image: velero/velero-plugin-for-aws:v1.1.0
imagePullPolicy: IfNotPresent
volumeMounts:
- mountPath: /target
name: plugins
configuration:
provider: aws
backupStorageLocation:
name: backups
bucket: saverso
config:
region: s3-de-central
s3Url: "https://s3-de-central.profitbricks.com:443"
s3ForcePathStyle: true
volumeSnapshotLocation:
name: backups
config:
region: s3-de-central
snapshotLocation: backups
logLevel: error
logFormat: json
defaultVolumesToRestic: true
credentials:
name: credentials
secretContents:
cloud: |
[backups]
aws_access_key_id=xxx
aws_secret_access_key=xxxxxx
extraSecretRef: velero
schedules:
saversobackup:
schedule: "0 3 * * *"
template:
includeClusterResources: true
storageLocation: backups
snapshotVolumes: true
ttl: "240h0m0s"
includedResources:
- '*'
includedNamespaces:
- '*'
zubron
rajeevpadinharepattu
helletheone
pborn-ionos
What steps did you take and what happened: I managed to connect to my IONOS S3 Bucket via AWS-Plugin from velero, but somehow it is partially failing and I can't backup my Persistent-Volumes via snapshotting.
What did you expect to happen: Persistent Volumes land on IONOS and gets backuped.
The output of the following commands will help us better understand what's going on: (Pasting long output into a GitHub gist or other pastebin is fine.)
Logs
kubectl logs deployment/velero -n velero:Click to expand
```bash time="2021-03-13T01:57:39Z" level=info msg="setting log-level to INFO" logSource="pkg/cmd/server/server.go:191" time="2021-03-13T01:57:39Z" level=info msg="Starting Velero server v1.5.3 (123109a3bcac11dbb6783d2758207bac0d0817cb)" logSource="pkg/cmd/server/server.go:193" time="2021-03-13T01:57:39Z" level=info msg="No feature flags enabled" logSource="pkg/cmd/server/server.go:197" time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/crd-remap-version time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/pod time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/pv time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/service-account time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/add-pv-from-pvc time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/add-pvc-from-pod time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/change-pvc-node-selector time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/change-storage-class time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/cluster-role-bindings time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/crd-preserve-fields time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/init-restore-hook time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/job time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/pod time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/restic time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/role-bindings time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/service time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/service-account time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/plugins/velero-plugin-for-aws kind=VolumeSnapshotter logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/aws time="2021-03-13T01:57:39Z" level=info msg="registering plugin" command=/plugins/velero-plugin-for-aws kind=ObjectStore logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/aws time="2021-03-13T01:57:40Z" level=info msg="Checking existence of namespace." logSource="pkg/cmd/server/server.go:380" namespace=velero time="2021-03-13T01:57:40Z" level=info msg="Namespace exists" logSource="pkg/cmd/server/server.go:386" namespace=velero I0313 01:57:43.125947 1 request.go:621] Throttling request took 1.029003727s, request: GET:https://10.233.0.1:443/apis/rbac.authorization.k8s.io/v1?timeout=32s time="2021-03-13T01:57:44Z" level=info msg="Checking existence of Velero custom resource definitions" logSource="pkg/cmd/server/server.go:415" time="2021-03-13T01:57:44Z" level=info msg="All Velero custom resource definitions exist" logSource="pkg/cmd/server/server.go:449" time="2021-03-13T01:57:44Z" level=warning msg="Velero restic daemonset not found; restic backups/restores will not work until it's created" logSource="pkg/cmd/server/server.go:495" time="2021-03-13T01:57:44Z" level=info msg="Starting controllers" logSource="pkg/cmd/server/server.go:571" time="2021-03-13T01:57:44Z" level=info msg="Starting metric server at address [:8085]" logSource="pkg/cmd/server/server.go:578" time="2021-03-13T01:57:44Z" level=info msg="Backup sync period is 1m0s" logSource="pkg/controller/backup_sync_controller.go:76" time="2021-03-13T01:57:44Z" level=info msg="Waiting for informer caches to sync" logSource="pkg/cmd/server/server.go:836" time="2021-03-13T01:57:47Z" level=info msg="Creating schedule velero-saversobackup" controller=schedule logSource="pkg/controller/schedule_controller.go:105" time="2021-03-13T01:57:47Z" level=info msg="Done waiting for informer caches to sync" logSource="pkg/cmd/server/server.go:839" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.ResticRepository" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.Backup" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.VolumeSnapshotLocation" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.Restore" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.DownloadRequest" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.Schedule" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.DeleteBackupRequest" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Informer cache synced" informer="*v1.PodVolumeBackup" logSource="pkg/cmd/server/server.go:850" time="2021-03-13T01:57:47Z" level=info msg="Server starting..." logSource="pkg/cmd/server/server.go:896" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=backup-sync logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=backup-deletion logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=info msg="Checking for expired DeleteBackupRequests" controller=backup-deletion logSource="pkg/controller/backup_deletion_controller.go:595" time="2021-03-13T01:57:47Z" level=info msg="Done checking for expired DeleteBackupRequests" controller=backup-deletion logSource="pkg/controller/backup_deletion_controller.go:623" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=backup logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=schedule logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=gc-controller logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=restic-repository logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=downloadrequest logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=info msg="Starting controller" controller=restore logSource="pkg/controller/generic_controller.go:76" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=info msg="Found 5 backups in the backup location that do not exist in the cluster and need to be synced" backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:197" time="2021-03-13T01:57:47Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313003726 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T01:57:47Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:47Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:47Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:47Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:47Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:47Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:47Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:47Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:47Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:47Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:47Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:47Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:47Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:47Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:47Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:47Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:48Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:48Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:48Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:48Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:48Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:48Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:48Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:48Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:48Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:48Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:48Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:48Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:49Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:49Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:49Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:50Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:50Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:50Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:50Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313003726 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T01:57:50Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313004155 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T01:57:50Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:50Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:50Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:50Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313004155 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T01:57:50Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313013406 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T01:57:50Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313013406 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T01:57:50Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313013650 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T01:57:50Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313013650 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T01:57:50Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313013821 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T01:57:50Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313013821 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T01:57:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:51Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:52Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:52Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:52Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:52Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:57:52Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:57:52Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:57:57Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:57Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:57:57Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:58:03Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:58:03Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:58:03Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:58:08Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:58:08Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:58:08Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:58:23Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:58:23Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:58:23Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:58:28Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:58:28Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:58:28Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:58:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:58:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:58:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:58:51Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:58:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:59:04Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:59:04Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:59:04Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:59:09Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:59:09Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:59:09Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T01:59:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:59:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T01:59:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T01:59:51Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T01:59:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:00:31Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:00:31Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:00:31Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:00:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:00:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:00:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:00:51Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:00:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:01:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:01:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:01:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:01:51Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:01:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:02:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:02:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:02:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:02:51Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:02:51Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" I0313 02:02:52.396466 1 request.go:621] Throttling request took 1.029001296s, request: GET:https://10.233.0.1:443/apis/acme.cert-manager.io/v1?timeout=32s time="2021-03-13T02:03:15Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:03:15Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:03:15Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:03:51Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:03:52Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:03:52Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:03:52Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:03:52Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:04:32Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:04:32Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:04:32Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:04:52Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:04:52Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:04:52Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:04:52Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:04:52Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:05:52Z" level=info msg="Found 5 backups in the backup location that do not exist in the cluster and need to be synced" backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:197" time="2021-03-13T02:05:52Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313013650 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T02:05:52Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313013650 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T02:05:52Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313013821 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T02:05:52Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313013821 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T02:05:52Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313003726 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T02:05:52Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313003726 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T02:05:52Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313004155 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T02:05:52Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313004155 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T02:05:52Z" level=info msg="Attempting to sync backup into cluster" backup=velero-saversobackup-20210313013406 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:205" time="2021-03-13T02:05:52Z" level=info msg="Successfully synced backup into cluster" backup=velero-saversobackup-20210313013406 backupLocation=backups controller=backup-sync logSource="pkg/controller/backup_sync_controller.go:235" time="2021-03-13T02:05:52Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:05:52Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:05:52Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:05:52Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:05:52Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:06:52Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:06:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:06:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:06:53Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:06:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:07:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:07:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:07:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:07:53Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:07:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" I0313 02:07:56.066725 1 request.go:621] Throttling request took 1.028712982s, request: GET:https://10.233.0.1:443/apis/authorization.k8s.io/v1beta1?timeout=32s time="2021-03-13T02:08:42Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014910\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014910-20210313024947 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:08:42Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024455 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:08:42Z" level=error msg="Error in syncHandler, re-adding item to queue" controller=downloadrequest error="backup.velero.io \"velero-saversobackup-20210313014417\" not found" error.file="/go/src/github.com/vmware-tanzu/velero/pkg/controller/download_request_controller.go:161" error.function="github.com/vmware-tanzu/velero/pkg/controller.(*downloadRequestController).generatePreSignedURL" key=velero/velero-saversobackup-20210313014417-20210313024543 logSource="pkg/controller/generic_controller.go:140" time="2021-03-13T02:08:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:08:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:08:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:08:53Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:08:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:09:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:09:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:09:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:09:53Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:09:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:10:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:10:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:10:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:10:53Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:10:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:11:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:11:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:11:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:11:53Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:11:53Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:12:53Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:12:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:12:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:12:54Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:12:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" I0313 02:12:59.736950 1 request.go:621] Throttling request took 1.029399089s, request: GET:https://10.233.0.1:443/apis/acme.cert-manager.io/v1?timeout=32s time="2021-03-13T02:13:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:13:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:13:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:13:54Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:13:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:14:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:14:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:14:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:14:54Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:14:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:15:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:15:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:15:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:15:54Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:15:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:16:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:16:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:16:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:16:54Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:16:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:17:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:17:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:17:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:17:54Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" time="2021-03-13T02:17:54Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" I0313 02:18:03.407511 1 request.go:621] Throttling request took 1.029534245s, request: GET:https://10.233.0.1:443/apis/autoscaling/v1?timeout=32s time="2021-03-13T02:18:54Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:18:55Z" level=warning msg="The specified default backup location named \"default\" was not found; for convenience, be sure to create one or make another backup location that is available the default" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:161" time="2021-03-13T02:18:55Z" level=info msg="Checking for existing backup locations ready to be verified; there needs to be at least 1 backup location available" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:58" time="2021-03-13T02:18:55Z" level=info msg="No backup locations were ready to be verified" controller=backupstoragelocation logSource="pkg/controller/backupstoragelocation_controller.go:120" ```❯
velero backup describe velero-saversobackup-20210315030048 --detailsClick to Expand
```yaml Name: velero-saversobackup-20210315030048 Namespace: velero Labels: app.kubernetes.io/instance=velero app.kubernetes.io/managed-by=Helm app.kubernetes.io/name=velero helm.sh/chart=velero-2.15.0 velero.io/schedule-name=velero-saversobackup velero.io/storage-location=backups Annotations: velero.io/source-cluster-k8s-gitversion=v1.18.15 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=18 Phase: PartiallyFailed (run `velero backup logs velero-saversobackup-20210315030048` for more information) Errors: 13 Warnings: 0 Namespaces: Included: * Excluded:SignatureDoesNotMatchvelero backup logs <backupname>Click to expand
```bash An error occurred: request failed:SignatureDoesNotMatchEnvironment:
helm version):kubectl version):Managed K8S-Cluster
IONOS by 1&1 - Cloud (Intel Skylake):
[IONOS S3 Bucket API](https://devops.ionos.com/api/s3/?hstc=94004290.61c6314c7e913008fbf3920436be8227.1613413417846.1615495428227.1615540550167.14&hssc=94004290.2.1615540550167&hsfp=3606176375#overview)__
Vote on this issue!
This is an invitation to the Velero community to vote on issues, you can see the project's top voted issues listed here.
Use the "reaction smiley face" up to the right of this comment to vote.