vmware-tanzu / velero

Backup and migrate Kubernetes applications and their persistent volumes
https://velero.io
Apache License 2.0
8.67k stars 1.4k forks source link

Restored postgresql tables missing after backup restoration in new cluster #7496

Open nknoii opened 7 months ago

nknoii commented 7 months ago

What steps did you take and what happened:

  1. Deployed PostgreSQL in the my local cluster and created tables within the database.
  2. Created a Velero backup and It was completed successfully.
  3. Restored the Velero backup in a new cluster, including all pods, pvc, pv.
  4. Attempted to access the database in the new cluster to verify the presence of tables. But the expected tables were missing from the restored backup.

What did you expect to happen: After restoring the backup into a new cluster, the tables and data should be available for access in the new cluster.

If you are using earlier versions:
Please provide the output of the following commands (Pasting long output into a GitHub gist or other pastebin is fine.)

Type "help" for help. postgres=# \d List of relations Schema | Name | Type | Owner
--------+-------------+----------+---------- public | t_50000 | table | postgres public | test | table | postgres public | test_id_seq | sequence | postgres

(3 rows)


- `velero backup create my-backup --include-namespaces postgres --default-volumes-to-fs-backup --snapshot-volumes --snapshot-move-data  `

Backup request "my-backup" submitted successfully.

Run velero backup describe my-backup or velero backup logs my-backup for more details.


- `velero backup describe my-backup `

Name: my-backup Namespace: velero Labels: velero.io/storage-location=velero-dev Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.27.3 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=27

Phase: Completed

Warnings: Velero: Cluster: Namespaces: postgres: resource: /pods name: /postgresql-0

Namespaces: Included: postgres Excluded:

Resources: Included: * Excluded: Cluster-scoped: auto

Label selector: Or label selector: Storage Location: velero-dev

Velero-Native Snapshot PVs: true Snapshot Move Data: true Data Mover: velero

TTL: 336h0m0s

CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s

Hooks:

Backup Format Version: 1.1.0

Started: 2024-03-05 20:17:33 +0330 +0330 Completed: 2024-03-05 20:17:42 +0330 +0330 Expiration: 2024-03-19 20:17:33 +0330 +0330

Total items to be backed up: 16 Items backed up: 16

Velero-Native Snapshots:


- `kubectl exec -it -n postgres postgresql-0 -- psql -U postgres -d postgres`

psql (16.2 (Debian 16.2-1.pgdg120+2))

Type "help" for help.

postgres=# /d postgres=# select * from test; ERROR: relation "test" does not exist

LINE 1: select * from test; ^ postgres=#



**Anything else you would like to add:**
<!--Miscellaneous information that will assist in solving the issue.-->

**Environment:**

- Velero version (use `6.0.0 (Helm chart)`): 
- Cloud provider or hardware configuration: Tested in local kind clusters
- OS (e.g. from `/etc/os-release`):

**Vote on this issue!**

This is an invitation to the Velero community to vote on issues, you can see the project's [top voted issues listed here](https://github.com/vmware-tanzu/velero/issues?q=is%3Aissue+is%3Aopen+sort%3Areactions-%2B1-desc).  
Use the "reaction smiley face" up to the right of this comment to vote.

- :+1: for "I would like to see this bug fixed as soon as possible"
- :-1: for "There are more important bugs to focus on right now"
Lyndon-Li commented 7 months ago

@nknoii From the command line you are using, you have specified both --default-volumes-to-fs-backup and --snapshot-move-data. --default-volumes-to-fs-backup activates the fs-backup method and --snapshot-move-data is for CSI snapshot data movement backup method. If they are both specified, as the current logic, fs-backup method takes preference.

However, fs-backup is not a consistent backup type, so your backup encountered data inconsistency.

Therefore, you need to remove --default-volumes-to-fs-backup so that you can get a crash consistent backup with CSI snapshot data movement backup method. For sure, CSI snapshot data movement backup requires your CSI driver supports CSI snapshot.

Lyndon-Li commented 7 months ago

Probably, we need to add some checks to prevent these two backup flags coexist.

nknoii commented 7 months ago

Hey @Lyndon-Li

$ velero backup create my-backup --include-namespaces postgres --snapshot-volumes --snapshot-move-data

I ran this command. Backup and restore completed successfully. but I'm still facing the same issue where tables are not restored.

ps: I'm using aws s3 bucket for the backup.

Lyndon-Li commented 7 months ago

Please collect velero logs by running velero debug and share us the log bundle.

nknoii commented 7 months ago

Please collect velero logs by running velero debug and share us the log bundle.

bundle-2024-03-06-10-48-56.tar.gz

Lyndon-Li commented 7 months ago

From the log bundle, there is no logs for data movement backup/restore activities. From the restore log, a restore was launched for backup my-backup-20240306101305. Looks like the backup is a data movement backup, but the DataUpload was not generated. Probably, the data movement backup for the PVC was not completed.

time="2024-03-06T04:43:07Z" level=warning msg="Got 0 DataUpload result. Expect one." error="dataupload result number is not expected" logSource="pkg/restore/restore.go:2013" restore=velero/my-backup-20240306101305

time="2024-03-06T04:43:07Z" level=info msg="Start DataMover restore." Action=PVCRestoreItemAction PVC=postgres/postgresql-persistent-storage-postgresql-0 Restore=velero/my-backup-20240306101305 cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/restore/pvc_action.go:174" pluginName=velero-plugin-for-csi restore=velero/my-backup-20240306101305
time="2024-03-06T04:43:07Z" level=warning msg="PVC doesn't have a DataUpload for data mover. Return." Action=PVCRestoreItemAction PVC=postgres/postgresql-persistent-storage-postgresql-0 Restore=velero/my-backup-20240306101305 cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/restore/pvc_action.go:180" pluginName=velero-plugin-for-csi restore=velero/my-backup-20240306101305

@nknoii Please share the log bundle for backup my-backup-20240306101305 so that we can further troubleshoot (if the restore is to a different cluster, the backup log should be on the source cluster). Or you can run a new backup on the source cluster and make sure there is no warning about PVC skip and then run another restore.

nknoii commented 7 months ago

From the log bundle, there is no logs for data movement backup/restore activities. From the restore log, a restore was launched for backup my-backup-20240306101305. Looks like the backup is a data movement backup, but the DataUpload was not generated. Probably, the data movement backup for the PVC was not completed.

time="2024-03-06T04:43:07Z" level=warning msg="Got 0 DataUpload result. Expect one." error="dataupload result number is not expected" logSource="pkg/restore/restore.go:2013" restore=velero/my-backup-20240306101305

time="2024-03-06T04:43:07Z" level=info msg="Start DataMover restore." Action=PVCRestoreItemAction PVC=postgres/postgresql-persistent-storage-postgresql-0 Restore=velero/my-backup-20240306101305 cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/restore/pvc_action.go:174" pluginName=velero-plugin-for-csi restore=velero/my-backup-20240306101305
time="2024-03-06T04:43:07Z" level=warning msg="PVC doesn't have a DataUpload for data mover. Return." Action=PVCRestoreItemAction PVC=postgres/postgresql-persistent-storage-postgresql-0 Restore=velero/my-backup-20240306101305 cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/restore/pvc_action.go:180" pluginName=velero-plugin-for-csi restore=velero/my-backup-20240306101305

@nknoii Please share the log bundle for backup my-backup-20240306101305 so that we can further troubleshoot (if the restore is to a different cluster, the backup log should be on the source cluster). Or you can run a new backup on the source cluster and make sure there is no warning about PVC skip and then run another restore.

postgres-backup.log I did a new backup and there were some skipping warnings.

Lyndon-Li commented 7 months ago

The volume is built on hostpath, it is not supported by data movement backup or fs-backup:

time="2024-03-07T03:28:45Z" level=info msg="Skipping PVC postgres/postgresql-persistent-storage-postgresql-0, associated PV postgresql-pv is not a CSI volume" backup=velero/postgres-backup cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/pvc_action.go:99" pluginName=velero-plugin-for-csi

time="2024-03-07T03:28:47Z" level=warning msg="Volume postgresql-persistent-storage in pod postgres/postgresql-0 is a hostPath volume which is not supported for pod volume backup, skipping" backup=velero/postgres-backup logSource="pkg/podvolume/backupper.go:267" name=postgresql-0 namespace=postgres resource=pods
nknoii commented 7 months ago

The volume is built on hostpath, it is not supported by data movement backup or fs-backup:

time="2024-03-07T03:28:45Z" level=info msg="Skipping PVC postgres/postgresql-persistent-storage-postgresql-0, associated PV postgresql-pv is not a CSI volume" backup=velero/postgres-backup cmd=/plugins/velero-plugin-for-csi logSource="/go/src/velero-plugin-for-csi/internal/backup/pvc_action.go:99" pluginName=velero-plugin-for-csi

time="2024-03-07T03:28:47Z" level=warning msg="Volume postgresql-persistent-storage in pod postgres/postgresql-0 is a hostPath volume which is not supported for pod volume backup, skipping" backup=velero/postgres-backup logSource="pkg/podvolume/backupper.go:267" name=postgresql-0 namespace=postgres resource=pods

I see, velero supports local persistent volumes right? so I changed it to that. but it's still skipping the pvc.

postgres-backup.log

apiVersion: v1
kind: Service
metadata:
  name: postgresql
  namespace: postgres
  labels:
    app: postgresql
spec:
  ports:
    - port: 5432
  selector:
    app: postgresql
---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: postgresql-pv
spec:
  capacity:
    storage: 1Gi
  volumeMode: Filesystem
  accessModes:
    - ReadWriteOnce
  persistentVolumeReclaimPolicy: Retain
  storageClassName: local-storage
  local:
    path: /var/lib/postgresql/data
  nodeAffinity:
    required:
      nodeSelectorTerms:
        - matchExpressions:
            - key: kubernetes.io/hostname
              operator: In
              values:
                - kind-control-plane
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: postgresql-pvc
  namespace: postgres
spec:
  accessModes:
    - ReadWriteOnce
  resources:
    requests:
      storage: 1Gi
  storageClassName: local-storage
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: postgresql
  namespace: postgres
spec:
  selector:
    matchLabels:
      app: postgresql
  serviceName: postgresql
  replicas: 1
  template:
    metadata:
      labels:
        app: postgresql
    spec:
      containers:
        - name: postgresql
          image: postgres:latest
          ports:
            - containerPort: 5432
          env:
            - name: POSTGRES_PASSWORD
              value: password
          volumeMounts:
            - name: postgresql-persistent-storage
              mountPath: /var/lib/postgresql/data
  volumeClaimTemplates:
    - metadata:
        name: postgresql-persistent-storage
      spec:
        accessModes: ["ReadWriteOnce"]
        resources:
          requests:
            storage: 1Gi
Lyndon-Li commented 7 months ago

I see, velero supports local persistent volumes right?

The data movement backup doesn't support local PV, fs-backup supports it. But fs-backup is not consistent.

nknoii commented 7 months ago

I see, velero supports local persistent volumes right?

The data movement backup doesn't support local PV, fs-backup supports it. But fs-backup is not consistent.

If it doesn't support local pv, what should I do? sorry, I didn't get you.

draghuram commented 7 months ago

@nknoii, If you can use CSI PVs, snapshot data mover backups can be done. They take CSI snapshot first and then backs up the data. But this method cannot be used for PVs that do not support CSI snapshots. For example, "local" type PVs (https://kubernetes.io/docs/concepts/storage/volumes/#local) do not support snapshots so you can't use snapshot data mover method.

But you can use "File system backup" method (enabled by the option "--default-volumes-to-fs-backup") but the only issue there, as @Lyndon-Li pointed out, is that backup is done from live PV. So your Postgres data may be backed up in inconsistent state, depending on DB activity. Note that you can use Velero hooks (https://velero.io/docs/v1.13/backup-hooks/) to quiesce data.

Hope this helps.

sseago commented 7 months ago

@Lyndon-Li "Probably, we need to add some checks to prevent these two backup flags coexist." Actually, we probably don't want that. default-volumes-to-fs-backup just specifies whether we're using opt-in or opt-out. If you have a bunch of volumes you want to use fs-backup for (not compatible with CSI volumes), but a few CSI volumes you want to use datamover with, you'd use all 3 flags and then annotate the datamover volumes to opt in.

Point is that the flags are not contradictory -- collectively, using all 3 means "by default, use fs-backup with individual volume opt-out, and for those opted-out volumes, snapshot the data and move to object storage via datamover.

nknoii commented 7 months ago

@nknoii, If you can use CSI PVs, snapshot data mover backups can be done. They take CSI snapshot first and then backs up the data. But this method cannot be used for PVs that do not support CSI snapshots. For example, "local" type PVs (https://kubernetes.io/docs/concepts/storage/volumes/#local) do not support snapshots so you can't use snapshot data mover method.

But you can use "File system backup" method (enabled by the option "--default-volumes-to-fs-backup") but the only issue there, as @Lyndon-Li pointed out, is that backup is done from live PV. So your Postgres data may be backed up in inconsistent state, depending on DB activity. Note that you can use Velero hooks (https://velero.io/docs/v1.13/backup-hooks/) to quiesce data.

Hope this helps.

I tested by using '--default-volumes-to-fs-backup', but I'm still encountering the same issue. postgres data is not being restored

Lyndon-Li commented 7 months ago

@sseago

@Lyndon-Li "Probably, we need to add some checks to prevent these two backup flags coexist." Actually, we probably don't want that. default-volumes-to-fs-backup just specifies whether we're using opt-in or opt-out. If you have a bunch of volumes you want to use fs-backup for (not compatible with CSI volumes), but a few CSI volumes you want to use datamover with, you'd use all 3 flags and then annotate the datamover volumes to opt in.

Point is that the flags are not contradictory -- collectively, using all 3 means "by default, use fs-backup with individual volume opt-out, and for those opted-out volumes, snapshot the data and move to object storage via datamover.

These logics are correct as Velero's current behavior, that is, default-volumes-to-fs-backup + opt-in/opt-out + CSI plugin availability/feature enability + snapshot-move-data work together to decide the final backup method. And the current behavior is also comprehensive, as the case you have mentioned, some volumes support CSI snapshot, some don't.

However, we achieve this comprehensiveness by leaving the complexity to users, they need to decide the complex-to-understand and less user-friendly combination:

This is a big topic since we need to change the entire behavior and it is out of the scope of the current issue. So let's continue this thinking and discussion, at present, my immediate idea is that at least we need to block/warn users if these two flags come together.

allenxu404 commented 7 months ago

I tested by using '--default-volumes-to-fs-backup', but I'm still encountering the same issue. postgres data is not being restored

@nknoii can you make sure PV can be dynamically provisioned by local volume provisioner in your cluster? Checking the StatefulSet yaml you provided above, I didn't see there is a storageClassName field in volumeClaimTemplates section.

Please also provide us with log bundle for better troubleshooting.

nknoii commented 7 months ago

I tested by using '--default-volumes-to-fs-backup', but I'm still encountering the same issue. postgres data is not being restored

@nknoii can you make sure PV can be dynamically provisioned by local volume provisioner in your cluster? Checking the StatefulSet yaml you provided above, I didn't see there is a storageClassName field in volumeClaimTemplates section.

Please also provide us with log bundle for better troubleshooting.

Yes, I missed the storageClassName. Btw, now I tried installing it with a helm chart.

$ helm install postgres bitnami/postgresql --namespace postgres

$ velero backup create postgres-backup --include-namespaces postgres --default-volumes-to-fs-backup
$ velero backup describe postgres-backup

Name: postgres-backup Namespace: velero Labels: velero.io/storage-location=dev-velero Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.27.3 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=27 Phase: Completed Warnings: Velero: Cluster: Namespaces: postgres: resource: /pods name: /postgres-postgresql-0 Namespaces: Included: postgres Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: dev-velero Velero-Native Snapshot PVs: auto Snapshot Move Data: false Data Mover: velero TTL: 336h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2024-03-10 14:54:22 +0330 +0330 Completed: 2024-03-10 14:55:50 +0330 +0330 Expiration: 2024-03-24 14:54:22 +0330 +0330 Total items to be backed up: 29 Items backed up: 29 Velero-Native Snapshots: restic Backups (specify --details for more information): Completed: 2

$ velero backup describe postgres-backup --details

Name: postgres-backup Namespace: velero Labels: velero.io/storage-location=dev-velero Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.27.3 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=27 Phase: Completed Warnings: Velero: Cluster: Namespaces: postgres: resource: /pods name: /postgres-postgresql-0 Namespaces: Included: postgres Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: dev-velero Velero-Native Snapshot PVs: auto Snapshot Move Data: false Data Mover: velero TTL: 336h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2024-03-10 14:54:22 +0330 +0330 Completed: 2024-03-10 14:55:50 +0330 +0330 Expiration: 2024-03-24 14:54:22 +0330 +0330 Total items to be backed up: 29 Items backed up: 29 Resource List: apps/v1/ControllerRevision: - postgres/postgres-postgresql-6f78857f57 apps/v1/StatefulSet: - postgres/postgres-postgresql discovery.k8s.io/v1/EndpointSlice: - postgres/postgres-postgresql-hl-vjvvq - postgres/postgres-postgresql-kpsjg networking.k8s.io/v1/NetworkPolicy: - postgres/postgres-postgresql v1/ConfigMap: - postgres/kube-root-ca.crt v1/Endpoints: - postgres/postgres-postgresql - postgres/postgres-postgresql-hl v1/Event: - postgres/data-postgres-postgresql-0.17bb5c833100c23d - postgres/data-postgres-postgresql-0.17bb5c83335afefa - postgres/data-postgres-postgresql-0.17bb5c83344eff86 - postgres/data-postgres-postgresql-0.17bb5c83ebbf9816 - postgres/postgres-postgresql-0.17bb5c8421336078 - postgres/postgres-postgresql-0.17bb5c844bba8c41 - postgres/postgres-postgresql-0.17bb5cb170d39c3c - postgres/postgres-postgresql-0.17bb5cb175e80282 - postgres/postgres-postgresql-0.17bb5cb189d4a540 - postgres/postgres-postgresql.17bb5c8330fe7a5f - postgres/postgres-postgresql.17bb5c83315aeb86 v1/Namespace: - postgres v1/PersistentVolume: - pvc-b00272c5-a904-4ff8-a3a6-e2ccfe35bc61 v1/PersistentVolumeClaim: - postgres/data-postgres-postgresql-0 v1/Pod: - postgres/postgres-postgresql-0 v1/Secret: - postgres/postgres-postgresql - postgres/sh.helm.release.v1.postgres.v1 v1/Service: - postgres/postgres-postgresql - postgres/postgres-postgresql-hl v1/ServiceAccount: - postgres/default - postgres/postgres-postgresql Velero-Native Snapshots: restic Backups: Completed: postgres/postgres-postgresql-0: dshm, empty-dir

$ velero backup logs postgres-backup

time="2024-03-10T09:24:22Z" level=info msg="Setting up backup temp file" backup=velero/postgres-backup logSource="pkg/controller/backup_controller.go:617" time="2024-03-10T09:24:22Z" level=info msg="Setting up plugin manager" backup=velero/postgres-backup logSource="pkg/controller/backup_controller.go:624" time="2024-03-10T09:24:22Z" level=info msg="Getting backup item actions" backup=velero/postgres-backup logSource="pkg/controller/backup_controller.go:628" time="2024-03-10T09:24:22Z" level=info msg="Setting up backup store to check for backup existence" backup=velero/postgres-backup logSource="pkg/controller/backup_controller.go:633" time="2024-03-10T09:24:23Z" level=info msg="Writing backup version file" backup=velero/postgres-backup logSource="pkg/backup/backup.go:197" time="2024-03-10T09:24:23Z" level=info msg="Including namespaces: postgres" backup=velero/postgres-backup logSource="pkg/backup/backup.go:203" time="2024-03-10T09:24:23Z" level=info msg="Excluding namespaces: " backup=velero/postgres-backup logSource="pkg/backup/backup.go:204" time="2024-03-10T09:24:23Z" level=info msg="Including resources: *" backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:506" time="2024-03-10T09:24:23Z" level=info msg="Excluding resources: " backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:507" time="2024-03-10T09:24:23Z" level=info msg="Backing up all volumes using pod volume backup: true" backup=velero/postgres-backup logSource="pkg/backup/backup.go:222" time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=pods time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=pods time="2024-03-10T09:24:23Z" level=info msg="list for groupResource pods was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 1 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=pods time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=persistentvolumeclaims time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=persistentvolumeclaims time="2024-03-10T09:24:23Z" level=info msg="list for groupResource persistentvolumeclaims was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 1 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=persistentvolumeclaims time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=persistentvolumes time="2024-03-10T09:24:23Z" level=info msg="Skipping resource persistentvolumes, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:255" resource=persistentvolumes time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=resourcequotas time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=resourcequotas time="2024-03-10T09:24:23Z" level=info msg="list for groupResource resourcequotas was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=resourcequotas time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=namespaces time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=events time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=events time="2024-03-10T09:24:23Z" level=info msg="list for groupResource events was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 11 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=events time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=nodes time="2024-03-10T09:24:23Z" level=info msg="Skipping resource nodes, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:255" resource=nodes time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=serviceaccounts time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=serviceaccounts time="2024-03-10T09:24:23Z" level=info msg="list for groupResource serviceaccounts was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 2 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=serviceaccounts time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=endpoints time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=endpoints time="2024-03-10T09:24:23Z" level=info msg="list for groupResource endpoints was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 2 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=endpoints time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=podtemplates time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=podtemplates time="2024-03-10T09:24:23Z" level=info msg="list for groupResource podtemplates was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=podtemplates time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=services time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=services time="2024-03-10T09:24:23Z" level=info msg="list for groupResource services was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 2 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=services time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=limitranges time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=limitranges time="2024-03-10T09:24:23Z" level=info msg="list for groupResource limitranges was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=limitranges time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=secrets time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=secrets time="2024-03-10T09:24:23Z" level=info msg="list for groupResource secrets was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 2 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=secrets time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=configmaps time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=configmaps time="2024-03-10T09:24:23Z" level=info msg="list for groupResource configmaps was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 1 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=configmaps time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:196" resource=replicationcontrollers time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=replicationcontrollers time="2024-03-10T09:24:23Z" level=info msg="list for groupResource replicationcontrollers was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=replicationcontrollers time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=apiservices time="2024-03-10T09:24:23Z" level=info msg="Skipping resource apiservices.apiregistration.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=apiregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=apiservices time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=controllerrevisions time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=controllerrevisions time="2024-03-10T09:24:23Z" level=info msg="list for groupResource controllerrevisions.apps was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 1 items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=controllerrevisions time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=deployments time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=deployments time="2024-03-10T09:24:23Z" level=info msg="list for groupResource deployments.apps was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=deployments time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=replicasets time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=replicasets time="2024-03-10T09:24:23Z" level=info msg="list for groupResource replicasets.apps was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=replicasets time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=daemonsets time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=daemonsets time="2024-03-10T09:24:23Z" level=info msg="list for groupResource daemonsets.apps was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=daemonsets time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:196" resource=statefulsets time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=statefulsets time="2024-03-10T09:24:23Z" level=info msg="list for groupResource statefulsets.apps was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 1 items" backup=velero/postgres-backup group=apps/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=statefulsets time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=events.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=events.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=events time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it cohabitates and we've already processed it" backup=velero/postgres-backup cohabitatingResource1=events cohabitatingResource2=events.events.k8s.io group=events.k8s.io/v1 logSource="pkg/backup/item_collector.go:267" resource=events time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=autoscaling/v2 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=autoscaling/v2 logSource="pkg/backup/item_collector.go:196" resource=horizontalpodautoscalers time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=autoscaling/v2 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=horizontalpodautoscalers time="2024-03-10T09:24:23Z" level=info msg="list for groupResource horizontalpodautoscalers.autoscaling was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=autoscaling/v2 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=horizontalpodautoscalers time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=batch/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=batch/v1 logSource="pkg/backup/item_collector.go:196" resource=cronjobs time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=batch/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=cronjobs time="2024-03-10T09:24:23Z" level=info msg="list for groupResource cronjobs.batch was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=batch/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=cronjobs time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=batch/v1 logSource="pkg/backup/item_collector.go:196" resource=jobs time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=batch/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=jobs time="2024-03-10T09:24:23Z" level=info msg="list for groupResource jobs.batch was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=batch/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=jobs time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=certificates.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=certificates.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=certificatesigningrequests time="2024-03-10T09:24:23Z" level=info msg="Skipping resource certificatesigningrequests.certificates.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=certificates.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=certificatesigningrequests time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=ingressclasses time="2024-03-10T09:24:23Z" level=info msg="Skipping resource ingressclasses.networking.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=ingressclasses time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=networkpolicies time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=networkpolicies time="2024-03-10T09:24:23Z" level=info msg="list for groupResource networkpolicies.networking.k8s.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 1 items" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=networkpolicies time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=ingresses time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=ingresses time="2024-03-10T09:24:23Z" level=info msg="list for groupResource ingresses.networking.k8s.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=networking.k8s.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=ingresses time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=policy/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=policy/v1 logSource="pkg/backup/item_collector.go:196" resource=poddisruptionbudgets time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=policy/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=poddisruptionbudgets time="2024-03-10T09:24:23Z" level=info msg="list for groupResource poddisruptionbudgets.policy was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=policy/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=poddisruptionbudgets time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=clusterrolebindings time="2024-03-10T09:24:23Z" level=info msg="Skipping resource clusterrolebindings.rbac.authorization.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=clusterrolebindings time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=roles time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=roles time="2024-03-10T09:24:23Z" level=info msg="list for groupResource roles.rbac.authorization.k8s.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=roles time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=rolebindings time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=rolebindings time="2024-03-10T09:24:23Z" level=info msg="list for groupResource rolebindings.rbac.authorization.k8s.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=rolebindings time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=clusterroles time="2024-03-10T09:24:23Z" level=info msg="Skipping resource clusterroles.rbac.authorization.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=rbac.authorization.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=clusterroles time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=volumeattachments time="2024-03-10T09:24:23Z" level=info msg="Skipping resource volumeattachments.storage.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=volumeattachments time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=storageclasses time="2024-03-10T09:24:23Z" level=info msg="Skipping resource storageclasses.storage.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=storageclasses time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=csidrivers time="2024-03-10T09:24:23Z" level=info msg="Skipping resource csidrivers.storage.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=csidrivers time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=csistoragecapacities time="2024-03-10T09:24:23Z" level=info msg="Listing items" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=csistoragecapacities time="2024-03-10T09:24:23Z" level=info msg="list for groupResource csistoragecapacities.storage.k8s.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:23Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=csistoragecapacities time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=csinodes time="2024-03-10T09:24:23Z" level=info msg="Skipping resource csinodes.storage.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=storage.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=csinodes time="2024-03-10T09:24:23Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=validatingwebhookconfigurations time="2024-03-10T09:24:23Z" level=info msg="Skipping resource validatingwebhookconfigurations.admissionregistration.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:23Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=validatingwebhookconfigurations time="2024-03-10T09:24:23Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=mutatingwebhookconfigurations time="2024-03-10T09:24:24Z" level=info msg="Skipping resource mutatingwebhookconfigurations.admissionregistration.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:24Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=admissionregistration.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=mutatingwebhookconfigurations time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=customresourcedefinitions time="2024-03-10T09:24:24Z" level=info msg="Skipping resource customresourcedefinitions.apiextensions.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:24Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=apiextensions.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=customresourcedefinitions time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=priorityclasses time="2024-03-10T09:24:24Z" level=info msg="Skipping resource priorityclasses.scheduling.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:24Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=scheduling.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=priorityclasses time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=leases time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=leases time="2024-03-10T09:24:24Z" level=info msg="list for groupResource leases.coordination.k8s.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=coordination.k8s.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=leases time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=node.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=node.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=runtimeclasses time="2024-03-10T09:24:24Z" level=info msg="Skipping resource runtimeclasses.node.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:24Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=node.k8s.io/v1 logSource="pkg/backup/item_collector.go:255" resource=runtimeclasses time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:196" resource=endpointslices time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=endpointslices time="2024-03-10T09:24:24Z" level=info msg="list for groupResource endpointslices.discovery.k8s.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 2 items" backup=velero/postgres-backup group=discovery.k8s.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=endpointslices time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=flowcontrol.apiserver.k8s.io/v1beta3 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=flowcontrol.apiserver.k8s.io/v1beta3 logSource="pkg/backup/item_collector.go:196" resource=prioritylevelconfigurations time="2024-03-10T09:24:24Z" level=info msg="Skipping resource prioritylevelconfigurations.flowcontrol.apiserver.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:24Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=flowcontrol.apiserver.k8s.io/v1beta3 logSource="pkg/backup/item_collector.go:255" resource=prioritylevelconfigurations time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=flowcontrol.apiserver.k8s.io/v1beta3 logSource="pkg/backup/item_collector.go:196" resource=flowschemas time="2024-03-10T09:24:24Z" level=info msg="Skipping resource flowschemas.flowcontrol.apiserver.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:24:24Z" level=info msg="Skipping resource because it's excluded" backup=velero/postgres-backup group=flowcontrol.apiserver.k8s.io/v1beta3 logSource="pkg/backup/item_collector.go:255" resource=flowschemas time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=volumesnapshotlocations time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=volumesnapshotlocations time="2024-03-10T09:24:24Z" level=info msg="list for groupResource volumesnapshotlocations.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=volumesnapshotlocations time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=podvolumerestores time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=podvolumerestores time="2024-03-10T09:24:24Z" level=info msg="list for groupResource podvolumerestores.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=podvolumerestores time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=schedules time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=schedules time="2024-03-10T09:24:24Z" level=info msg="list for groupResource schedules.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=schedules time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=backupstoragelocations time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=backupstoragelocations time="2024-03-10T09:24:24Z" level=info msg="list for groupResource backupstoragelocations.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=backupstoragelocations time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=serverstatusrequests time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=serverstatusrequests time="2024-03-10T09:24:24Z" level=info msg="list for groupResource serverstatusrequests.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=serverstatusrequests time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=backuprepositories time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=backuprepositories time="2024-03-10T09:24:24Z" level=info msg="list for groupResource backuprepositories.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=backuprepositories time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=backups time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=backups time="2024-03-10T09:24:24Z" level=info msg="list for groupResource backups.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=backups time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=podvolumebackups time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=podvolumebackups time="2024-03-10T09:24:24Z" level=info msg="list for groupResource podvolumebackups.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=podvolumebackups time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=restores time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=restores time="2024-03-10T09:24:24Z" level=info msg="list for groupResource restores.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=restores time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=deletebackuprequests time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=deletebackuprequests time="2024-03-10T09:24:24Z" level=info msg="list for groupResource deletebackuprequests.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=deletebackuprequests time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:196" resource=downloadrequests time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=downloadrequests time="2024-03-10T09:24:24Z" level=info msg="list for groupResource downloadrequests.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=downloadrequests time="2024-03-10T09:24:24Z" level=info msg="Getting items for group" backup=velero/postgres-backup group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:105" time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:196" resource=datadownloads time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=datadownloads time="2024-03-10T09:24:24Z" level=info msg="list for groupResource datadownloads.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=datadownloads time="2024-03-10T09:24:24Z" level=info msg="Getting items for resource" backup=velero/postgres-backup group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:196" resource=datauploads time="2024-03-10T09:24:24Z" level=info msg="Listing items" backup=velero/postgres-backup group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:322" namespace=postgres resource=datauploads time="2024-03-10T09:24:24Z" level=info msg="list for groupResource datauploads.velero.io was not paginated" backup=velero/postgres-backup logSource="pkg/backup/item_collector.go:495" time="2024-03-10T09:24:24Z" level=info msg="Retrieved 0 items" backup=velero/postgres-backup group=velero.io/v2alpha1 logSource="pkg/backup/item_collector.go:353" namespace=postgres resource=datauploads time="2024-03-10T09:24:24Z" level=info msg="Collected 28 items matching the backup spec from the Kubernetes API (actual number of items backed up may be more or less depending on velero.io/exclude-from-backup annotation, plugins returning additional related items to back up, etc.)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:280" progress= time="2024-03-10T09:24:24Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-0 namespace=postgres progress= resource=pods time="2024-03-10T09:24:24Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-0 namespace=postgres resource=pods time="2024-03-10T09:24:24Z" level=info msg="Executing custom action" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:355" name=postgres-postgresql-0 namespace=postgres resource=pods time="2024-03-10T09:24:24Z" level=info msg="Executing podAction" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/pod_action.go:51" pluginName=velero time="2024-03-10T09:24:24Z" level=info msg="Adding pvc data-postgres-postgresql-0 to additionalItems" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/pod_action.go:75" pluginName=velero time="2024-03-10T09:24:24Z" level=info msg="Done executing podAction" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/pod_action.go:85" pluginName=velero time="2024-03-10T09:24:24Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=data-postgres-postgresql-0 namespace=postgres resource=persistentvolumeclaims time="2024-03-10T09:24:24Z" level=info msg="Executing custom action" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:355" name=data-postgres-postgresql-0 namespace=postgres resource=persistentvolumeclaims time="2024-03-10T09:24:24Z" level=info msg="Executing PVCAction" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/backup_pv_action.go:52" pluginName=velero time="2024-03-10T09:24:24Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=pvc-b00272c5-a904-4ff8-a3a6-e2ccfe35bc61 namespace= resource=persistentvolumes time="2024-03-10T09:24:24Z" level=info msg="Executing takePVSnapshot" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:495" name=pvc-b00272c5-a904-4ff8-a3a6-e2ccfe35bc61 namespace= resource=persistentvolumes time="2024-03-10T09:24:24Z" level=info msg="Skipping snapshot of persistent volume because volume is being backed up with pod volume backup." backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:513" name=pvc-b00272c5-a904-4ff8-a3a6-e2ccfe35bc61 namespace= persistentVolume=pvc-b00272c5-a904-4ff8-a3a6-e2ccfe35bc61 resource=persistentvolumes time="2024-03-10T09:24:24Z" level=info msg="pod postgres/postgres-postgresql-0 has volumes to backup: [data empty-dir dshm]" backup=velero/postgres-backup logSource="pkg/podvolume/backupper.go:174" name=postgres-postgresql-0 namespace=postgres resource=pods time="2024-03-10T09:24:30Z" level=warning msg="Volume data in pod postgres/postgres-postgresql-0 is a hostPath volume which is not supported for pod volume backup, skipping" backup=velero/postgres-backup logSource="pkg/podvolume/backupper.go:267" name=postgres-postgresql-0 namespace=postgres resource=pods time="2024-03-10T09:25:44Z" level=info msg="Backed up 3 items out of an estimated total of 30 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-0 namespace=postgres progress= resource=pods time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=data-postgres-postgresql-0 namespace=postgres progress= resource=persistentvolumeclaims time="2024-03-10T09:25:44Z" level=info msg="Skipping item because it's already been backed up." backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:172" name=data-postgres-postgresql-0 namespace=postgres resource=persistentvolumeclaims time="2024-03-10T09:25:44Z" level=info msg="Backed up 3 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=data-postgres-postgresql-0 namespace=postgres progress= resource=persistentvolumeclaims time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres namespace= progress= resource=namespaces time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres namespace= resource=namespaces time="2024-03-10T09:25:44Z" level=info msg="Backed up 4 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres namespace= progress= resource=namespaces time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=data-postgres-postgresql-0.17bb5c833100c23d namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=data-postgres-postgresql-0.17bb5c833100c23d namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 5 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=data-postgres-postgresql-0.17bb5c833100c23d namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=data-postgres-postgresql-0.17bb5c83335afefa namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=data-postgres-postgresql-0.17bb5c83335afefa namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 6 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=data-postgres-postgresql-0.17bb5c83335afefa namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=data-postgres-postgresql-0.17bb5c83344eff86 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=data-postgres-postgresql-0.17bb5c83344eff86 namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 7 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=data-postgres-postgresql-0.17bb5c83344eff86 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=data-postgres-postgresql-0.17bb5c83ebbf9816 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=data-postgres-postgresql-0.17bb5c83ebbf9816 namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 8 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=data-postgres-postgresql-0.17bb5c83ebbf9816 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-0.17bb5c8421336078 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-0.17bb5c8421336078 namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 9 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-0.17bb5c8421336078 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-0.17bb5c844bba8c41 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-0.17bb5c844bba8c41 namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 10 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-0.17bb5c844bba8c41 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-0.17bb5cb170d39c3c namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-0.17bb5cb170d39c3c namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 11 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-0.17bb5cb170d39c3c namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-0.17bb5cb175e80282 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-0.17bb5cb175e80282 namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 12 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-0.17bb5cb175e80282 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-0.17bb5cb189d4a540 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-0.17bb5cb189d4a540 namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 13 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-0.17bb5cb189d4a540 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql.17bb5c8330fe7a5f namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql.17bb5c8330fe7a5f namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 14 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql.17bb5c8330fe7a5f namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql.17bb5c83315aeb86 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql.17bb5c83315aeb86 namespace=postgres resource=events time="2024-03-10T09:25:44Z" level=info msg="Backed up 15 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql.17bb5c83315aeb86 namespace=postgres progress= resource=events time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=default namespace=postgres progress= resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=default namespace=postgres resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Executing custom action" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:355" name=default namespace=postgres resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Running ServiceAccountAction" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/service_account_action.go:77" pluginName=velero time="2024-03-10T09:25:44Z" level=info msg="Done running ServiceAccountAction" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/service_account_action.go:120" pluginName=velero time="2024-03-10T09:25:44Z" level=info msg="Backed up 16 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=default namespace=postgres progress= resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql namespace=postgres progress= resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql namespace=postgres resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Executing custom action" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:355" name=postgres-postgresql namespace=postgres resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Running ServiceAccountAction" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/service_account_action.go:77" pluginName=velero time="2024-03-10T09:25:44Z" level=info msg="Done running ServiceAccountAction" backup=velero/postgres-backup cmd=/velero logSource="pkg/backup/service_account_action.go:120" pluginName=velero time="2024-03-10T09:25:44Z" level=info msg="Backed up 17 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql namespace=postgres progress= resource=serviceaccounts time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql namespace=postgres progress= resource=endpoints time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql namespace=postgres resource=endpoints time="2024-03-10T09:25:44Z" level=info msg="Backed up 18 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql namespace=postgres progress= resource=endpoints time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-hl namespace=postgres progress= resource=endpoints time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-hl namespace=postgres resource=endpoints time="2024-03-10T09:25:44Z" level=info msg="Backed up 19 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-hl namespace=postgres progress= resource=endpoints time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql namespace=postgres progress= resource=services time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql namespace=postgres resource=services time="2024-03-10T09:25:44Z" level=info msg="Backed up 20 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql namespace=postgres progress= resource=services time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-hl namespace=postgres progress= resource=services time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-hl namespace=postgres resource=services time="2024-03-10T09:25:44Z" level=info msg="Backed up 21 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-hl namespace=postgres progress= resource=services time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql namespace=postgres progress= resource=secrets time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql namespace=postgres resource=secrets time="2024-03-10T09:25:44Z" level=info msg="Backed up 22 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql namespace=postgres progress= resource=secrets time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=sh.helm.release.v1.postgres.v1 namespace=postgres progress= resource=secrets time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=sh.helm.release.v1.postgres.v1 namespace=postgres resource=secrets time="2024-03-10T09:25:44Z" level=info msg="Backed up 23 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=sh.helm.release.v1.postgres.v1 namespace=postgres progress= resource=secrets time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=kube-root-ca.crt namespace=postgres progress= resource=configmaps time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=kube-root-ca.crt namespace=postgres resource=configmaps time="2024-03-10T09:25:44Z" level=info msg="Backed up 24 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=kube-root-ca.crt namespace=postgres progress= resource=configmaps time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-6f78857f57 namespace=postgres progress= resource=controllerrevisions.apps time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-6f78857f57 namespace=postgres resource=controllerrevisions.apps time="2024-03-10T09:25:44Z" level=info msg="Backed up 25 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-6f78857f57 namespace=postgres progress= resource=controllerrevisions.apps time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql namespace=postgres progress= resource=statefulsets.apps time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql namespace=postgres resource=statefulsets.apps time="2024-03-10T09:25:44Z" level=info msg="Backed up 26 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql namespace=postgres progress= resource=statefulsets.apps time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql namespace=postgres progress= resource=networkpolicies.networking.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql namespace=postgres resource=networkpolicies.networking.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Backed up 27 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql namespace=postgres progress= resource=networkpolicies.networking.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-hl-vjvvq namespace=postgres progress= resource=endpointslices.discovery.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-hl-vjvvq namespace=postgres resource=endpointslices.discovery.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Backed up 28 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-hl-vjvvq namespace=postgres progress= resource=endpointslices.discovery.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Processing item" backup=velero/postgres-backup logSource="pkg/backup/backup.go:364" name=postgres-postgresql-kpsjg namespace=postgres progress= resource=endpointslices.discovery.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Backing up item" backup=velero/postgres-backup logSource="pkg/backup/item_backupper.go:177" name=postgres-postgresql-kpsjg namespace=postgres resource=endpointslices.discovery.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Backed up 29 items out of an estimated total of 29 (estimate will change throughout the backup)" backup=velero/postgres-backup logSource="pkg/backup/backup.go:404" name=postgres-postgresql-kpsjg namespace=postgres progress= resource=endpointslices.discovery.k8s.io time="2024-03-10T09:25:44Z" level=info msg="Skipping resource customresourcedefinitions.apiextensions.k8s.io, because it's cluster-scoped and only specific namespaces or namespace scope types are included in the backup." backup=velero/postgres-backup logSource="pkg/util/collections/includes_excludes.go:155" time="2024-03-10T09:25:44Z" level=info msg="Summary for skipped PVs: []" backup=velero/postgres-backup logSource="pkg/backup/backup.go:434" time="2024-03-10T09:25:44Z" level=info msg="Backed up a total of 29 items" backup=velero/postgres-backup logSource="pkg/backup/backup.go:436" progress=

Then i deleted the postgres namespace and restored it.

$ velero restore create --from-backup postgres-backup

$ velero restore describe postgres-backup-20240310150017

Name: postgres-backup-20240310150017 Namespace: velero Labels: Annotations: Phase: Completed Total items to be restored: 18 Items restored: 18 Started: 2024-03-10 15:00:17 +0330 +0330 Completed: 2024-03-10 15:02:07 +0330 +0330 Warnings: Velero: Cluster: Namespaces: postgres: could not restore, ConfigMap "kube-root-ca.crt" already exists. Warning: the in-cluster version is different than the backed-up version Backup: postgres-backup Namespaces: Included: all namespaces found in the backup Excluded: Resources: Included: * Excluded: nodes, events, events.events.k8s.io, backups.velero.io, restores.velero.io, resticrepositories.velero.io, csinodes.storage.k8s.io, volumeattachments.storage.k8s.io, backuprepositories.velero.io Cluster-scoped: auto Namespace mappings: Label selector: Or label selector: Restore PVs: auto Existing Resource Policy: ItemOperationTimeout: 4h0m0s Preserve Service NodePorts: auto

$ velero restore describe postgres-backup-20240310150017 --details

Name: postgres-backup-20240310150017 Namespace: velero Labels: Annotations: Phase: Completed Total items to be restored: 18 Items restored: 18 Started: 2024-03-10 15:00:17 +0330 +0330 Completed: 2024-03-10 15:02:07 +0330 +0330 Warnings: Velero: Cluster: Namespaces: postgres: could not restore, ConfigMap "kube-root-ca.crt" already exists. Warning: the in-cluster version is different than the backed-up version Backup: postgres-backup Namespaces: Included: all namespaces found in the backup Excluded: Resources: Included: * Excluded: nodes, events, events.events.k8s.io, backups.velero.io, restores.velero.io, resticrepositories.velero.io, csinodes.storage.k8s.io, volumeattachments.storage.k8s.io, backuprepositories.velero.io Cluster-scoped: auto Namespace mappings: Label selector: Or label selector: Restore PVs: auto Existing Resource Policy: ItemOperationTimeout: 4h0m0s Preserve Service NodePorts: auto Resource List: apps/v1/ControllerRevision: - postgres/postgres-postgresql-6f78857f57(created) apps/v1/StatefulSet: - postgres/postgres-postgresql(created) discovery.k8s.io/v1/EndpointSlice: - postgres/postgres-postgresql-hl-vjvvq(created) - postgres/postgres-postgresql-kpsjg(created) networking.k8s.io/v1/NetworkPolicy: - postgres/postgres-postgresql(created) v1/ConfigMap: - postgres/kube-root-ca.crt(failed) v1/Endpoints: - postgres/postgres-postgresql(created) - postgres/postgres-postgresql-hl(created) v1/Namespace: - postgres(created) v1/PersistentVolume: - pvc-b00272c5-a904-4ff8-a3a6-e2ccfe35bc61(skipped) v1/PersistentVolumeClaim: - postgres/data-postgres-postgresql-0(created) v1/Pod: - postgres/postgres-postgresql-0(created) v1/Secret: - postgres/postgres-postgresql(created) - postgres/sh.helm.release.v1.postgres.v1(created) v1/Service: - postgres/postgres-postgresql(created) - postgres/postgres-postgresql-hl(created) v1/ServiceAccount: - postgres/default(skipped) - postgres/postgres-postgresql(created)

Once the restore completed, I tried to log in to the database, but it says the password is wrong. And also, there's a 'Defaulted container "postgresql" out of: postgresql, restore-wait (init)' message when I tried to access it.

$ kubectl exec -it -n postgres postgres-postgresql-0 -- psql -U postgres Defaulted container "postgresql" out of: postgresql, restore-wait (init) Password for user postgres: psql: error: connection to server on socket "/tmp/.s.PGSQL.5432" failed: FATAL: password authentication failed for user "postgres" command terminated with exit code 2

sseago commented 7 months ago

@Lyndon-Li regarding this: "About user-friendly, simply speaking, we need to consider users' true priority. For example, if they specify default-volumes-to-fs-backup + snapshot-move-data, what users want is --- I want to run consistent backup as more as possible, for others, I use fs-backup. So for the volumes that support CSI snapshot, snapshot-move-data should take preference even though opt-out is not specified. However, at present, Velero just takes fs-backup for them."

Note that @shubham-pampattiwar's current work on adding volume policies for fs-backup and snapshot will enable this. One of the primary example use cases there is "use snapshot when available, fs-backup when not".