apache / cloudstack

Apache CloudStack is an opensource Infrastructure as a Service (IaaS) cloud computing platform
https://cloudstack.apache.org/
Apache License 2.0
1.98k stars 1.09k forks source link

Dell EMC Networker integration #9601

Closed steven3579 closed 1 week ago

steven3579 commented 2 weeks ago

ISSUE TYPE

COMPONENT NAME Dell EMC Networker integration plugin CLOUDSTACK VERSION 4.19.1.1

CONFIGURATION Master node on Ubuntu 22, advanced networking, dell emc networker v 19.9.0.5

OS / ENVIRONMENT SUMMARY After configuring the networker plug. when I try to create a Backup Offering, but don't list the external backup policies of EMC Networker.

ACTUAL RESULTS

024-08-28 08:38:36,463 DEBUG [o.a.c.b.BackupManagerImpl] (qtp341748265-1403734:ctx-6492bdf4 ctx-c74d326c) (logid:53c3f977) Listing external backup offerings for the backup provider configured for zone ID 1
2024-08-28 08:38:36,497 DEBUG [o.a.c.b.n.NetworkerClient] (qtp341748265-1403734:ctx-6492bdf4 ctx-c74d326c) (logid:53c3f977) Trying to list backup EMC Networker Policies we can use
2024-08-28 08:38:45,601 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-289:ctx-c8e88a7c) (logid:1d93512b) Unable to find matched VM in CloudStack DB. name: cs-iperf01_backup
2024-08-28 08:39:35,966 DEBUG [o.a.c.b.BackupManagerImpl] (BackupPollTask:ctx-eecdb419) (logid:3127e2d3) Backup backup.poll is being called at 2024-08-28 08:39:35 GMT
2024-08-28 08:39:45,608 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-243:ctx-130648c1) (logid:a0862a1e) Unable to find matched VM in CloudStack DB. name: cs-iperf01_backup
2024-08-28 08:40:45,621 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-4b4ed255) (logid:8a0729ee) Unable to find matched VM in CloudStack DB. name: cs-iperf01_backup
2024-08-28 08:41:45,654 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-342:ctx-408d82c8) (logid:5f9a4b60) Unable to find matched VM in CloudStack DB. name: cs-iperf01_backup
2024-08-28 08:42:45,647 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-b3f6e211) (logid:fb72d8cf) Unable to find matched VM in CloudStack DB. name: cs-iperf01_backup
boring-cyborg[bot] commented 2 weeks ago

Thanks for opening your first issue here! Be sure to follow the issue template!

DaanHoogland commented 2 weeks ago

@fermosan can you tell if this looks like a bug or a configuration issue?

rajujith commented 2 weeks ago

@steven3579 Have you created policies on the Networker with the required tag, it is mandatory, and it should match the exact string -CSBKP-.

The tag -CSBKP- in the comment of the POLICY indicates that this policy is available to Cloudstack Other POLICIES used in your infrastructure will not be visible inside Cloudstack. It is recommended to create brand new POLICIES dedicated to Cloudstack and settings the Protection Periods to match the backup plan retention you wish to enable for each of the offerings.

https://docs.cloudstack.apache.org/en/latest/adminguide/networker_plugin.html

steven3579 commented 2 weeks ago

Hi @rajujith I have added tags to policies. I back up for VMware after I attach the VM to offer backup EMC Networker. I received the error code below OS / ENVIRONMENT

ACTUAL RESULTS Log UI (Z-Windows-001) Cannot find login credentials for HYPERVISOR 28209802-e385-40b1-865d-2aa0283ea86d

Log manager `2024-08-29 04:47:58,947 DEBUG [c.c.a.t.Request] (RouterStatusMonitor-1:ctx-617ba971) (logid:2c203308) Seq 2-1125618431866301545: Sending { Cmd , MgmtId: 40057382433780, via: 2(esxi02.x.cloud), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"healthChecksConfig":{"gateways":"gatewaysIps=192.168.1.254 192.168.100.254 ","portForwarding":"","systemThresholds":"minDiskNeeded=100.0,maxCpuUsage=100.0,maxMemoryUsage=100.0;","haproxyData":"","virtualMachines":"vmName=yc-demo-delete,macAddress=02:01:01:88:00:11,ip=10.1.1.20,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm11,macAddress=02:01:01:88:00:58,ip=10.1.1.219,dhcp=true,dns=true;vmName=v-windows10-lab-backup,macAddress=02:01:01:88:00:5e,ip=10.1.1.61,dhcp=true,dns=true;","routerVersion":"templateVersion=Cloudstack Release 4.19.1 Mon 08 Jul 2024 08:19:20 AM UTC,scriptsVersion=5e2bba15096d47ce03185c8b04a24f17 2024-08-29 04:47:58,948 DEBUG [c.c.a.t.Request] (RouterStatusMonitor-1:ctx-617ba971) (logid:2c203308) Seq 2-1125618431866301545: Executing: { Cmd , MgmtId: 40057382433780, via: 2(esxi02.x.cloud), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"healthChecksConfig":{"gateways":"gatewaysIps=192.168.1.254 192.168.100.254 ","portForwarding":"","systemThresholds":"minDiskNeeded=100.0,maxCpuUsage=100.0,maxMemoryUsage=100.0;","haproxyData":"","virtualMachines":"vmName=yc-demo-delete,macAddress=02:01:01:88:00:11,ip=10.1.1.20,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm11,macAddress=02:01:01:88:00:58,ip=10.1.1.219,dhcp=true,dns=true;vmName=v-windows10-lab-backup,macAddress=02:01:01:88:00:5e,ip=10.1.1.61,dhcp=true,dns=true;","routerVersion":"templateVersion=Cloudstack Release 4.19.1 Mon 08 Jul 2024 08:19:20 AM UTC,scriptsVersion=5e2bba15096d47ce03185c8b04a24f17 2024-08-29 04:47:58,948 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-240:ctx-9f8ea297) (logid:2c203308) Executing resource command SetMonitorServiceCommand: [{"healthChecksConfig":{"gateways":"gatewaysIps=192.168.1.254 192.168.100.254 ","portForwarding":"","systemThresholds":"minDiskNeeded=100.0,maxCpuUsage=100.0,maxMemoryUsage=100.0;","haproxyData":"","virtualMachines":"vmName=yc-demo-delete,macAddress=02:01:01:88:00:11,ip=10.1.1.20,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm09,macAddress=02:01:01:88:00:52,ip=10.1.1.132,dhcp=true,dns=true;vmName=ubuntu-lab-vm11,macAddress=02:01:01:88:00:58,ip=10.1.1.219,dhcp=true,dns=true;vmName=v-windows10-lab-backup,macAddress=02:01:01:88:00:5e,ip=10.1.1.61,dhcp=true,dns=true;","routerVersion":"templateVersion=Cloudstack Release 4.19.1 Mon 08 Jul 2024 08:19:20 AM UTC,scriptsVersion=5e2bba15096d47ce03185c8b04a24f17\n"},"reconfigureAfterUpdate":true,"deleteFromProcessedCache":true,"accessDetails":{"router.name":"r-2854-VM","router.health.checks.advanced.interval":"10","router.health.checks.enabled":"true","router.health.checks.basic.interval":"3","router.health.checks.excluded":"","router.ip":"192.168.1.49"},"wait":0,"bypassHostMaintenance":false}]. 2024-08-29 04:48:11,075 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (qtp341748265-1458810:ctx-b83c7661 ctx-02ce253c) (logid:ab0dd114) submit async job-34251, details: AsyncJobVO: {id:34251, userId: 2, accountId: 2, instanceType: Backup, instanceId: 2549, cmd: org.apache.cloudstack.api.command.user.backup.CreateBackupCmd, cmdInfo: {"virtualmachineid":"6b4c79b5-f18c-4ca5-8aeb-997510c0f643","response":"json","ctxUserId":"2","httpmethod":"GET","ctxStartEventId":"163294","id":"2549","ctxDetails":"{\"interface com.cloud.vm.VirtualMachine\":\"6b4c79b5-f18c-4ca5-8aeb-997510c0f643\"}","ctxAccountId":"2","cmdEventType":"BACKUP.CREATE"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 40057382433780, completeMsid: null, lastUpdated: null, lastPolled: null, created: null, removed: null} 2024-08-29 04:48:11,075 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-24:ctx-addef807 job-34251) (logid:a28e7110) Executing AsyncJobVO: {id:34251, userId: 2, accountId: 2, instanceType: Backup, instanceId: 2549, cmd: org.apache.cloudstack.api.command.user.backup.CreateBackupCmd, cmdInfo: {"virtualmachineid":"6b4c79b5-f18c-4ca5-8aeb-997510c0f643","response":"json","ctxUserId":"2","httpmethod":"GET","ctxStartEventId":"163294","id":"2549","ctxDetails":"{\"interface com.cloud.vm.VirtualMachine\":\"6b4c79b5-f18c-4ca5-8aeb-997510c0f643\"}","ctxAccountId":"2","cmdEventType":"BACKUP.CREATE"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 40057382433780, completeMsid: null, lastUpdated: null, lastPolled: null, created: null, removed: null} 2024-08-29 04:48:11,120 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-24:ctx-addef807 job-34251) (logid:a28e7110) Done executing org.apache.cloudstack.api.command.user.backup.CreateBackupCmd for job-34251

`

rajujith commented 2 weeks ago

@steven3579 The Networker backup plugin supports only KVM as of now. B&R framework support Veeam for ESXi.

https://docs.cloudstack.apache.org/en/latest/adminguide/virtual_machines.html#instance-backups-backup-and-recovery-feature