search

apache / cloudstack

Apache CloudStack is an opensource Infrastructure as a Service (IaaS) cloud computing platform
https://cloudstack.apache.org/
Apache License 2.0
2.05k stars 1.1k forks source link

Internal error reported by arm architecture server: No more available PCI slots #7770

Closed yjtzfywh closed 1 month ago

yjtzfywh commented 1 year ago
ISSUE TYPE
COMPONENT NAME

Advanced network mode(VPC), instance creation, agent error: No more available PCI slots；

CLOUDSTACK VERSION

4.18.0 The download code url: https://dlcdn.apache.org/cloudstack/releases/4.18.0.0/apache-cloudstack-4.18.0.0-src.tar.bz2

CONFIGURATION

advanced networking

OS / ENVIRONMENT

openEuler 22.09 CPU architecture aarch64

SUMMARY

OpenEuler 22.09 operating system, cup architecture aarch64, instance creation failed in advanced network mode, agent error No more available PCI slots.

STEPS TO REPRODUCE
  1. Create VPC;
  2. Create a network;
  3. Create an instance and start it;
  4. Cloudstack management log 2023-07-19 13:46:55,480 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-17:ctx-8aa465bf job-22) (logid:08e7acf0) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM [68f8a4d1-4d01-4a16-9fcb-1f1edbd79d80] due to [Unable to create a deployment for VM instance {"id":4,"instanceName":"i-2-4-VM","type":"User","uuid":"68f8a4d1-4d01-4a16-9fcb-1f1edbd79d80"}]. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:822) at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:246) at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:214) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:5370) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:5220) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3164) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) at com.sun.proxy.$Proxy186.startVirtualMachine(Unknown Source) at org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:180) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:163) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:106) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM instance {"id":4,"instanceName":"i-2-4-VM","type":"User","uuid":"68f8a4d1-4d01-4a16-9fcb-1f1edbd79d80"}Scope=interface com.cloud.dc.DataCenter; id=1 at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1166) at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5351) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ... 18 more 2023-07-19 13:46:55,485 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-17:ctx-8aa465bf job-22) (logid:08e7acf0) Complete async job-22, jobStatus: FAILED, resultCode: 530, result:
  5. Cloudstack agent.log 2023-07-19 13:46:54,521 WARN [resource.wrapper.LibvirtPlugNicCommandWrapper] (agentRequest-Handler-3:null) (logid:08e7acf0) Plug Nic failed due to org.libvirt.LibvirtException: internal error: No more available PCI slots org.libvirt.LibvirtException: internal error: No more available PCI slots at org.libvirt.ErrorHandler.processError(Unknown Source) at org.libvirt.ErrorHandler.processError(Unknown Source) at org.libvirt.Domain.attachDevice(Unknown Source) at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtPlugNicCommandWrapper.execute(LibvirtPlugNicCommandWrapper.java:67) at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtPlugNicCommandWrapper.execute(LibvirtPlugNicCommandWrapper.java:40) at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1847) at com.cloud.agent.Agent.processRequest(Agent.java:662) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1082) at com.cloud.utils.nio.Task.call(Task.java:83) at com.cloud.utils.nio.Task.call(Task.java:29) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829)
  6. Virtual Router XML ` r-874-VM b1483994-67ef-4a48-8405-ed8f003b1525 Debian GNU/Linux 5.0 (64-bit) 262144 262144 1 500 /machine Apache Software Foundation CloudStack KVM Hypervisor b1483994-67ef-4a48-8405-ed8f003b1525 hvm /usr/share/AAVMF/AAVMF_CODE.fd /var/lib/libvirt/qemu/nvram/r-874-VM_VARS.fd destroy restart destroy /usr/libexec/qemu-kvm 844fb7c8dbea44d6925e
EXPECTED RESULTS

Create an instance and successfully start it

ACTUAL RESULTS

Failed to create an instance and start it

boring-cyborg[bot] commented 1 year ago

Thanks for opening your first issue here! Be sure to follow the issue template!

yjtzfywh commented 1 year ago

`

r-874-VM b1483994-67ef-4a48-8405-ed8f003b1525 Debian GNU/Linux 5.0 (64-bit) 262144 262144 1 500 /machine Apache Software Foundation CloudStack KVM Hypervisor b1483994-67ef-4a48-8405-ed8f003b1525 hvm /usr/share/AAVMF/AAVMF_CODE.fd /var/lib/libvirt/qemu/nvram/r-874-VM_VARS.fd destroy restart destroy /usr/libexec/qemu-kvm 844fb7c8dbea44d6925e
DaanHoogland commented 1 year ago

@rohityadavcloud can you have a look at this one?

rohityadavcloud commented 8 months ago

Thanks for sharing @MinosCN were you able to make further progress? Could you try the latest 4.18.1.0?

yjtzfywh commented 1 month ago

It has been processed