intel / Edge-Software-Provisioner

BSD 3-Clause "New" or "Revised" License
42 stars 31 forks source link

Both Legacy Mode Boot / UEFI Mode Bios Mode can not pass the PXE boot #44

Open boxu-intel opened 1 year ago

boxu-intel commented 1 year ago

Hi, there We try to build and run latest version of ESP. When the target machine is configured as Legacy boot with PXE enabled, it report : NBP is too big to fit in free base memory. When the target machine is configured as UEFI bios mode with PXE enabled, it report: nothing to boot no such file or directory (http //ipxe.org/xxxx) So is there any pointer we can debug more ? I think probably because the DNSMasq is not well configured, but we don't know how to proceed the next step. The topology of the network is one router with DHCP enabled which can access external network, and 2 machines are connected to the router, 1 is ESP server and the other is the target machine.

brod-intel commented 1 year ago

What is the base hardware? How much memory? Also, run docker logs esp_dnsmasq_1 to show the log output during a pxe boot. Send the output.

boxu-intel commented 1 year ago

Hello, for this issue , this is the Target machine information: Target machine UEFI PXE boot message: /***

Checking Media Presence...... Media Present...... Downloading NBP file... NBP file downloaded successfully. iPXE initialising devices...ok iPXE1.21.1(g988d2)-- 0pen Source Network Boot Firmware -- http://ipxe.org Features:DNS FTP HTTP HTTPS ISCSI NFS SLAM TFTP SRP VLAN AOE EFI Menu net0:ec:d6:8a:95:51:7f using i219v-7 on 0000:00:1f.6(open) [Link:down,TX:0 TXE:0 RX:0 RXE:0] [Link status: Down(http://ipxe.org/38086193)] Waiting for link-up on net0.... ok Configuring(net0 ec:d6:8a:95:51:7f)...... ok net0:192.168.1.24/255.255.255.0 gw 192.168.1.1 net0:fe80::eed6:8aff:fe95:517f/64 Nothing to boot:No such file or directory (http://ipxe.org/2d03e18e) No more network devices ****/

Target machine BIOS information: /** Advanced: Power Settings Deep S5: [Disabled] Power Loss: [0ff] G3 Wakeup: [Disabled] USB WakeUp: [Enabled] LAN Wakeup: [Enabled] RTC Wakeup: [Disabled]

Boot: Boot Configuration Set Setup Prompt Timeout: 3 Bootup NumLock State: [On] Full Screen Logo: [Enabled] USB Mass Storage Driver Support: [Enabled] Boot Option Priorities Boot 0ption #1: [UEFI: PXE IPV4 Intel(r) Ethernet Connection (7) I219-V] Boot 0ption #2: [ubuntu(P1: Hoodisk SSD)]

Main: BIOS vendor: American Megatrends Project version: CMLOTA-010 R03 Build Date and Time: 11/01/2021 17:36:07 Access Level: Administrator System Information System Serial Number: [some SN] CPU Intel(R)Core(TH) i5-10200H CPU @2.40GHZ Total Memory 8192 MB Memory Speed 2667 MHZ Machine Type and Model: INVALID System Brand ID: Lenovo Product System UUID: INVALID Asset Tag: Default string Ethernet MAC Address: EC-D6-8A-95-51-7F M.2 SATA: Hoodisk SSD (256.0GB) SATA 1: Empty SATA 2: Empty

Chipset: LCD Panel Type [1920x1080 Double 8] M.2 Interface: [Auto] Onboard Devices Serial Port: [Enabled] Lan BootROM: [Enabled] PCH LAN Controller: [Enabled] Ver,2.21.1277 ***/

boxu-intel commented 1 year ago

Hello, for this issue , this is the Provisioner Server's docker log information for a whole process of provisioning: 2022-12-01T06:35:50.871326240Z dnsmasq-dhcp: 3391103292 available DHCP range: 192.168.1.100 -- 192.168.1.250 2022-12-01T06:35:50.871473770Z dnsmasq-dhcp: 3391103292 vendor class: PXEClient:Arch:00007:UNDI:003016 2022-12-01T06:35:50.871508284Z dnsmasq-dhcp: 3391103292 DHCPDISCOVER(eno1) ec:d6:8a:95:51:7f 2022-12-01T06:35:50.871534925Z dnsmasq-dhcp: 3391103292 tags: BC_EFI, eno1 2022-12-01T06:35:50.871558679Z dnsmasq-dhcp: 3391103292 DHCPOFFER(eno1) 192.168.1.246 ec:d6:8a:95:51:7f 2022-12-01T06:35:50.871582086Z dnsmasq-dhcp: 3391103292 requested options: 1:netmask, 2:time-offset, 3:router, 4, 5, 2022-12-01T06:35:50.871621884Z dnsmasq-dhcp: 3391103292 requested options: 6:dns-server, 12:hostname, 13:boot-file-size, 2022-12-01T06:35:50.871657118Z dnsmasq-dhcp: 3391103292 requested options: 15:domain-name, 17:root-path, 18:extension-path, 2022-12-01T06:35:50.871679439Z dnsmasq-dhcp: 3391103292 requested options: 22:max-datagram-reassembly, 23:default-ttl, 2022-12-01T06:35:50.871706626Z dnsmasq-dhcp: 3391103292 requested options: 28:broadcast, 40:nis-domain, 41:nis-server, 2022-12-01T06:35:50.871726072Z dnsmasq-dhcp: 3391103292 requested options: 42:ntp-server, 43:vendor-encap, 50:requested-address, 2022-12-01T06:35:50.871745914Z dnsmasq-dhcp: 3391103292 requested options: 51:lease-time, 54:server-identifier, 58:T1, 2022-12-01T06:35:50.871770247Z dnsmasq-dhcp: 3391103292 requested options: 59:T2, 60:vendor-class, 66:tftp-server, 67:bootfile-name, 2022-12-01T06:35:50.871790063Z dnsmasq-dhcp: 3391103292 requested options: 97:client-machine-id, 128, 129, 130, 131, 2022-12-01T06:35:50.871875856Z dnsmasq-dhcp: 3391103292 requested options: 132, 133, 134, 135 2022-12-01T06:35:50.871959767Z dnsmasq-dhcp: 3391103292 next server: 192.168.1.21 2022-12-01T06:35:50.872032315Z dnsmasq-dhcp: 3391103292 broadcast response 2022-12-01T06:35:50.872063097Z dnsmasq-dhcp: 3391103292 sent size: 1 option: 53 message-type 2 2022-12-01T06:35:50.872102385Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 54 server-identifier 192.168.1.21 2022-12-01T06:35:50.872127746Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 51 lease-time 6h 2022-12-01T06:35:50.872149748Z dnsmasq-dhcp: 3391103292 sent size: 20 option: 67 bootfile-name ipxe/efi64/ipxe.efi 2022-12-01T06:35:50.872172379Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 58 T1 3h 2022-12-01T06:35:50.872223927Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 59 T2 5h15m 2022-12-01T06:35:50.872250439Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 1 netmask 255.255.255.0 2022-12-01T06:35:50.872274994Z dnsmasq-dhcp: 3391103292 sent size: 13 option: 15 domain-name builder.local 2022-12-01T06:35:50.872301334Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 28 broadcast 192.168.1.255 2022-12-01T06:35:50.872322931Z dnsmasq-dhcp: 3391103292 sent size: 8 option: 6 dns-server 8.8.4.4, 8.8.8.8 2022-12-01T06:35:50.872368806Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 3 router 192.168.1.1 2022-12-01T06:35:54.381277350Z dnsmasq-dhcp: 3391103292 available DHCP range: 192.168.1.100 -- 192.168.1.250 2022-12-01T06:35:54.381373587Z dnsmasq-dhcp: 3391103292 vendor class: PXEClient:Arch:00007:UNDI:003016 2022-12-01T06:35:54.381395041Z dnsmasq-dhcp: 3391103292 DHCPREQUEST(eno1) 192.168.1.246 ec:d6:8a:95:51:7f 2022-12-01T06:35:54.381408738Z dnsmasq-dhcp: 3391103292 tags: BC_EFI, eno1 2022-12-01T06:35:54.381429388Z dnsmasq-dhcp: 3391103292 DHCPACK(eno1) 192.168.1.246 ec:d6:8a:95:51:7f 2022-12-01T06:35:54.381461115Z dnsmasq-dhcp: 3391103292 requested options: 1:netmask, 2:time-offset, 3:router, 4, 5, 2022-12-01T06:35:54.381484374Z dnsmasq-dhcp: 3391103292 requested options: 6:dns-server, 12:hostname, 13:boot-file-size, 2022-12-01T06:35:54.381518403Z dnsmasq-dhcp: 3391103292 requested options: 15:domain-name, 17:root-path, 18:extension-path, 2022-12-01T06:35:54.381533430Z dnsmasq-dhcp: 3391103292 requested options: 22:max-datagram-reassembly, 23:default-ttl, 2022-12-01T06:35:54.381547732Z dnsmasq-dhcp: 3391103292 requested options: 28:broadcast, 40:nis-domain, 41:nis-server, 2022-12-01T06:35:54.381573145Z dnsmasq-dhcp: 3391103292 requested options: 42:ntp-server, 43:vendor-encap, 50:requested-address, 2022-12-01T06:35:54.381601403Z dnsmasq-dhcp: 3391103292 requested options: 51:lease-time, 54:server-identifier, 58:T1, 2022-12-01T06:35:54.381622234Z dnsmasq-dhcp: 3391103292 requested options: 59:T2, 60:vendor-class, 66:tftp-server, 67:bootfile-name, 2022-12-01T06:35:54.381689708Z dnsmasq-dhcp: 3391103292 requested options: 97:client-machine-id, 128, 129, 130, 131, 2022-12-01T06:35:54.381815542Z dnsmasq-dhcp: 3391103292 requested options: 132, 133, 134, 135 2022-12-01T06:35:54.381852229Z dnsmasq-dhcp: 3391103292 next server: 192.168.1.21 2022-12-01T06:35:54.381875356Z dnsmasq-dhcp: 3391103292 broadcast response 2022-12-01T06:35:54.381896316Z dnsmasq-dhcp: 3391103292 sent size: 1 option: 53 message-type 5 2022-12-01T06:35:54.381917084Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 54 server-identifier 192.168.1.21 2022-12-01T06:35:54.381950298Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 51 lease-time 6h 2022-12-01T06:35:54.381971927Z dnsmasq-dhcp: 3391103292 sent size: 20 option: 67 bootfile-name ipxe/efi64/ipxe.efi 2022-12-01T06:35:54.381995991Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 58 T1 3h 2022-12-01T06:35:54.382187819Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 59 T2 5h15m 2022-12-01T06:35:54.382278274Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 1 netmask 255.255.255.0 2022-12-01T06:35:54.382312877Z dnsmasq-dhcp: 3391103292 sent size: 13 option: 15 domain-name builder.local 2022-12-01T06:35:54.382339381Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 28 broadcast 192.168.1.255 2022-12-01T06:35:54.382380363Z dnsmasq-dhcp: 3391103292 sent size: 8 option: 6 dns-server 8.8.4.4, 8.8.8.8 2022-12-01T06:35:54.382404814Z dnsmasq-dhcp: 3391103292 sent size: 4 option: 3 router 192.168.1.1 2022-12-01T06:35:54.386819697Z dnsmasq-tftp: error 8 User aborted the transfer received from 192.168.1.246 2022-12-01T06:35:54.386879304Z dnsmasq-tftp: sent /srv/tftp/ipxe/efi64/ipxe.efi to 192.168.1.246 2022-12-01T06:35:54.552255515Z dnsmasq-tftp: sent /srv/tftp/ipxe/efi64/ipxe.efi to 192.168.1.246 2022-12-01T06:35:59.293094328Z dnsmasq-dhcp: 671376486 available DHCP range: 192.168.1.100 -- 192.168.1.250 2022-12-01T06:35:59.293237312Z dnsmasq-dhcp: 671376486 vendor class: PXEClient:Arch:00007:UNDI:003010 2022-12-01T06:35:59.293280200Z dnsmasq-dhcp: 671376486 user class: iPXE 2022-12-01T06:35:59.293309525Z dnsmasq-dhcp: 671376486 DHCPDISCOVER(eno1) ec:d6:8a:95:51:7f 2022-12-01T06:35:59.293334471Z dnsmasq-dhcp: 671376486 tags: iPXE, BC_EFI, ipxe, eno1 2022-12-01T06:35:59.293360109Z dnsmasq-dhcp: 671376486 DHCPOFFER(eno1) 192.168.1.246 ec:d6:8a:95:51:7f 2022-12-01T06:35:59.293388783Z dnsmasq-dhcp: 671376486 requested options: 1:netmask, 3:router, 6:dns-server, 7:log-server, 2022-12-01T06:35:59.293427692Z dnsmasq-dhcp: 671376486 requested options: 12:hostname, 15:domain-name, 17:root-path, 2022-12-01T06:35:59.293459280Z dnsmasq-dhcp: 671376486 requested options: 26:mtu, 43:vendor-encap, 60:vendor-class, 2022-12-01T06:35:59.293487817Z dnsmasq-dhcp: 671376486 requested options: 66:tftp-server, 67:bootfile-name, 119:domain-search, 2022-12-01T06:35:59.293514317Z dnsmasq-dhcp: 671376486 requested options: 128, 129, 130, 131, 132, 133, 134, 135, 175, 2022-12-01T06:35:59.293539738Z dnsmasq-dhcp: 671376486 requested options: 203 2022-12-01T06:35:59.293567401Z dnsmasq-dhcp: 671376486 next server: 192.168.1.21 2022-12-01T06:35:59.293641863Z dnsmasq-dhcp: 671376486 sent size: 1 option: 53 message-type 2 2022-12-01T06:35:59.293676322Z dnsmasq-dhcp: 671376486 sent size: 4 option: 54 server-identifier 192.168.1.21 2022-12-01T06:35:59.293702761Z dnsmasq-dhcp: 671376486 sent size: 4 option: 51 lease-time 6h 2022-12-01T06:35:59.293726051Z dnsmasq-dhcp: 671376486 sent size: 30 option: 67 bootfile-name http://192.168.1.21/menu.ipxe 2022-12-01T06:35:59.293751542Z dnsmasq-dhcp: 671376486 sent size: 4 option: 58 T1 3h 2022-12-01T06:35:59.293780788Z dnsmasq-dhcp: 671376486 sent size: 4 option: 59 T2 5h15m 2022-12-01T06:35:59.293805425Z dnsmasq-dhcp: 671376486 sent size: 4 option: 1 netmask 255.255.255.0 2022-12-01T06:35:59.293833193Z dnsmasq-dhcp: 671376486 sent size: 13 option: 15 domain-name builder.local 2022-12-01T06:35:59.293863422Z dnsmasq-dhcp: 671376486 sent size: 8 option: 6 dns-server 8.8.4.4, 8.8.8.8 2022-12-01T06:35:59.294173214Z dnsmasq-dhcp: 671376486 sent size: 4 option: 3 router 192.168.1.1 2022-12-01T06:36:01.314254963Z dnsmasq-dhcp: 671376486 available DHCP range: 192.168.1.100 -- 192.168.1.250 2022-12-01T06:36:01.314360721Z dnsmasq-dhcp: 671376486 vendor class: PXEClient:Arch:00007:UNDI:003010 2022-12-01T06:36:01.314390350Z dnsmasq-dhcp: 671376486 user class: iPXE

boxu-intel commented 1 year ago

Is this issue because of the network configuration? currently we use 1 router with DHCP enabled. the router has configured as DHCP Server, and the available DHCP range is from 192.168.1.100~192.168.1.250 as default. Provisioner server and target machine are both connected to this router. Any recommended topology will be appreciated. we are planning to use 1 router and 1 switch to isolate the router DHCP server from 2 machines. and 2 machines will be connected to the switch, 2 Ethernet interfaces will be used in provisioner machine. 1 interface will be connected to router and the other interface will be connected to the switch which has no DHCP function.

brod-intel commented 1 year ago

Your topology is correct. This not a network problem. Everything is working in network terms. I am seeing user aborted transfer of files. Also make sure this file is accessible on the network: http://192.168.1.21/menu.ipxe. If you get file not found then the build.sh process did not complete. run ./build.sh -P -S to generate the menu.ipxe.