GPUOpen-LibrariesAndSDKs / MxGPU-Virtualization

MIT License
182 stars 84 forks source link

it can used in Dell R720XD? #38

Open vipsql opened 3 years ago

vipsql commented 3 years ago

HardWare: Dell R720XD (VT-X +SRIOV is open) + S7150X2 OS: CentOS7.8 shell#dmesg | grep gim [ 162.019958] gim: loading out-of-tree module taints kernel. [ 162.023581] gim: module verification failed: signature and/or required key missing - tainting kernel [ 162.028928] gim info:(gim_init:149) Start AMD open source GIM initialization [ 162.028934] gim info:(gim_init:152) GPU IOV MODULE - version 0.0 [ 162.028937] gim info:(gim_init:154) Copyright (c) 2014-2017 Advanced Micro Devices, Inc. All rights reserved. [ 162.030327] gim info:(parse_config_file:219) AMD GIM fb_option = 0 [ 162.030334] gim info:(parse_config_file:219) AMD GIM sched_option = 0 [ 162.030338] gim info:(parse_config_file:219) AMD GIM vf_num = 0 [ 162.030341] gim info:(parse_config_file:219) AMD GIM pf_fb = 0 [ 162.030345] gim info:(parse_config_file:219) AMD GIM vf_fb = 0 [ 162.030349] gim info:(parse_config_file:219) AMD GIM sched_interval = 0 [ 162.030353] gim info:(parse_config_file:219) AMD GIM sched_interval_us = 0 [ 162.030357] gim info:(parse_config_file:219) AMD GIM fb_clear = 0 [ 162.030361] gim info:(init_config:341) INIT CONFIG [ 162.035756] gim info:(set_new_adapter:572) curr allocated at ffffffffc095bb80 [ 162.035761] gim info:(set_new_adapter:579) SRIOV is supported [ 162.035769] gim info:(set_new_adapter:587) found PCI bridge device [ 162.035772] gim info:(set_new_adapter:591) found: 43:8.0 [ 162.035811] gim info:(set_new_adapter:608) mmio_base = ffffb0c807700000 [ 162.035825] gim info:(set_new_adapter:610) doorbell = ffffb0c808400000 [ 162.035853] gim info:(set_new_adapter:612) pf.fb_va = ffffb0c840000000 [ 162.035872] gim info:(sriov_is_ari_enabled:164) PCI_SRIOV_CAP = 0x00000002 [ 162.035876] gim info:(sriov_is_ari_enabled:174) PCI_SRIOV_CTRL = 0x00000010 [ 162.035878] gim info:(sriov_is_ari_enabled:177) PCI_SRIOV_CTRL_ARI is set --> ARI is supported [ 162.035883] gim info:(program_ari_mode:441) Read bif_strap8 = 0x00200004 [ 162.035886] gim info:(program_ari_mode:446) program_ari_mode - Set ARI_Mode = PF_BUS [ 162.035889] gim info:(program_ari_mode:456) Write bif_strap8 = 0x00000004 [ 162.035891] gim info:(gim_read_rom_from_reg:181) Reading VBios from ROM [ 162.036013] gim info:(gim_read_vbios:243) VBIOS starts: 0x55, 0xaa [ 162.036016] gim info:(gim_read_vbios:246) VBios size is 0x10000 [ 162.036032] gim info:(gim_read_vbios:249) vbios allocated at ffffb0c807663000 [ 162.036035] gim info:(gim_read_rom_from_reg:181) Reading VBios from ROM [ 162.174479] gim info:(gim_read_vbios:257) BIOS Version Major 0xF Minor 0x31 [ 162.174534] gim info:(gim_read_vbios:270) Valid video BIOS image, [ 162.174535] gim info:(gim_read_vbios:271) size = 0x10000, check sum is 0x541300 [ 162.174539] gim info:(gim_post_vbios:302) Init Parser passed!, continue [ 162.174542] gim info:(atom_chk_asic_status:333) ATOM_CheckAsicStatus - BIOS_SCRATCH_7 = 0x00000000 [ 162.174544] gim info:(atom_chk_asic_status:336) Isolate ATOM_S7_ASIC_INIT_COMPLETE_MASK bit(s) = 0x00000000 [ 162.174547] gim info:(atom_chk_asic_status:339) RLC_CNTL = 0x00000000 [ 162.174548] gim info:(atom_chk_asic_status:341) Isolate RLC_CNTL__RLC_ENABLE_F32_MASK = 0x00000000 [ 162.174549] gim info:(atom_chk_asic_status:348) ATOM_ASIC_NEED_POST [ 162.174551] gim info:(gim_post_vbios:305) Asic needs a VBios post [ 162.174552] gim info:(atom_post_vbios:200) ATOM_PostVBIOS: firmware_info passed [ 162.174554] gim info:(atom_post_vbios:253) asic_init before, engine clock = 7530; memory clock =1e848 [ 162.499440] gim info:(atom_post_vbios:256) asic_init after [ 162.499441] gim info:(atom_post_vbios:263) atom_init_fan_cntl before [ 162.499442] gim info:(atom_post_vbios:265) atom_init_fan_cntl after [ 162.499443] gim info:(gim_post_vbios:311) Post INIT_ASIC successfully! [ 162.499461] gim info:(firmware_requires_update:510) SMU option ROM version 0x111700 [ 162.499462] gim info:(firmware_requires_update:511) versus patch version 0x111a00 [ 162.499475] gim info:(firmware_requires_update:521) RLCV option ROM version 113 versus patch version 129 [ 162.499477] gim info:(firmware_requires_update:526) TOC found, update it [ 162.499479] gim info:(patch_firmware:586) Update smc_init table [ 163.065380] gim info:(patch_firmware:619) Update smu firmware [ 163.065442] gim info:(patch_firmware:628) Update RLCV firmware [ 163.065446] gim info:(patch_firmware:637) Update TOC [ 163.065465] gim info:(gim_post_vbios:317) Asic needs firmware loaded [ 163.065466] gim info:(atom_post_vbios:200) ATOM_PostVBIOS: firmware_info passed [ 163.065468] gim info:(atom_post_vbios:239) just load uCode [ 163.065469] gim info:(atom_post_vbios:253) asic_init before, engine clock = 7530; memory clock =1e848 [ 164.620852] gim info:(atom_post_vbios:256) asic_init after [ 164.620853] gim info:(atom_post_vbios:263) atom_init_fan_cntl before [ 164.620854] gim info:(atom_post_vbios:265) atom_init_fan_cntl after [ 164.620855] gim info:(gim_post_vbios:323) Post LOAD_FW successfully! [ 164.620856] gim info:(gim_post_vbios:324) Post VBIOS successfully! [ 164.620858] gim info:(set_new_adapter:640) gim_post_vbios done [ 164.620859] gim info:(set_new_adapter:661) Scheduler Time interval is per-vf from XL [ 164.620860] gim info:(set_new_adapter:662) config file [ 164.620861] gim info:(enable_sriov:299) Enable SRIOV [ 164.620863] gim info:(enable_sriov:300) Enable SRIOV vfs count = 16 [ 164.620900] gim error:(enable_sriov:311) Fail to enable sriov, status = fffffff4 [ 164.620923] gim error:(set_new_adapter:668) Failed to properly enable SRIOV [ 164.620946] gim info:(gim_probe:91) AMD GIM probe: pf_count = 1 [ 164.620947] gim info:(set_new_adapter:572) curr allocated at ffffffffc096b268 [ 164.620948] gim info:(set_new_adapter:579) SRIOV is supported [ 164.620953] gim info:(set_new_adapter:587) found PCI bridge device [ 164.620954] gim info:(set_new_adapter:591) found: 43:10.0 [ 164.620961] gim info:(set_new_adapter:608) mmio_base = ffffb0c807780000 [ 164.620967] gim info:(set_new_adapter:610) doorbell = ffffb0c809000000 [ 164.620976] gim info:(set_new_adapter:612) pf.fb_va = ffffb0c860000000 [ 164.620986] gim info:(sriov_is_ari_enabled:164) PCI_SRIOV_CAP = 0x00000002 [ 164.620988] gim info:(sriov_is_ari_enabled:174) PCI_SRIOV_CTRL = 0x00000010 [ 164.620989] gim info:(sriov_is_ari_enabled:177) PCI_SRIOV_CTRL_ARI is set --> ARI is supported [ 164.620992] gim info:(program_ari_mode:441) Read bif_strap8 = 0x00200004 [ 164.620994] gim info:(program_ari_mode:446) program_ari_mode - Set ARI_Mode = PF_BUS [ 164.620995] gim info:(program_ari_mode:456) Write bif_strap8 = 0x00000004 [ 164.620996] gim info:(gim_read_rom_from_reg:181) Reading VBios from ROM [ 164.621115] gim info:(gim_read_vbios:243) VBIOS starts: 0x55, 0xaa [ 164.621116] gim info:(gim_read_vbios:246) VBios size is 0x10000 [ 164.621123] gim info:(gim_read_vbios:249) vbios allocated at ffffb0c8076b4000 [ 164.621125] gim info:(gim_read_rom_from_reg:181) Reading VBios from ROM [ 164.759276] gim info:(gim_read_vbios:257) BIOS Version Major 0xF Minor 0x31 [ 164.759323] gim info:(gim_read_vbios:270) Valid video BIOS image, [ 164.759325] gim info:(gim_read_vbios:271) size = 0x10000, check sum is 0x541300 [ 164.759328] gim info:(gim_post_vbios:302) Init Parser passed!, continue [ 164.759331] gim info:(atom_chk_asic_status:333) ATOM_CheckAsicStatus - BIOS_SCRATCH_7 = 0x00000000 [ 164.759332] gim info:(atom_chk_asic_status:336) Isolate ATOM_S7_ASIC_INIT_COMPLETE_MASK bit(s) = 0x00000000 [ 164.759335] gim info:(atom_chk_asic_status:339) RLC_CNTL = 0x00000000 [ 164.759336] gim info:(atom_chk_asic_status:341) Isolate RLC_CNTL__RLC_ENABLE_F32_MASK = 0x00000000 [ 164.759337] gim info:(atom_chk_asic_status:348) ATOM_ASIC_NEED_POST [ 164.759338] gim info:(gim_post_vbios:305) Asic needs a VBios post [ 164.759339] gim info:(atom_post_vbios:200) ATOM_PostVBIOS: firmware_info passed [ 164.759341] gim info:(atom_post_vbios:253) asic_init before, engine clock = 7530; memory clock =1e848 [ 165.083127] gim info:(atom_post_vbios:256) asic_init after [ 165.083129] gim info:(atom_post_vbios:263) atom_init_fan_cntl before [ 165.083130] gim info:(atom_post_vbios:265) atom_init_fan_cntl after [ 165.083131] gim info:(gim_post_vbios:311) Post INIT_ASIC successfully! [ 165.083143] gim info:(firmware_requires_update:510) SMU option ROM version 0x111700 [ 165.083145] gim info:(firmware_requires_update:511) versus patch version 0x111a00 [ 165.083157] gim info:(firmware_requires_update:521) RLCV option ROM version 113 versus patch version 129 [ 165.083158] gim info:(firmware_requires_update:526) TOC found, update it [ 165.083160] gim info:(patch_firmware:586) Update smc_init table [ 165.644979] gim info:(patch_firmware:619) Update smu firmware [ 165.645023] gim info:(patch_firmware:628) Update RLCV firmware [ 165.645026] gim info:(patch_firmware:637) Update TOC [ 165.645044] gim info:(gim_post_vbios:317) Asic needs firmware loaded [ 165.645045] gim info:(atom_post_vbios:200) ATOM_PostVBIOS: firmware_info passed [ 165.645046] gim info:(atom_post_vbios:239) just load uCode [ 165.645048] gim info:(atom_post_vbios:253) asic_init before, engine clock = 7530; memory clock =1e848 [ 166.874366] gim info:(atom_post_vbios:256) asic_init after [ 166.874368] gim info:(atom_post_vbios:263) atom_init_fan_cntl before [ 166.874369] gim info:(atom_post_vbios:265) atom_init_fan_cntl after [ 166.874370] gim info:(gim_post_vbios:323) Post LOAD_FW successfully! [ 166.874371] gim info:(gim_post_vbios:324) Post VBIOS successfully! [ 166.874372] gim info:(set_new_adapter:640) gim_post_vbios done [ 166.874373] gim info:(set_new_adapter:661) Scheduler Time interval is per-vf from XL [ 166.874374] gim info:(set_new_adapter:662) config file [ 166.874376] gim info:(enable_sriov:299) Enable SRIOV [ 166.874377] gim info:(enable_sriov:300) Enable SRIOV vfs count = 16 [ 166.874407] gim error:(enable_sriov:311) Fail to enable sriov, status = fffffff4 [ 166.874430] gim error:(set_new_adapter:668) Failed to properly enable SRIOV [ 166.874453] gim info:(gim_probe:91) AMD GIM probe: pf_count = 2

errors: [ 166.874407] gim error:(enable_sriov:311) Fail to enable sriov, status = fffffff4 [ 166.874430] gim error:(set_new_adapter:668) Failed to properly enable SRIOV

JoveYu commented 1 year ago

enable SRIOV on BIOS

vipsql commented 1 year ago

it's Tested, Not Resolved

markednmbr1 commented 1 year ago

I wouldn't bother trying to get this work, there has been no commitment from AMD to develop this for open source as proven by 4 years of no commits.

On Mon, 19 Sept 2022 at 09:38, pyja @.***> wrote:

it's Tested, Not Resolved

— Reply to this email directly, view it on GitHub https://github.com/GPUOpen-LibrariesAndSDKs/MxGPU-Virtualization/issues/38#issuecomment-1250728544, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALPVINQK4YKVFG4R66P35KTV7AQ73ANCNFSM4U56ECIA . You are receiving this because you are subscribed to this thread.