search

DualCoder / vgpu_unlock

Unlock vGPU functionality for consumer grade GPUs.
MIT License
4.6k stars 429 forks source link

Ampere support #8

Open judge2020 opened 3 years ago

judge2020 commented 3 years ago

An RTX A4000 was spotted, presumably built on GA104, so we should be on the look-out for a new driver that supports this GPU and test it out on existing consumer-grade 30-series cards.

KrutavShah commented 3 years ago

Can we rename this issue to Ampere Support? The reality is, we haven't even gotten the GA102 cards working yet, so we are all hard at work figuring out.

Currently, the latest vGPU driver is 460.32.04 which supports GA102 but no sign of GA104 yet. One thing to note as well is that Nvidia doesn't constantly release these drivers since they are part of enterprise product, so updates are going to be a bit slow to come, with GA104 support coming when the card is released.

grandprixgp commented 3 years ago

Any plans for AMD support in the future?

KrutavShah commented 3 years ago

AMD support should be relatively the same to achieve: spoof PCI ID and do some IOCTL stuff and then we will be able to achieve SRIOV on cards like RX 480 and a few select others.

DualCoder commented 3 years ago

AMD GPUs will not be supported by vgpu_unlock. That would have to be a separate project.

grandprixgp commented 3 years ago

AMD GPUs will not be supported by vgpu_unlock. That would have to be a separate project.

Is there a specific reason? If a similar method was achievable and a PR was submitted you wouldn't be interested?

lambdatastic commented 3 years ago

Is there a specific reason?

The underlying tech is different / custom for each manufacturer, so the finer details of the workaround for Nvidia vGPU won't work for AMD's MxGPU / general SR-IOV. I'd imagine that's the reason to keep an AMD project separate.

marcosscriven commented 3 years ago

I have an RTX3080 - is there anything I can do or try that would help here?

olealgoritme commented 3 years ago

If anyone spots the RTX A5000 vGPU profiles, we could start testing with these for ampere :) From the looks of it, RTX A4000 does not support vGPU.

leo60228 commented 3 years ago

Is the A5000 expected to receive vGPU support? I assumed that it wouldn't, similarly to the Quadro RTX 5000.

leo60228 commented 3 years ago

The A10 launched very recently and is the successor to the Tesla T4. However, it isn't supported in the public drivers yet, and it uses a GA102 like the A6000...

leo60228 commented 3 years ago

Oh, wait, did you just mean any GRID drivers with support for Ampere? I have the latest GRID drivers.

olealgoritme commented 3 years ago

Is the A5000 expected to receive vGPU support? I assumed that it wouldn't, similarly to the Quadro RTX 5000.

Yes, A5000 will have vGPU support. https://www.nvidia.com/en-us/design-visualization/rtx-a5000/

leo60228 commented 3 years ago

Hm, you're right... I assumed they would've released the drivers by now, since the cards officially launched a couple weeks ago (though I can't find anywhere to buy them).

KrutavShah commented 3 years ago

All new GPUs capable of vGPU announced at GTC 2021 should be available for use with R470 drivers. Hopefully, they will release in a few months or so, and we will be able to obtain them to do testing. Note that currently, it seems that only GA107 and GA102 support vGPU, not sure if GA104 does.

fidelix commented 3 years ago

Any news on GA104 support?

ahmeteminkocal commented 3 years ago

If Nvidia does a little suprise and enables SR-IOV on 3090's, Nevermind, they will not.

kaprog commented 3 years ago

Any news regarding Ampere support?

DualCoder commented 3 years ago

No news at this time.

Current status is unchanged: The guest driver crashes on startup due to a null-pointer dereference. It is unknown if this is due to a bug in the driver or if SR-IOV is required for the driver to function. AFAIK nobody is actively working on this at this time.

Silvermane06 commented 3 years ago

I did just get an a4000 in, so if there's anything I could do to maybe help, then I wouldn't mind doing so, though I imagine the problem is a software restriction imposed by nvidia (due to the null-pointer dereference), thus making me unable to really help, not to mention the fact the a4000 doesn't even support vGPU officially, let alone unofficially.

ahmeteminkocal commented 3 years ago

Any news?

ahmeteminkocal commented 2 years ago

Still no luck I guess.

PAI5REECHO commented 2 years ago

Significant portions of Nvidia driver source were made available recently which may aid in reverse engineering for Ampere: \<REDACTED>

DualCoder commented 2 years ago

@PAI5REECHO Please do not link to leaked copyright infringing material.

PeterPorker3 commented 2 years ago

I hate to be the 4th guy to ask, but any news?

I noticed a lot of the discussion about looking into the a5000 drivers happened almost a year ago, is that more of a possibility now that some time has passed, and more software is available to examine? Furthermore, I would be happy to assist looking into it further as a summer project, but I'm not sure if I would be of much use since I have little experience with driver modification and development, and I only have access to a 3060.

unrealbishop commented 2 years ago

i guess this: https://developer.nvidia.com/blog/nvidia-releases-open-source-gpu-kernel-modules/ would count as good news?

just google "nvidia open source drivers" if you don't wanna click on links.

we just have to be patient until they fully make everything open source i guess.

Santiblocks commented 2 years ago

If anything, i think it is bad news, cause it means they probably have a way to restrict vgpu unlock at firmware level, as the failed attempts to make vgpu work have suggested

Kamilake commented 2 years ago

Can't 3090 work like the A40? RTX A40 appears to support vGPU..

poohzaza166 commented 2 years ago

5th guy to ask any updates?

alex4401 commented 2 years ago

Can't 3090 work like the A40? RTX A40 appears to support vGPU..

The A40 is a data centre GPU with VGPU capability enabled. That doesn't mean any other Ampere GPU has it enabled, and it's probably locked within the on-board chip firmware.

KrutavShah commented 2 years ago

I think it’s best to close this issue as this specific GitHub repository is not likely to be updated any time soon. I have heard that other members of the community have been working on an Ampere solution but there does not appear to be much success. If there’s any updates regarding that, it’ll be on their repository, but don’t expect anything when it comes to Ampere.

leticiatm commented 2 years ago

I think it’s best to close this issue as this specific GitHub repository is not likely to be updated any time soon. I have heard that other members of the community have been working on an Ampere solution but there does not appear to be much success. If there’s any updates regarding that, it’ll be on their repository, but don’t expect anything when it comes to Ampere.

can you link those other repos?

gentoorax commented 2 years ago

I think it’s best to close this issue as this specific GitHub repository is not likely to be updated any time soon. I have heard that other members of the community have been working on an Ampere solution but there does not appear to be much success. If there’s any updates regarding that, it’ll be on their repository, but don’t expect anything when it comes to Ampere.

Can we have a link to the Ampere repository mentioned?

gentoorax commented 2 years ago

No news at this time.

Current status is unchanged: The guest driver crashes on startup due to a null-pointer dereference. It is unknown if this is due to a bug in the driver or if SR-IOV is required for the driver to function. AFAIK nobody is actively working on this at this time.

@DualCoder - now that the A5000 is around and has vGPU support, do you know if anyone tried spoofing the 3090 as a A5000 instead of an A40 to see if that has anymore success? I was going to give this a go when I get minute. I'm happy to try and test something. I basically got a 3090 for this purpose (now they're massively down in price) before I'd read people were having issues with a null reference pointer exception. Let me know if you think I'm wasting my time.

delta-whiplash commented 1 year ago

Hello any updates?

seyk777 commented 1 year ago

still waiting

jfrgagnon commented 1 year ago

Would the 15.0 and 15.1 release for Ampere Architecture could be some good news for the 3070ti GA104 and more?

https://docs.nvidia.com/grid/latest/grid-vgpu-release-notes-red-hat-el-kvm/index.html#release-notes

delta-whiplash commented 1 year ago

Could someone with an RTX 3000 please try for us and leave a comment of his experience here

Alfatango12 commented 1 year ago

Any news?

FrederikSchack commented 1 year ago

I'm very curious too. I read somewhere that vbios in the Ampere architecture was encrypted, is this a roadblock?

JustAnotherPU commented 1 year ago

Any advancement on the project guys ?

AkechiShiro commented 3 months ago

Any update or any news to share ?

@FrederikSchack can you share the source about the encrypted vBIOS, it should be possible to dump it if you have the card using an external programmer maybe?

If I get an Ampere GPU, I'll try to investigate