search

isl-org / PhotorealismEnhancement

Code & Data for Enhancing Photorealism Enhancement
1.3k stars 106 forks source link

Mod #3

Closed maxkraft7 closed 2 years ago

maxkraft7 commented 3 years ago

At the bottom of the readme you wrote More coming soon!. Will there be a mod released? I would love to play GTA that way!

chris-aeviator commented 3 years ago

This is scientific research - I guess it's not exactly a mod. The work is about a neural network, it looks like further work needs to be done.

Inference withour approach in its current unoptimized implementationtakes half a second on a Geforce RTX 3090 GPU. Since G-buffers that are used as input are produced natively on theGPU, our method could be integrated more deeply into gameengines, increasing efficiency and possibly further advancingthe level of realism

CasualDev242 commented 3 years ago

Yeah, this might not be released as a mod, though I wish they would so people could better appreciate how significant this is. This is very impressive, to put it mildly.

KCGD commented 3 years ago

well a sort of "mod" may not be impossible, reshade can provide most of the gbuffers necessary to run the AI (at least to what I saw), and the developers claim that it can run at interactive frame rates, implying that it was or could be used in real time. but still we won't know anything untill the code is actually released which is up to the devs

CasualDev242 commented 3 years ago

Reshade does not have access to the G-buffers, only Depth and Backbuffer. On top of that, Reshade does not contain any machine-learning.

The code could be modified by someone savvy to do it, but it would make more sense if Intel released it, rather than reinvent the wheel.

srrichter commented 3 years ago

Sorry, a mod is not planned at the moment. Regarding the code release we're thinking of the network architecture, and training and inference code as well as the metric for evaluation.

AlexPresso commented 3 years ago

Would be perfect ! this way people could train their own model and modders could implement that model in a mod by themselves

honzikv commented 3 years ago

Would love to try this myself, looks very good, though my 1060 would probably die rendering this

darthnithin commented 3 years ago

Would love to try this myself, looks very good, though my 1060 would probably die rendering this

No it wouldn't, (at least not from rendering) the method they use isn't re-rendering the game. They are feeding the output of the game engine into a machine learning model which generates the "photorealistic" images you see

ThijnLans commented 3 years ago

Is it Possible to install this on my own pc?

mmtmn commented 3 years ago

Any updates on sharing the code? Would love to attempt to run this.

srrichter commented 2 years ago

There are no plans from our side to create or release a mod. If you create one based on our research code, let us know -- we would love to try it out. The code release is in the final stages of the approval process and I expect to have this done with a few weeks (before the end of the year). Thanks for your patience!

wovai commented 2 years ago

How is that going?