ValveSoftware / SteamOS

SteamOS community tracker
1.53k stars 69 forks source link

[Feature Request] Add frame generation capabilities, similar to Lossless Scaling Frame Generation (LSFG) or AMD Fluid Motion Frames (AFMF) #1499

Open SaltyBet opened 2 months ago

SaltyBet commented 2 months ago

Your system information

Please describe your issue in as much detail as possible:

A feature request to add frame generation capabilities, similar to Lossless Scaling Frame Generation (LSFG) or AMD Fluid Motion Frames (AFMF).

Details:

LSFG:

  1. Introducing Frame Generation - LSFG
  2. New frame capture API
  3. LSFG 1.1 – New UI detection model
  4. Introducing LSFG 2.0

AFMF:

  1. AMD Fluid Motion Frames

Steps for reproducing this issue:

  1. N/A
SaltyBet commented 2 months ago

To better illustrate what is being requested, here is a video showing a Windows-based handheld PC using Lossless Scaling Frame Generation:

https://youtu.be/KbaX35ky0rQ

As you can see, even using a relatively low 30 FPS base, the fluidity and overall experience is much better with frame generation on the Windows-based handheld PC.

sonic2kk commented 2 months ago

See also: https://github.com/ValveSoftware/gamescope/issues/1213

lyndonguitar commented 1 month ago

+1 to this. It would be a game changer and extend the life of Steam Deck to a few years more and allow it to run games at a higher FPS than it is rated.

Imagine a game barely running 40FPS being frame genned to 60fps. (you need some FPS/performance allowance to have frame gen, a game barely running 30fps will not go up to 60)

I understand that the current solutions presented are Windows-centric only, but that's no stranger for the Steam Deck, which already runs games designed for Windows. Having one baked into SteamOS itself (like FSR or gamescope) will probably work wonders.

PS. Having used both, LSFG implementation is better imo simply because it doesn't turn off at fast movement, so no disorienting stutters.

vavakado commented 1 month ago

This would also benefit emulation both on Steam Deck and usual linux desktop, especially for games that don't have 60 fps patches available.

SaltyBet commented 1 month ago

Latest developments

LSFG:

KulaRose commented 1 month ago

Definitely would be a huge feature in allowing SteamOS and SteamDeck users to play demanding games in higher fidelity than their hardware can handle. By far my most desired feature for SteamOS.

FerLuisxd commented 1 month ago

+1 to this.

jonaburg commented 1 month ago

+1

ASmyrnyi commented 3 weeks ago

+1

Pahheb commented 3 weeks ago

This has most likely not yet been implemented due to the absence of Vulkan support, which would be needed for it to run on top of DXVK.

However AMD are planning to open source the recently released FSR 3.1 in July 2024, which not only has Vulkan support, but also decouples Frame Generation, allowing it to be used separately from the upscaling, which is the last ingredient to it being implemented.

It is definitely the number 1 on my most exciting features list, and I just hope that some sort of AMD Anti-Lag alternative can be implemented to reduce its most obvious deficiency.

Source: https://community.amd.com/t5/gaming/amd-fsr-3-1-now-available-fsr-3-available-and-upcoming-in-60/ba-p/692000

Globetrotter129 commented 3 weeks ago

I think it would be a good time for valve to officially support 70hz for the steam deck lcd because 35fps looks perfect with framegen unlike 30fps. And people are going to want to upgrade to better handhelds without frame generation on deck lcd.

superkeka commented 3 weeks ago

+1

SaltyBet commented 1 week ago

@Pahheb:

This has most likely not yet been implemented due to the absence of Vulkan support, which would be needed for it to run on top of DXVK.

However AMD are planning to open source the recently released FSR 3.1 in July 2024, which not only has Vulkan support, but also decouples Frame Generation, allowing it to be used separately from the upscaling, which is the last ingredient to it being implemented.

It is definitely the number 1 on my most exciting features list, and I just hope that some sort of AMD Anti-Lag alternative can be implemented to reduce its most obvious deficiency.

Source: https://community.amd.com/t5/gaming/amd-fsr-3-1-now-available-fsr-3-available-and-upcoming-in-60/ba-p/692000

It seems AMD has publicly released FSR 3.1 today:

lmills87 commented 1 week ago

Forgive my ignorance, but does this mean that we might see FSR3 implemented system-wide and thus compatible with all games? Has Valve commented on this?