NVIDIAGameWorks / rtx-remix

Combined repo for the RTX-Remix runtime
https://www.nvidia.com/en-us/geforce/rtx-remix/
MIT License
1.32k stars 68 forks source link

Replacement issues in Shader-heavy games #181

Open Kim2091 opened 1 year ago

Kim2091 commented 1 year ago

This entire thread relates to these 3 games:

First Issue When adding lights to meshes (following the proper steps), the lights "float" and are attached to the player camera or mesh instead. The lights then follow the player/camera until it's culled from being out of range. Examples:

https://cdn.discordapp.com/attachments/1097563444137427056/1113721450982023228/Skyrim_2023-06-01_02-50-43.mp4 https://cdn.discordapp.com/attachments/1097563444137427056/1113723027667025980/Elder_Scrolls_V_Skyrim_2023.06.01_-_02.56.48.04.mp4

Second issue In Skyrim specifically, captured meshes are actually stacked on top of each other, losing their original positions. This occurs with multiple objects, although there's no consistency to which ones it occurs with. The main object types this happens with are light sources though (torches, chandeliers, etc.). Examples here:

https://cdn.discordapp.com/attachments/1097563444137427056/1113364221187608688/image.png https://cdn.discordapp.com/attachments/1097563444137427056/1113364136865304666/image.png https://cdn.discordapp.com/attachments/1097563444137427056/1113706823984369684/image.png

New 3rd Issue Mesh replacements do not work properly. They behave similarly to light additions, where they're attached either to the player, or the player camera. See this comment: https://github.com/NVIDIAGameWorks/rtx-remix/issues/181#issuecomment-1613669477

Attach logs! Logs produce nothing helpful here

To Reproduce Steps to reproduce the behavior:

First Issue

  1. Add a light to a mesh as you normally would (https://discord.com/channels/1028444667789967381/1096847508002590760/1096847729788977183)
  2. Load in-game
  3. Observe the issue

Second Issue

  1. Load Skyrim with this conf file: https://cdn.discordapp.com/attachments/1097563444137427056/1113888845298143322/rtx.conf
  2. Make a capture of the Sleeping Giant Inn
  3. Look at the captured torches on the wall

Third Issue

  1. Replace a mesh per Mark's newest tutorial in one of the specified games: https://discord.com/channels/1028444667789967381/1096847508002590760/1123306156773879928
  2. Observe end result. The mesh should be anchored either to the player position, or the player camera

Expected behavior

  1. The light should remain attached to the mesh. This is not the case, as it follows the player mesh or camera.
  2. Meshes should not be stacked, and should appear in their original positions
  3. Meshes should remain in their designated locations

Additional Files Skyrim mod.usda with light sources: mod.usda.txt

Note: Updated with the mesh issue

adamplayer commented 1 year ago

This is exhibited in Fallout New Vegas

https://github.com/NVIDIAGameWorks/rtx-remix/assets/94309006/58a4d850-4ff5-4d72-b08e-ead1ca15564f

Kim2091 commented 1 year ago

New behavior. I also replaced meshes for the first time this week. Here's the result in Barnyard:

https://github.com/NVIDIAGameWorks/rtx-remix/assets/62084776/ce5e6245-646d-47e1-9452-efb851146982

In this instance, I replaced the table meshes in the scene with the character model, just as a test. As you can see, a solid black mesh is attached to the player model, rather than being in place of the tables.

I used the same process of mesh replacement in Morrowind, per Mark's suggestion to attempt it in another game to verify I'm doing it properly. It does indeed work: https://cdn.discordapp.com/attachments/1097049994156060682/1123494675827929149/image.png

Kim2091 commented 10 months ago

I just wanted to update and say that this is sadly still an issue. I tested a mesh replacement again in Barnyard, and it seemingly has improved a small amount, but not much.

Rather than being stuck to the player's position, it now just follows around the player similar to light behavior: image

Kim2091 commented 5 months ago

There's a new game experiencing this issue: Kingpin: Life of Crime

vannomad commented 3 months ago

I can also confirm the same issue in Prince of Persia: The Two Thrones

NV-LL commented 2 months ago

Hello! Will you please test this on the 0.5 release and let us know if the issue persists? Thank you!

Kim2091 commented 2 months ago

@NV-LL I can confirm that the issue unfortunately persists in Barnyard (and almost certainly the other games as well). Here's a new video and example

image In this example I have anchored a cube to this vase mesh.

This is how it looks in-game:

https://github.com/NVIDIAGameWorks/rtx-remix/assets/62084776/e5499c42-9d27-4581-a621-26c328ecea18

As you can see, it tracks the player camera instead of staying anchored in place. It is also culled as soon as the vase is culled, which proves it's anchored to the correct mesh.

One more thing that I've seen since the original post: scene scale does not actually work other than for terrain baking.

Imadbein46 commented 1 month ago

hi i had the same issue in TMNT 2007 in game the light that keeps moving with the camera i add the light via tools kit but the light did t get fixd in the lamp mesh NVIDIA RTX Remix 105 1 2+release 135279 09b309e7 tc - E__Games_TMNT_RTX_project_TMNT usda 5_22_2024 6_44_54 AM

here issue https://github.com/NVIDIAGameWorks/rtx-remix/assets/56880122/a2ea78bc-3c1f-4e12-a712-02ab9531729c

TMNTGame_d3d9.log