Kim2091 / PBRify_Remix

My custom (ethical) set of AI models to upscale textures and generate PBR maps
Creative Commons Zero v1.0 Universal
44 stars 2 forks source link

PBRify_Remix

My custom (ethical) set of AI models to upscale textures and generate PBR maps from diffuse or albedo texture maps. Intended for use with RTX Remix

πŸš€ Support my work!

Any donations help pay training costs + other living costs that would hinder my work on these models. Any donation helps, even if it's just $1!

(The name won't be Kim on the checkout page, that's okay)

ko-fi

Features

This is a complete set, consisting of a pre-made chain for chaiNNer & 3 models. These models do the following:

  1. Upscale
  2. Generate Normal Map
  3. Generate Roughness Map
  4. Generate Height Map (Disabled by default)

Guide

  1. Download chaiNNer and install the dependencies in the top right
  2. Download the latest release and extract.
  3. Open the .chn file in chaiNNer
  4. Set an input and output directory for the textures
  5. Load the model files by following the notes in the chain (refer to the image for more details)
  6. Press the green run button at the top!
  7. Ingest the saved textures in Remix's Ingestion tab

ComfyUI

You can also use PBRify in ComfyUI thanks to Nvidia! They have an implementation of it in their official repository here: https://github.com/NVIDIAGameWorks/ComfyUI-RTX-Remix

This implementation allows you to use PBRify directly with the toolkit. You can select textures in the toolkit to process, send them to ComfyUI to be processed with PBRify, then sent back to be added πŸ™‚

Steps: - These steps assume you've already installed [ComfyUI](https://github.com/comfyanonymous/ComfyUI), the [ComfyUI-RTX-Remix](https://github.com/NVIDIAGameWorks/ComfyUI-RTX-Remix) extensions, and the [RTX Remix toolkit](https://www.nvidia.com/en-us/geforce/rtx-remix/) with an existing project file. Look in the [RTX Remix Discord server](https://discord.gg/rtxremix) for further details. 1. Download PBRify's latest ComfyUI compatible package from [here](https://github.com/Kim2091/PBRify_Remix/releases/download/ComfyUI_Compat_1.7.0/PBRify_Remix_1.7.0_ComfyUI_ONLY.zip) 2. Open the zip file 3. Extract the contents of the folder to `ComfyUI\models\upscale_models` 4. Open the RTX Remix Toolkit 5. Open your project 6. Select the objects with textures you want to upscale 7. Launch ComfyUI 8. Load the workflow using the `rtx_remix_pbrify_workflow.png` file located in `ComfyUI\custom_nodes\ComfyUI-RTX-Remix\workflows` and hit "Queue Prompt" - If you want alpha layer support for textures, you can use and load [this workflow instead](https://github.com/Kim2091/ComfyUI-RTX-Remix/raw/main/workflows/rtx_remix_pbrify_remix_workflow.png) 9. It will now upscale and generate PBR textures. Simply switch back to the toolkit to observe the improvement Tips: - The default displacement value is far too strong. Set it per texture to 0.1 or even less, such as 0.05

Tips & Additional Info:

alt text