EpicGames / MetaHuman-DNA-Calibration

https://epicgames.github.io/MetaHuman-DNA-Calibration/
Other
437 stars 116 forks source link

MetaHuman DNA Calibration

MetaHuman DNA Calibration is a set of tools used for working with MetaHuman DNA files, bundled into a single package. DNA is an integral part of MetaHuman identity. DNA files are created with MetaHuman Creator and downloaded with Quixel Bridge, and Bifrost in UE5.

MetaHuman DNA Calibration is a set of tools used for working with MetaHuman DNA files, bundled into a single package. We wanted to share this code to help users customize DNA files so they can better integrate the characters they create into their games and experiences. MetaHuman DNA Calibration tools are provided in a GitHub repository located at this address.

Overview

For an explanation about how the repository is organized, click here.

The MetaHuman DNA Calibration repository contains two distinct tools:

Required Knowledge

To use these tools, you should be familiar with:

Optional Knowledge

DNACalib

DNACalib and its API are used to inspect and modify DNA files. With DNACalib, you can make the following changes in DNA files:

An overview of the MetaHuman DNA file format can be found here.

Note: DNACalib library allows removal and renaming of any joint. However, the following joints are used for connecting head with body and should not be removed or renamed: neck_01, neck_02, FACIAL_C_FacialRoot.

External Software Dependencies

DNACalib's Python wrapper is compiled against Python 3.7 and 3.9. Pre-compiled binaries for Windows and Linux (both 64-bit) are part of the repository. If you are using a different version of Python, you must recompile it. Any Python 3 version should be fine. If a user has a different platform or architecture, the library and its dependencies must be compiled.

Important DNA files are stored as LFS (Large File Storage) files. They are downloaded with the rest of the code if git-lfs is installed and configured to use. If you are not using git-lfs, you have to download DNA files manually.

Additional information can be found here

Warning: Python 2 is not supported.

DNACalib can be used in C++ projects as a C++ library.

DNACalib Python wrapper can be used in Python 3.7 and 3.9, mayapy (Python interpreter shipped with Maya) shipped with Maya. Supported Maya versions are 2022 and 2023.

Note: Maya 2022 is bundled with Python 3.7, Maya 2023 is bundled with Python 3.9.

Environment Setup

In order to use MetaHuman DNA Calibration in your scripts, you need to:

If you plan to run the script from command line:

import maya.standalone 
maya.standalone.initialize()

ROOT_DIR = f"{ospath.dirname(ospath.abspath(file))}/..".replace("\", "/") MAYA_VERSION = "2022" # or 2023 ROOT_LIB_DIR = f"{ROOT_DIR}/lib/Maya{MAYA_VERSION}" if platform == "win32": LIB_DIR = f"{ROOT_LIB_DIR}/windows" elif platform == "linux": LIB_DIR = f"{ROOT_LIB_DIR}/linux" else: raise OSError( "OS not supported, please compile dependencies and add value to LIB_DIR" )

Adds directories to path

syspath.insert(0, ROOT_DIR) syspath.insert(0, LIB_DIR)


NOTE: 
If running on Linux, please make sure to append the LD_LIBRARY_PATH with absolute path to the `lib/Maya2022/linux` or `lib/Maya2023/linux` directory before running the example: 
 - `export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<path-to-lib-linux-dir>`

## DNAViewer
With DNAViewer, you can:
- Create functional rigs for Maya.
- Export FBX files.
- Read internal parts of DNA files.

DNAViewer can be used in `mayapy` (Python interpreter shipped with Maya) or in Maya 2022, except [Propagating changes from Maya scene to dna](/examples/dna_viewer_grab_changes_from_scene_and_propagate_to_dna.py) which can be used just in Maya.

# Examples
Several Python examples are provided for reference and can be found in the **examples'** folder:
- [Showcase a few commands](/examples/dnacalib_demo.py)
- [Rename a joint](/examples/dnacalib_rename_joint_demo.py)
- [Create a small DNA from scratch](/examples/dna_demo.py)
- [Read binary DNA and write it in a human readable format](/examples/dna_binary_to_json_demo.py)
- [Create a new DNA from an existing one by extracting specific LODs](/examples/dnacalib_lod_demo.py)
- [Remove a joint](/examples/dnacalib_remove_joint.py)
- [Clear blend shape data](/examples/dnacalib_clear_blend_shapes.py)
- [Subtract values from neutral mesh](/examples/dnacalib_neutral_mesh_subtract.py)
- [Simple UI in Maya](examples/dna_viewer_run_in_maya.py) and some [documentation](docs/dna_viewer.md#usage-in-maya) for it
- [Generates rig](/examples/dna_viewer_build_rig.py)
- [Export FBX per LOD](/examples/dna_viewer_export_fbx.py)
- [Propagating changes from Maya scene to dna](/examples/dna_viewer_grab_changes_from_scene_and_propagate_to_dna.py)

Note: Examples are grouped in three groups: DNA, DNACalib, and DNAViewer. These names are embedded as prefixes: dna_, dnacalib_, and dna_viewer_.   

## Example DNA files
[Two demo DNA files](data/dna_files) are provided for easier testing of this tool. Any DNA generated with [MetaHumanCreator](https://www.unrealengine.com/en-US/metahuman)
should work.

The MHC 2023 spring release introduced changes to the rig definition (number of joints increased as well as the number of expressions).
In order to accommodate those changes, we added several files to the repository in `/data/mh4` folder: new [gui scene](/data/mh4/gui.ma), updated [assemble script](/data/mh4/additional_assemble_script.py) and example of Ada’s [DNA file](data/mh4/dna_files/Ada.dna).
If a user wants to switch and use this new rig version it is necessary to update paths in their scripts:
```python
GUI = f"{DATA_DIR}/mh4/gui.ma"
ADDITIONAL_ASSEMBLE_SCRIPT = f"{DATA_DIR}/mh4/additional_assemble_script.py"

In case character DNA is downloaded from Quixel Bridge and we are not sure which rig definition is used, it can be checked with following code:

from dna import (
    BinaryStreamReader,
    DataLayer_All,
    FileStream,
    Status,
)

def load_dna_reader(dna_file):
    stream = FileStream(
        dna_file, FileStream.AccessMode_Read, FileStream.OpenMode_Binary
    )
    reader = BinaryStreamReader(stream, DataLayer_All)
    reader.read()
    if not Status.isOk():
        status = Status.get()
        raise RuntimeError(f"Error loading DNA: {status.message}")
    return reader

character_dna = "path_to/character.dna"
reader = load_dna_reader(character_dna)
if reader.getDBName() == "MH.4":
  print("Use mh4 folder")
elif reader.getDBName() == "DHI":
  print("Use data folder")
else:
  print("Unsupported rig definition!")

Notes

If a user runs examples in Maya 2022, the value for ROOT_DIR should be changed and absolute paths must be used, e.g. c:/MetaHuman-DNA-Calibration in Windows or /home/user/MetaHuman-DNA-Calibration in Linux. Important: Use / (forward slash), Maya uses forward slashes in path.

See the FAQ guide for additional specifications.

License

MetaHuman DNA Calibration is released with licence.