InfernalWAVE / GD_MAXINE

NVIDIA AR SDK "MAXINE" integration with Godot as a GDExtension.
MIT License
1 stars 0 forks source link

Video of demo #1

Open GeorgeS2019 opened 4 months ago

GeorgeS2019 commented 4 months ago

Provide how the capture looks like in real times as video

InfernalWAVE commented 4 months ago

Provide how the capture looks like in real times as video

https://github.com/InfernalWAVE/GD_Spectrogram/issues/2#issuecomment-2067629926

reference to above

should work with any Godot humanoid bone profile skeleton. the body posing code is not yet in the demo, but soon. will post a preview video as well

GeorgeS2019 commented 4 months ago

The godotv4 humanoid needs more feedback

Seems trivial.. but not so..if U have time

Do a PoC

GeorgeS2019 commented 4 months ago

@InfernalWAVE

@j20001970 How is GDMP features compared to Maxine Augmented Reality SDK?

https://catalog.ngc.nvidia.com/orgs/nvidia/teams/maxine/collections/maxine

Key Features

  1. Face Tracking => available in Godot4 GDMP
  2. Face Landmark tracking => available in Godot4 GDMP
  3. Face Mesh => available in Godot4 GDMP
  4. Body Pose Estimation => available in Godot4 GDMP
  5. Eye Contact
  6. Face Expression Estimation

Latest Release

  1. Face Expression Estimation
  2. 6DOF head pose now available => ? Godot4 GDMP
  3. Expression estimation model updated
  4. New face model for visualization with updated blendshapes, and face area partitioning
  5. Eye Contact
  6. Performance improvements via CUDA graph functionality
GeorgeS2019 commented 4 months ago

@InfernalWAVE

Not everyone has the hardware to support Maxine Augmented Reality SDK :-(

Supported Hardware Windows SDK: NVIDIA GeForce RTX 20XX and 30XX Series, Quadro RTX 3000, TITAN RTX, or higher (any NVIDIA GPUs with Tensor Cores)

Could you consider using Godot4 GDMP?

Godot_v4 0 3-rc2_mono_win64_JU4OlmIfLZ