API for current scene information

RobotecAI / o3de-genai-gems

Core features and interfaces enabling use of modern AI with O3DE for variety of purposes.

Other

1 stars 0 forks source link

Closed adamdbrw closed 2 months ago

adamdbrw commented 3 months ago

Implement a way to communicate current scene status to the model:

Visual Language Models could benefit from overview (top-down) with some scale.
Scene API to query placement overall or intersection with a given shape (box). The intersection would be so that the model decides whether it is suitable to add a new model in the place.

jhanca-robotecai commented 3 months ago

Multiple different projects beyond AI might use such API. I believe this should be implemented as a separate tool, e.g., as a part of https://github.com/RobotecAI/robotec-o3de-tools