HITL - Add buttons and modal dialog boxes. - Githubissues

facebookresearch / habitat-lab

A modular high-level library to train embodied AI agents across a variety of tasks and environments.

https://aihabitat.org/

MIT License

1.81k stars 460 forks source link

HITL - Add buttons and modal dialog boxes. #1956

Closed 0mdc closed 1 month ago

0mdc commented 1 month ago

Motivation and Context

This change introduces networked UI elements. A button and modal dialog boxes are added.

https://github.com/facebookresearch/habitat-lab/assets/110583667/2c433d07-9234-4102-ba83-33073352ff1b

How it works

UI elements follow the immediate mode GUI pattern. They are both keyframe consumers and message producers.

How buttons work:

Server creates a button named X and sends it to the client.
Client receives it, renders it, and stores whether it was clicked.
Client sends back X's state.
Server checks whether X was clicked.

Notes

Dialogue boxes are simply containers of UI elements (right now only supporting buttons).
A UI wrapper will be created. For the sake of simplifying deltas, this will be done in a later changeset.

Related to:

https://github.com/0mdc/siro_hitl_unity_client/pull/26

How Has This Been Tested

Tested in multiplayer HITL application.

Types of changes

[Development]

Checklist

[x] My code follows the code style of this project.
[x] I have updated the documentation if required.
[x] I have read the CONTRIBUTING document.
[x] I have completed my CLA (see CONTRIBUTING)
[x] I have added tests to cover my changes if required.