facebookresearch / habitat-lab

A modular high-level library to train embodied AI agents across a variety of tasks and environments.
https://aihabitat.org/
MIT License
1.81k stars 460 forks source link

HITL - Data collection #1967

Closed 0mdc closed 1 month ago

0mdc commented 1 month ago

Motivation and Context

This changeset enables the rearrange_v2 app to record data for HITL experiments.

How it works

This adds a session recorder, which has its lifetime tied to a single HITL session.

When reaching the End Session state (see this PR), the session is uploaded to S3 before being destroy.

Configuration:

The following configuration will do the following:

The bucket is defined via the environment variable S3_BUCKET.

rearrange_v2:
  data_collection:
    s3_path: "Placeholder/"
    output_file_name: "session"

Notes

Depends on:

How Has This Been Tested

Tested on EC2 instances running single and multi user applications.

Types of changes

Checklist