Benchmarking

[AlvaroHG]

Setup to do daily benchmarks.

Runs using benchmark configuration, like one under ai2thor/benchmarking/benchmark_test.json

Benchmark configs are stored in S3 and picked up by build server and run daily.

To add new benchmarks that are run daily run the task, with the right S3 credentials, invoke task add_daily_benchmark_config <config_filepath>, with json file matching schema ai2thor/benchmarking/benchmark_config_schema.json.

Also by coincidence, includes new Windows build compatibility.

[AlvaroHG]

Done, addressed all comments. Thanks :)

[Lucaweihs]

Looks good! One last change request: please run black autoformatting on the new benchmarking.py script:

pip install black
black ai2thor/benchmarking.py