search

askforalfred / alfred

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
MIT License
352 stars 77 forks source link

25 cm grid #100

Closed nikepupu closed 2 years ago

nikepupu commented 2 years ago

Do we have to move 25 cm at a time? Can I change the movement resolution at certain moment? Especially at the boundary to avoid collision?

MohitShridhar commented 2 years ago

@nikepupu for data collection or training you can change the step-size to suit your needs. But during evaluation on val and test sets, you have to use the pre-defined step-size. This is to keep the evaluations fair and comparable across models, particularly when it comes to path-length weighted metrics.

MohitShridhar commented 2 years ago

Closing due to inactivity.