search

askforalfred / alfred

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
MIT License
379 stars 88 forks source link

Rules of image resolution #115

Closed joeyy5588 closed 2 years ago

joeyy5588 commented 2 years ago

Hi, I notice the default resolution of the RGB input is 300x300 (as specified at here: https://github.com/askforalfred/alfred/blob/master/gen/constants.py#L105).

Can we use a larger resolution (ex. 600x600) during evaluation on ALFRED? Does this violate the dataset's rules? Thanks!

MohitShridhar commented 2 years ago

@joeyy5588, evaluations for leaderboard submissions should use 300x300 for the sake of fairness.

You are free to training an object detector at any resolution, but during evaluation please use 300x300 for the input.

MohitShridhar commented 2 years ago

Closing due to inactivity.