search

askforalfred / alfred

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
MIT License
352 stars 77 forks source link

Rules of image resolution #115

Closed joeyy5588 closed 1 year ago

joeyy5588 commented 2 years ago

Hi, I notice the default resolution of the RGB input is 300x300 (as specified at here: https://github.com/askforalfred/alfred/blob/master/gen/constants.py#L105).

Can we use a larger resolution (ex. 600x600) during evaluation on ALFRED? Does this violate the dataset's rules? Thanks!

MohitShridhar commented 2 years ago

@joeyy5588, evaluations for leaderboard submissions should use 300x300 for the sake of fairness.

You are free to training an object detector at any resolution, but during evaluation please use 300x300 for the input.

MohitShridhar commented 1 year ago

Closing due to inactivity.