Closed soyeonm closed 3 years ago
Can we write our own leaderboard code as long as
- It receives the same inputs
- It outputs the same json format?
Yes! As stated in the Leaderboard Rules, as long as you use the same inputs (RGB + Goal & Step-by-Step Language) and the output format of the JSON is consistent with leaderboard.py
, it should be good to go.
Hello,
I have a question on submitting the performance of a certain model to the leaderboard using the leaderboard.py code.
Can we write our own leaderboard code as long as
I am asking this because I have a model that is significantly different from the lstm model of the original paper, and the following lines
do not really hold for my model. Also, I would like to add other lines to the leaderborad.py, because of how I have implemented the memory of my model.
Thanks!