-
I really appreciate the work you've done.
I was wondering if you could provide the evaluation code for different scoring methods, such as COCO CIDEr and VQA score.
I would like to reimplement yo…
-
## I'm submitting a
(Check one with "x" from given options)
- [x] Bug report
- [ ] Feature request
## Current behavior
I noticed that in the EvalAI-ngx sometimes "state-of-the-art" is used, o…
-
Based on the checkpoints you provide, we can reproduce the "R2R Validation Seen" and "R2R Validation Uneen" results in table 1. But how to get "R2R Test Uneen" results? Could you give me some advice?
-
**Project Title:** Challenge Synchronization with GitHub Repositories
**Description:** This project aims to facilitate the migration of legacy challenges from challenge zip files to GitHub reposito…
-
Hi, I‘m trying to test my CARLA agent on the CARLA leaderboard 1.0 ([CARLA Autonomous Driving Challenge 2.0](https://eval.ai/web/challenges/challenge-page/2098/overview)), for which I have obtained pe…
-
-
the file :https://github.com/Cloud-CV/evalai-cli/blob/master/evalai/submissions.py.
here we have several places where we try to fetch entries from the HTTP responses.
We want to add proper excepti…
-
### Deliverables
In continuation with https://github.com/Cloud-CV/EvalAI/issues/1359
- [ ] Add a new page for FAQ (design same as Privacy-policy page).
- [ ] Research some FAQ for end users (Mayb…
-
**Description:**
Currently, when submitting to EvalAI, the system is accepting files of incorrect formats instead of rejecting them. This can cause issues with the evaluation process
![image](ht…
-
## I'm submitting a
(Check one with "x" from given options)
- [x] Bug report
- [ ] Feature request
## Current behavior
(Check screenshot for better understanding)
The "worker" service fail…