-
Would it be possible to add MMMU validation to EvalAI?
It'd be great to be able to compare the numbers calculated on the validation set with the ones produced by EvalAI.
-
Hello,
Thank you so much for organizing FALCON - I think the field will benefit hugely from it.
I'm not sure if this is the right place to ask technical questions about working with FALCON, but …
-
Hi, I have submit my results into the EvalAI for "BDD100K Multiple Object Tracking Challenge", and get the following error, which sounds like the version issue of pydantic. Could you figure it out?
`…
-
**Project Title:** Seamless User Experience & Leaderboard Porting
**Description:** This project aims to enhance the overall user experience on EvalAI by introducing user-centric features, improving…
-
**Project Title:** Admin Tools Enhancement and Cost Optimization
**Description:** The goal of this project is to focus on improving admin experience on EvalAI, as well as target efficient cost-redu…
-
**Project Title:** Enhanced Exception Handling Testing Documentation
**Description:** This project is dedicated to elevating the overall user experience on EvalAI by implementing robust exception h…
-
**Issue:** The number of organizations using EvalAI is outdated, as many organizations have started using it in the last few years.
**Solution:**
- Go through the list of all the hosted challenge…
-
### Description
This issue is a revival of #3701, but for frontend v1.
The idea is to add support to search challenges by name on the all challenges and Hosted challenges page. In future, there will…
-
Nice code , thanks for your work , I need a test code for leaderboard submission , can you provide some examples please?
-
I really appreciate the work you've done.
I was wondering if you could provide the evaluation code for different scoring methods, such as COCO CIDEr and VQA score.
I would like to reimplement yo…