AISG-Technology-Team / AISG-Online-Safety-Challenge-Submission-Guide

Submission Guide + Discussion Board for AI Singapore Online Safety Prize Challenge
https://ospc.aisingapore.org
14 stars 5 forks source link

offensive memes - aliencaocao - several questions post-competition #90

Open aliencaocao opened 7 months ago

aliencaocao commented 7 months ago

Hi

  1. we initiated our upload at 1158am and finished at 12pm (past a few seconds) and it seems like upload was denied. This is expected? image

  2. Is it possible to release the test set to us or allow us to submit post-competition to get a real score? E.g. a separate leaderboard, if test set cannot be released to us. Our team has submitted 20 times and only one succeeded, which is an untrained model. We have a very good performing model based on a local evaluation set (0.77 AUROC, 0.82 accuracy) that we would like to verify on the competition's dataset, so that we can publish our work despite unable to participate properly in the competition.

  3. We would also like to request the stdout logs for 63874750-3132-4f96-91ae-7f3b14ed2157 to understand where have we gone wrong in the previous submission. The stderr logs showed everything was normal. Note this is not the parallel one.

Hope that relevant restrictions can be lifted post-competition and we can start focusing on what matters.

AyushK002 commented 7 months ago

Hello We submitted our solution at 7:35am(IST) (well before the deadline, which was 9:30am IST) and our upload was going just fine till it reached 92% however after that our upload was progressing at around 1/2 hour for each percent. Was there some traffic issues with the server or some other issue? Kindly consider reopening of the submission portal in case there was an issue with the submission portal server. We would be grateful if given an opportunity to submit our solution. We had put in a lot of effort and achieved a fine-tuned model giving good performance at our local tests. It would also be fine if we were allowed to get the scores shown in a separate leaderboard. image

We also emailed at prizechallenge@aisingapore.org immediately after encountering the 'submission was not received' error, but we only received an automated reply till now. We spent a considerable time on this competition and some cooperation regarding our scenario would be greatly appreciated.