search

AISG-Technology-Team / AISG-Online-Safety-Challenge-Submission-Guide

Submission Guide + Discussion Board for AI Singapore Online Safety Prize Challenge
https://ospc.aisingapore.org
14 stars 5 forks source link

offensive memes - aliencaocao - request for log #87

Closed aliencaocao closed 7 months ago

aliencaocao commented 7 months ago

Hi may we also have the logs for 2e0777d4-f843-44ad-b470-f1641abbeb13 thanks

AISG-Wesley commented 7 months ago

Hi aliencaocao, in accordance with Section 7G of the Challenge Terms & Conditions, parallel submissions are not permitted. Consequently, both of your entries have been disqualified. Please note, these submissions will count against your overall submission limit.

aliencaocao commented 7 months ago

Your platform did not stop me from making such submission and this rule was not in place at the start of the competition. I strongly feel that disqualifying based on this is unfair. Notheless, can we still get the log for both? Or at the very least, let us know the reason for output format error. We tested locally with over 3000 images and never had an issue. Without it, it is impossible for us to use our last submission. We also see that one of them is still running. Will that be stopped so we can make another submission?

AISG-Wesley commented 7 months ago

Your platform did not stop me from making such submission and this rule was not in place at the start of the competition. I strongly feel that disqualifying based on this is unfair.

Your feelings are noted. Clause 7G has been in the terms and conditions from the very beginning, and it is regrettable that you have signed up for a Prize Challenge without fully reading and understanding the terms and conditions.

Also Clause 7G merely states the expected outcome regardless of the implementation. Thank you for drawing our attention to the inadequacies of our current platform through the two log requests for two submissions at the same time (#86; #87). We will be doing a system-wide manual check to detect any other parallelised runs from the same team after the deadline of the Challenge.

Notheless, can we still get the log for both? Or at the very least, let us know the reason for output format error. We tested locally with over 3000 images and never had an issue. Without it, it is impossible for us to use our last submission.

No to both.

We also see that one of them is still running. Will that be stopped so we can make another submission?

That is an artefact of us force terminating your previous running instance. You can make another submission as long as you have the quota for it, and this particular submission a6e0db4b-b017-4e18-a7d0-4c363b19063a does not count as a parallelly run instance.

aliencaocao commented 7 months ago

G. No parallel submissions will be accepted. Only one model instance per participant can be in operation at any given time. You are only allowed to run one model instance at a time, and you will not be allowed to upload another submission until the current model prediction has been completed or terminated.

No parallel submissions will be accepted: it was accepted by your platform.

you will not be allowed to upload another submission until the current model prediction has been completed or terminated: I was allowed.

Even if anyone would have read the T&Ts word for word, it is still expected from the wording here that anyone attempting to submitting twice will be stopped before they are able to do so.

Not that I think anything will be changed at this point, but just pointing out what anyone with basic English knowledge would interpret.

We will be doing a system-wide manual check to detect any other parallelised runs from the same team after the deadline of the Challenge.

We did not make any other such submissions, but I don't get the part about why only check our team's instead of every team participating. Do I interpreted this as AISG assuming that other teams would not have done so just because they did not request for logs together?

That is an artefact of us force terminating your previous running instance

And regarding this submission. 2e0777d4-f843-44ad-b470-f1641abbeb13, can I confirm that it has output format error was because of forced termination by AISG and not that it actually failed to run?

AISG-Wesley commented 7 months ago

And regarding this submission. 2e0777d4-f843-44ad-b470-f1641abbeb13, can I confirm that it has output format error was because of forced termination by AISG and not that it actually failed to run?

You can ignore any error messages from these the 2 submissions as they were force-terminated.