LeetCode-Feedback / LeetCode-Feedback

664 stars 318 forks source link

[BUG] - <title> #22344

Closed Mitternachtsmond closed 2 months ago

Mitternachtsmond commented 4 months ago

LeetCode Username

nichamp

Problem Number, Title, and Link

None

Bug Category

Editorial

Bug Description

I have observed that users are writing the test case itself in the code inside if statement and then posting it as missing test case. For instance Issue #22181, #22264 have the exact test case written in the code section and then claimed that it is a missing test case which is wrong

Language Used for Code

None

Code used for Submit/Run operation

No response

Expected behavior

The code which have the test cases inside if statement should not be accepted as missing test case.

Screenshots

Issue #22264 image Issue #22181 image

Additional context

It is a generalized issue so I have written None in Problem Number, TItle and Link and random value in Bug Category

exalate-issue-sync[bot] commented 4 months ago

Winston Tang commented: Dear nichamp,

Thank you for reaching out to LeetCode's support team with your concern. We strive to keep our platform challenging, fair, and beneficial to all users.

We understand your concern about users writing the test case inside an 'if' statement and then claiming it as a missing test case. However, in order to investigate further, we need additional information. Could you please provide concrete examples where a specific submission gets incorrectly accepted due to a test case being included in an 'if' statement? In this context, we would also require the test case which prevents the code from getting Accepted in the absence of the 'if' statement.

Once we have this information, we can further evaluate the nature of reported issues and take necessary actions.

We appreciate your understanding and cooperation in this matter.

Best,

LeetCode Support Team

Mitternachtsmond commented 4 months ago

Issue https://github.com/LeetCode-Feedback/LeetCode-Feedback/issues/22181, https://github.com/LeetCode-Feedback/LeetCode-Feedback/issues/22264 have the exact test case written in if and then claimed that it is a missing test case which is wrong

Mitternachtsmond commented 4 months ago

Again Issue #22348, #22349, #22350 same thing is happening the test cases mentioned missing is just written in if statement

exalate-issue-sync[bot] commented 4 months ago

Joyce_Ndisya commented: Hello,

Your reported issue has been relayed to our team for thorough investigation. We appreciate your patience as we work to address and resolve this matter. We will reach out to you when we have updates regarding the issue.

If you have any further questions or concerns in the meantime, please feel free to let us know.

Best regards, LeetCode Support Team

ghost commented 4 months ago

Hello @Mitternachtsmond,

From your issue I can understand that in your opinion, these shouldn't be counted as missing test cases. I would like to defend my argument.

My testcases were valid and met the criteria for a missing test case. I had an Accepted submission which didn't work for a certain test case. So, please reconsider your position on this matter and let me know what you think.

I appreciate any constructive feedback you might have.

Regards, qingy2019

Mitternachtsmond commented 4 months ago

@qingy2019 if these are missing test cases then if the size of the array nums is maximum 100 and nums[i] can be from 1 to 10^9 then all 10^9 * 100 different test cases (all possible arrays) must be judged?

Mitternachtsmond commented 4 months ago

Checking 10^11 cases which can go up to 10^14 or even higher if constraints are bigger? Is this feasible @qingy2019

ghost commented 4 months ago

That's not what I was trying to say: those test cases still met the criteria to be missing test cases. A code was getting Accepted but Wrong Answer on a test case.

Mitternachtsmond commented 4 months ago

Yes, so if the platform needs to fill the missing test case then all 10^11 test cases must be judged?

ghost commented 4 months ago

Yep, why not?

Mitternachtsmond commented 4 months ago

10^14 test cases will take more than a day to run

Mitternachtsmond commented 4 months ago

means to just submit one question wait for more than one day :)

ghost commented 4 months ago

I'm not saying we need to add every single one of those test cases, ha ha

Mitternachtsmond commented 4 months ago

but whichever we won't add can be written as missing test case so at the end to account for every missing TC we need to add all

ghost commented 4 months ago

yeah, so? it still counts as a missing test case.

Mitternachtsmond commented 4 months ago

I still don't understand your point. On one hand you say it is missing test case and on the other say we don't need to add every single TC. Let Leetcode decide whether it's right or wrong to mark missing test cases by adding them in if statements

ghost commented 4 months ago

I'm sorry, did you say CheatCode? :)

Mitternachtsmond commented 4 months ago

What ever you call it :confused: Let the platform decide

ghost commented 4 months ago

I'm sure they have other things to do.