search

skygragon / leetcode-cli

A cli tool to enjoy leetcode!
MIT License
3.64k stars 457 forks source link

Discrepancy in runtime rank returned from leetcode-cli and that shown in website #114

Open yaqihou opened 6 years ago

yaqihou commented 6 years ago

Problem Summary

The rank (that percentage) in runtime distribution in output of leetcode-cli is different from that value shown in leetcode website.

How to reproduce

(Only tried with python) Submit any python script and the the percentage shown in the output "beats over XX %" would be different from the result found in submission details on leetcode website.

Environment

Thanks for this awesome tool!

lostarchun commented 6 years ago

Have the same issue in C++

skygragon commented 5 years ago

is the difference significant?

ketankr9 commented 5 years ago

I too can confirm this, and the difference is significant. For example:

$ commit
859.buddy-strings.cpp
  ✔ Accepted
  ✔ 23/23 cases passed (8 ms)
  ✔ Your runtime beats 1.45 % of cpp submissions

However, the website shows Your runtime beats 35.10 % of cpp submissions The absolute run time is correct (8ms here).

Image Link Here you can verify that the submission id is same in both desktop.

Edit: Added another instance. Another instance: leetcode-cli shows 79.12% where as website shows 97.76%. Problem: 897.

$ leetcode version
2.6.1
skygragon commented 5 years ago

might be related to #156