KLUE-benchmark / KLUE

📖 Korean NLU Benchmark
https://klue-benchmark.com
Creative Commons Attribution Share Alike 4.0 International
554 stars 55 forks source link

[Leaderboard] Error on submission tab #37

Open kwonmha opened 2 years ago

kwonmha commented 2 years ago

Description

I submitted my works and after 3 trials, it fails to show me information on "My submission" and "Job log" tab as below. It still happens when I logout and re login.

Screenshots

image

Desktop

chrome

===================================================================== This is another question. My submission failed. But it doesn't let me know how to fix it.

My 1st, 2nd trial composed as inference.py requirements.txt util.py model -model.tar.gz

my 3rd trial composed as: model -model.tar.gz

wos -inference.py -requirements.txt -util.py

Please let me know how compose submission tar.gz file.

conan1024hao commented 2 years ago

Also interested in how the submission file should be.

inmoonlight commented 2 years ago

@kwonmha DST submission example code can be downloaded at https://klue-benchmark.com/tasks/73/data/download. By comparing the code, you might figure it out! :)

inmoonlight commented 2 years ago

@conan1024hao I guess you wanted to see the test score on YNAT. If so, you can find example code at https://klue-benchmark.com/tasks/66/data/download !

kwonmha commented 2 years ago

@inmoonlight Thanks for help. But I failed to submit before opening this issue though I made my submission file same format as example code.

It says nothing but failed which makes fixing difficult. image

And I tried to find other information from job logs or other things but couldn't find anything helpful.

kwonmha commented 2 years ago

Additional note: If I download example code and submit for testing, it still gives same submission failure(I know it downs't have model files).

kwonmha commented 2 years ago

@inmoonlight @JunYeopLee @marble25 @SungjoonPark

Hello, did someone check this issue?

  1. Is submission working well with well-formatted tar.gz file?
  2. It still gives me an error when click "My submission" and "Job log".
  3. Let me know how files should be involved tar.gz file.
mssongit commented 1 year ago

Has this problem been resolved? Same issue occurs.

image

My submit file configuration is below. wos_code_tar.gz

image