search

ecker-lab / sensorium_2023

repo for the sensorium 2023 competition
24 stars 13 forks source link

Submission data not updated #6

Closed wangkaihong closed 1 year ago

wangkaihong commented 1 year ago

Hi,

When we submit the results, we meet this error: 

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/tmp/codalab/tmpetecAj/run/program/score.py", line 546, in 
    assert set(solutions['mouse'].unique().tolist()) == set(predictions['mouse'].unique().tolist()), \
AssertionError: Mice are different in predictions. Mice column should contain all of the following values
 ['dynamic29156-11-10-Video-8744edeac3b4d1ce16b680916b5267ce', 
 'dynamic29228-2-10-Video-8744edeac3b4d1ce16b680916b5267ce', 
 'dynamic29234-6-9-Video-8744edeac3b4d1ce16b680916b5267ce', 
 'dynamic29513-3-5-Video-8744edeac3b4d1ce16b680916b5267ce', 
 'dynamic29514-2-9-Video-8744edeac3b4d1ce16b680916b5267ce']

It seems like the evaluation code is still looking for the name of the old datasets which are now replaced. Is that correct?

Thanks

pollytur commented 1 year ago

I guess this should help:) https://codalab.sensorium-competition.net/competitions/13