search

ai-starthon / AI_Starthon2019

60 stars 44 forks source link

메모리 부족으로 제출에 실패하고 있는건지 문의합니다 #219

Open onacloud opened 5 years ago

onacloud commented 5 years ago

Informations

CLI

WEB

What is your NSML login ID?

Question

매번 제출에 실패하고 있어서 원인이 궁금합니다. 저희 메모리가 부족해서 그런가요?

nsml submit team_130/16_tcls_movie/48 9
........
Building docker image. It might take for a while
............Inference the test set. The inference should be completed within 3600 seconds.
.
Error occurred while inference. You can check error 'nsml submit --test'
RuntimeError: CUDA out of memory. Tried to allocate 8.00 GiB (GPU 0; 23.88 GiB total capacity; 18.50 GiB already allocated; 1.89 GiB free; 2.80 GiB cached)
nsml-admin commented 5 years ago

네 서브밋에 사용되는 gpu메모리가 부족해서 발생한 문제입니다. https://github.com/ai-starthon/AI_Starthon2019/issues/92 https://github.com/ai-starthon/AI_Starthon2019/issues/100 와 같은 상황인것 같습니다.