submit Error 발생

[JasSong]

Informations

CLI

• OS (Mac, Windows, Linux, etc) and version: Window
• client version(please show nsml --version): Built: 2019-01-10T17:16:19+09:00 Go: go1.11.4 GOARCH: amd64 GOOS: windows Protocol: 20181214 Revision: cb3f66b5c345e62119237b5793139abee887eb5b (not-modified) Preconfigured connection: hack-cli.nsml.navercorp.com
• 전체 실행 명령어: nsml submit line_by_line/ir_ph1_v2/118 12

WEB

• Brower (chrome, firfox, etc): chrome
• URL:

NSML login ID 가 무엇인가요? jassong

문제가 발생한 세션은 어떤건가요? (bug message or screenshot) Error: Error occurred while loading model time="2019/01/11 09:37:16.475" level=fatal msg="Internal server error"

재현방법은 어떻게 되나요?

예상했던 동작방식은 무엇인가요? 학습은 정상적으로 되었고, submit시 error가 판단

제안하고 싶은 해결방법이 있나요? 코드에 대한 에러가 발생하지 않습니다. 자세한 로그 부탁드립니다.

[Hackoperation]

안녕하세요.

File "main_vgg16_base_conv_tune_block5_unfreeze.py", line 41, in load
    model.load_weights(file_path)
  File "/opt/conda/lib/python3.5/site-packages/keras/engine/network.py", line 1166, in load_weights
    f, self.layers, reshape=reshape)
  File "/opt/conda/lib/python3.5/site-packages/keras/engine/saving.py", line 1058, in load_weights_from_hdf5_group
    K.batch_set_value(weight_value_tuples)
  File "/opt/conda/lib/python3.5/site-packages/keras/backend/tensorflow_backend.py", line 2470, in batch_set_value
    get_session().run(assign_ops, feed_dict=feed_dict)
  File "/opt/conda/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/opt/conda/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (256, 128, 3, 3) for Tensor 'Placeholder_14:0', which has shape '(3, 3, 256, 512)'

입니다.