zhengying-liu / autodl_starting_kit_stable

Starting kit for AutoCV/AutoDL challenge (https://autodl.chalearn.org)
40 stars 23 forks source link

Bug found by Julio #3

Closed madclam closed 5 years ago

madclam commented 5 years ago

Hi Isabelle, thanks... ;) I downloaded the data and tried to run our baseline using the new starting kit from your git and got an error related to score.py, as shown below (by the way, you missed an apostrophe ' in the following instruction:

you have instructed: -code_dir=AutoDL_simple_baseline_models/linear'

where it should be: -code_dir='AutoDL_simple_baseline_models/linear'

the error:

root@9f8e3b89de81:/app/codalab/autodl_starting_kit_stable# python
run_local_test.py -dataset_dir='../data/'
-code_dir='AutoDL_sample_code_submission_resnet_v2_50-image/'
2019-05-11 19:16:41 INFO run_local_test.py:
##################################################
2019-05-11 19:16:41 INFO run_local_test.py: Begin running local test using
2019-05-11 19:16:41 INFO run_local_test.py: code_dir =
AutoDL_sample_code_submission_resnet_v2_50-image
2019-05-11 19:16:41 INFO run_local_test.py: dataset_dir = data
2019-05-11 19:16:41 INFO run_local_test.py:
##################################################
2019-05-11 19:16:41 INFO run_local_test.py: Cleaning existing output
directory of last run:
/app/codalab/autodl_starting_kit_stable/AutoDL_sample_result_submission
2019-05-11 19:16:41 INFO run_local_test.py: Cleaning existing output
directory of last run:
/app/codalab/autodl_starting_kit_stable/AutoDL_scoring_output
2019-05-11 19:16:41,821 INFO ingestion.py: ===== Start ingestion
program. Version: v20190508 =====
2019-05-11 19:16:44,225 INFO ingestion.py:
************************************************
2019-05-11 19:16:44,225 INFO ingestion.py: ******** Processing dataset
Hippocrate ********
2019-05-11 19:16:44,225 INFO ingestion.py:
************************************************
2019-05-11 19:16:44,225 INFO ingestion.py: Reading training set and test set...
WARNING:tensorflow:From
/app/codalab/autodl_starting_kit_stable/AutoDL_ingestion_program/dataset.py:232:
sparse_to_dense (from tensorflow.python.ops.sparse_ops) is deprecated
and will be removed in a future version.
Instructions for updating:
Create a `tf.sparse.SparseTensor` and use `tf.sparse.to_dense` instead.
2019-05-11 19:16:44,805 INFO score.py: Detected the start of ingestion
after 1 seconds. Start scoring.
2019-05-11 19:16:44,806 WARNING score.py: 0 solution files found: []!
Return `None` as solution.
Traceback (most recent call last):
 File "/app/codalab/autodl_starting_kit_stable/AutoDL_scoring_program/score.py",
line 682, in <module>
   is_multiclass_task = is_multiclass(solution)
 File "/app/codalab/autodl_starting_kit_stable/AutoDL_scoring_program/score.py",
line 202, in is_multiclass
   return all(is_one_hot_vector(solution, axis=1))
 File "/app/codalab/autodl_starting_kit_stable/AutoDL_scoring_program/score.py",
line 187, in is_one_hot_vector
   norm_1 = np.linalg.norm(x, ord=1, axis=axis, keepdims=keepdims)
 File "/usr/local/lib/python3.5/dist-packages/numpy/linalg/linalg.py",
line 2283, in norm
   return add.reduce(abs(x), axis=axis, keepdims=keepdims)
TypeError: bad operand type for abs(): 'NoneType'
zhengying-liu commented 5 years ago

This is due to the fact the no solution file is put in the dataset_dir which is '../data/' in this case. So this is not a bug of ingestion or scoring.