huawei-noah / vega

AutoML tools chain
http://www.noahlab.com.hk/opensource/vega/
Other
841 stars 177 forks source link

vega-noah:esr-ea/dnet-nas 网络废弃接口告警打印过多 #287

Open ultraWeiger opened 10 months ago

ultraWeiger commented 10 months ago

Related testcase / 关联用例 (Mandatory / 必填) test_ms_esr_ea_ilsvrc_ascend_check_fps_0001.py

Steps to reproduce the issue / 重现步骤 (Mandatory / 必填) cd solution_test/cases/02network/00cv/dnetnas/train pytest -s test_ms_esr_ea_ilsvrc_ascend_check_fps_0001.py Describe the expected behavior / 预期结果 (Mandatory / 必填) 训练成功

Related log / screenshot / 日志 / 截图 (Mandatory / 必填)

INFO 2023-09-05 13:00:34 - test_ms_esr_ea_vid2k_ascend_check_fps_0001 - local_cmd_actuator.py:exec_shell_cmd:47 - Exec [grep '^\[WARNING\]' /home/jenkins0/solution_test/cases/02network/0_ms_esr_ea_vid2k_ascend_check_fps_0001/src/train.log|awk -F ' \\[' '{print $2}'|sort|uniq -c|awk '{if ($1+0>10*1) print}'] success
ERROR 2023-09-05 13:00:34 - test_ms_esr_ea_vid2k_ascend_check_fps_0001 - base.py:check_warn_info:1027 - 以下是WARNING日志重复次数超过10的日志
WARNING日志重复次数     WARNING日志
15 mindspore/ccsrc/minddata/dataset/engine/datasetops/data_queue_op.cc:1144] DetectPerBatchTime] Bad performance attention, it takes more than 25 seconds to fetch a batch of data from da might result `GetNext` timeout problem. You may test dataset processing performance(with creating dataset iterator) and optimize it.
     13 mindspore/ccsrc/minddata/dataset/engine/datasetops/source/generator_op.cc:224] operator()] Bad performance attention, it takes more than 25 seconds to generator.__next__ new row,etNext` timeout problem when sink_mode=True. You can increase the parameter num_parallel_workers in GeneratorDataset / optimize the efficiency of obtaining samples in the user-defined ge
     18 mindspore/train/model.py:1104] For EvalCallBack callback, {'epoch_end'} methods may not be supported in later version, Use methods prefixed with 'on_train' or 'on_eval' instead wcallbacks.
ERROR 2023-09-05 13:00:34 - test_ms_esr_ea_vid2k_ascend_check_fps_0001 - base.py:check_warn_info:1031 - Warning logs exceed the threshold.
ERROR 2023-09-05 13:00:34 - test_ms_esr_ea_vid2k_ascend_check_fps_0001 - base.py:check_err_info_in_log:975 - Warning logs exceed the threshold.
ERROR 2023-09-05 13:00:34 - test_ms_esr_ea_vid2k_ascend_check_fps_0001 - test_ms_esr_ea_vid2k_ascend_check_fps_0001.py:test_run:130 - Somethong wrong with train or infer, pls check error
INFO 2023-09-05 13:00:35 - test_ms_esr_ea_vid2k_ascend_check_fps_0001 - local_cmd_actuator.py:get_status_cmd:75 - Exec [date > /home/jenkins0/solution_test/cases/02network/00cv/esr_ea/