bytedance / ByteMLPerf

AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.
https://bytemlperf.ai/
Apache License 2.0
197 stars 60 forks source link

运行gpt2-torch-fp32 task 遇到的2个问题 #49

Open longerzone opened 8 months ago

longerzone commented 8 months ago

问题1: general_perf/prepare_model_and_dataset.sh 脚本无法下载到正确的位置:

wget -O general_perf/download/traced_gpt2.tar https://lf-bytemlperf.17mh.cn/obj/bytemlperf-zoo/traced_gpt2.tar
tar xf general_perf/download/gpt2.tar -C general_perf/model_zoo/sota/

下载的tar 包和解压的tar 包名称不一样,需要修改为:

wget -O general_perf/download/traced_gpt2.tar -c https://lf-bytemlperf.17mh.cn/obj/bytemlperf-zoo/traced_gpt2.tar
mkdir general_perf/model_zoo/sota/traced_gpt2
tar xf general_perf/download/traced_gpt2.tar -C general_perf/model_zoo/sota/traced_gpt2/

问题2: 运行过程中遇到如下报错,程序不运行也不异常退出,麻烦确认下是什么问题?

INFO:PerfEngine:******************************************* Running Accuracy Checker... *******************************************
INFO:FAKE_DATA:Rebatching batch size to: 4 ...
INFO:TestAccuracy:Start to calculate accuracy...
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 100/100 [00:28<00:00,  3.48it/s]
INFO:TestAccuracy:Batch size is 4, Accuracy: 0.0
/ByteMLPerf/byte_infer_perf/general_perf/datasets/fake_dataset/test_accuracy.py:48: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray
  np.array(diffs),
运行到这里就卡死了
JianzheXiao commented 7 months ago

Problem 1 fixed: https://github.com/bytedance/ByteMLPerf/commit/6a63cc78b7c102db5c4ce301f9277d45fe7d6dcf