docker容器中，HTTP和RPC服务进行bert模型预测时报错

基本环境是按照文档pull的hub.baidubce.com/paddlepaddle/serving:0.2.0镜像，Windows7 64位环境下安装的docker。容器中安装的0.2.1版本的的client和server。安装后，uci_housing模型可以正常HTTP和RPC预测。但是用bert模型进行测试时有报错，内容如下。HTTP报错{"result":"Request Value Error"}可能是由于传入的数据不对，RPC的报错Illegal instruction (core dumped)。代码如下：

RPC服务：

[root@23130a8f27e7 project_bert_seq20]# python -m paddle_serving_server.serve --model bert_seq20_model --port 9292 --thread 4 &>bert_log.txt &
[1] 1358
[root@23130a8f27e7 project_bert_seq20]# cat data-c.txt | python bert_seq20_rpc.py
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0511 07:55:05.645292  1378 config_manager.cpp:217] Not found key in configue: cluster
E0511 07:55:05.646639  1378 config_manager.cpp:234] Not found key in configue: split_tag_name
E0511 07:55:05.647294  1378 config_manager.cpp:235] Not found key in configue: tag_candidates
E0511 07:55:05.647946  1378 config_manager.cpp:202] Not found key in configue: connect_timeout_ms
E0511 07:55:05.648443  1378 config_manager.cpp:203] Not found key in configue: rpc_timeout_ms
E0511 07:55:05.649521  1378 config_manager.cpp:205] Not found key in configue: hedge_request_timeout_ms
E0511 07:55:05.650112  1378 config_manager.cpp:207] Not found key in configue: connect_retry_count
E0511 07:55:05.650581  1378 config_manager.cpp:209] Not found key in configue: hedge_fetch_retry_count
E0511 07:55:05.651515  1378 config_manager.cpp:211] Not found key in configue: max_connection_per_host
E0511 07:55:05.652343  1378 config_manager.cpp:212] Not found key in configue: connection_type
E0511 07:55:05.652875  1378 config_manager.cpp:219] Not found key in configue: load_balance_strategy
E0511 07:55:05.653631  1378 config_manager.cpp:221] Not found key in configue: cluster_filter_strategy
E0511 07:55:05.654289  1378 config_manager.cpp:226] Not found key in configue: protocol
E0511 07:55:05.654405  1378 config_manager.cpp:227] Not found key in configue: compress_type
E0511 07:55:05.654548  1378 config_manager.cpp:228] Not found key in configue: package_size
E0511 07:55:05.654673  1378 config_manager.cpp:230] Not found key in configue: max_channel_per_request
E0511 07:55:05.655035  1378 config_manager.cpp:234] Not found key in configue: split_tag_name
E0511 07:55:05.655126  1378 config_manager.cpp:235] Not found key in configue: tag_candidates
I0511 07:55:05.664395  1378 naming_service_thread.cpp:209] brpc::policy::ListNamingService("127.0.0.1:9292"): added 1
Illegal instruction (core dumped)

HTTP服务：

[root@23130a8f27e7 project_bert_seq20]# python -m paddle_serving_server.serve --model bert_seq20_model --port 9292 --thread 4 --name bert &>bert_log.txt &
[1] 1404
[root@23130a8f27e7 project_bert_seq20]# curl -H "Content-Type:application/json" -X POST -d '{"feed":[{"words": "great"}], "fetch":["pooled_output"]}' http://0.0.0.0:9292/bert/prediction
{"result":"Request Value Error"}

您好，可以把操作流程完整的发一下吗（包括进入容器，在容器中安装了包的命令等）？这边没能复现出来

你好，复现步骤如下，包含了从状态查询，启动容器，进入容器，以及安装包的信息等： 容器的状态、启动、进入、安装包等信息

C:\Users\Administrator>docker ps -a
CONTAINER ID        IMAGE                                         COMMAND             CREATED             STATUS                        PORTS                    NAMES
23130a8f27e7        hub.baidubce.com/paddlepaddle/serving:0.2.0   "/bin/bash"         2 days ago          Exited (255) 16 minutes ago   0.0.0.0:9292->9292/tcp   test

C:\Users\Administrator>docker start test
test

C:\Users\Administrator>docker ps -a
CONTAINER ID        IMAGE                                         COMMAND             CREATED             STATUS              PORTS                    NAMES
23130a8f27e7        hub.baidubce.com/paddlepaddle/serving:0.2.0   "/bin/bash"         2 days ago          Up 8 minutes        0.0.0.0:9292->9292/tcp   test

C:\Users\Administrator>docker exec -it test bash
[root@23130a8f27e7 /]# cd project_bert_seq20
[root@23130a8f27e7 project_bert_seq20]# ls
bert_log.txt  bert_seq20_client  bert_seq20_model  bert_seq20_rpc.py  core  cs.py  data-c.txt  log  vocab.txt.1  workdir
[root@23130a8f27e7 project_bert_seq20]# pip freeze
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
chardet==2.2.1
click==7.1.2
Flask==1.1.2
iniparse==0.4
itsdangerous==1.1.0
Jinja2==2.11.2
kitchen==1.1.1
MarkupSafe==1.1.1
numpy==1.16.6
opencv-python==4.2.0.32
paddle-serving-app==0.0.2
paddle-serving-client==0.2.1
paddle-serving-server==0.2.1
protobuf==3.11.3
pycurl==7.19.0
pygobject==3.22.0
pygpgme==0.3
pyliblzma==0.5.3
pyxattr==0.5.1
sentencepiece==0.1.86
six==1.14.0
urlgrabber==3.10
Werkzeug==1.0.1
yum-metadata-parser==1.1.4

启动RPC服务预测、cat bert_log.txt

[root@23130a8f27e7 project_bert_seq20]# python -m paddle_serving_server.serve --model bert_seq20_model --port 9292 --thread 4 &>bert_log.txt &
[1] 31
[root@23130a8f27e7 project_bert_seq20]# cat data-c.txt | python bert_seq20_rpc.py
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0513 02:12:19.439486    45 config_manager.cpp:217] Not found key in configue: cluster
E0513 02:12:19.441614    45 config_manager.cpp:234] Not found key in configue: split_tag_name
E0513 02:12:19.442199    45 config_manager.cpp:235] Not found key in configue: tag_candidates
E0513 02:12:19.442862    45 config_manager.cpp:202] Not found key in configue: connect_timeout_ms
E0513 02:12:19.443343    45 config_manager.cpp:203] Not found key in configue: rpc_timeout_ms
E0513 02:12:19.443862    45 config_manager.cpp:205] Not found key in configue: hedge_request_timeout_ms
E0513 02:12:19.444504    45 config_manager.cpp:207] Not found key in configue: connect_retry_count
E0513 02:12:19.444999    45 config_manager.cpp:209] Not found key in configue: hedge_fetch_retry_count
E0513 02:12:19.445470    45 config_manager.cpp:211] Not found key in configue: max_connection_per_host
E0513 02:12:19.445996    45 config_manager.cpp:212] Not found key in configue: connection_type
E0513 02:12:19.446586    45 config_manager.cpp:219] Not found key in configue: load_balance_strategy
E0513 02:12:19.447402    45 config_manager.cpp:221] Not found key in configue: cluster_filter_strategy
E0513 02:12:19.447764    45 config_manager.cpp:226] Not found key in configue: protocol
E0513 02:12:19.448838    45 config_manager.cpp:227] Not found key in configue: compress_type
E0513 02:12:19.449363    45 config_manager.cpp:228] Not found key in configue: package_size
E0513 02:12:19.450052    45 config_manager.cpp:230] Not found key in configue: max_channel_per_request
E0513 02:12:19.450414    45 config_manager.cpp:234] Not found key in configue: split_tag_name
E0513 02:12:19.450937    45 config_manager.cpp:235] Not found key in configue: tag_candidates
I0513 02:12:19.465313    45 naming_service_thread.cpp:209] brpc::policy::ListNamingService("0.0.0.0:9292"): added 1
[1]+  Done                    python -m paddle_serving_server.serve --model bert_seq20_model --port 9292 --thread 4 &>bert_log.txt
Illegal instruction (core dumped)
[root@23130a8f27e7 project_bert_seq20]# cat bert_log.txt
mkdir: cannot create directory 'workdir': File exists
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000    42 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000    42 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000    42 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000    42 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000    42 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000    42 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    42 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000    42 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    42 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000    42 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    42 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000    42 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    42 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000    42 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    42 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000    42 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    42 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running IR pass [simplify_with_basic_ops_pass]
--- Running IR pass [attention_lstm_fuse_pass]
--- Running IR pass [seqconv_eltadd_relu_fuse_pass]
--- Running IR pass [seqpool_cvm_concat_fuse_pass]
--- Running IR pass [fc_lstm_fuse_pass]
--- Running IR pass [mul_lstm_fuse_pass]
--- Running IR pass [fc_gru_fuse_pass]
--- Running IR pass [mul_gru_fuse_pass]
--- Running IR pass [seq_concat_fc_fuse_pass]
--- Running IR pass [fc_fuse_pass]
--- Running IR pass [repeated_fc_relu_fuse_pass]
--- Running IR pass [squared_mat_sub_fuse_pass]
--- Running IR pass [conv_bn_fuse_pass]
--- Running IR pass [conv_eltwiseadd_bn_fuse_pass]
--- Running IR pass [conv_transpose_bn_fuse_pass]
--- Running IR pass [conv_transpose_eltwiseadd_bn_fuse_pass]
--- Running IR pass [is_test_pass]
--- Running IR pass [runtime_context_cache_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.1/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 4 -port 9292 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 4 -max_body_size 536870912

杀serving进程、启动HTTP服务预测、cat bert_log.txt

[root@23130a8f27e7 project_bert_seq20]# ps -ef | grep "serving" | grep -v grep | awk '{print $2}' | xargs kill

Usage:
 kill [options] <pid|name> [...]

Options:
 -a, --all              do not restrict the name-to-pid conversion to processes
                        with the same uid as the present process
 -s, --signal <sig>     send specified signal
 -q, --queue <sig>      use sigqueue(2) rather than kill(2)
 -p, --pid              print pids without signaling them
 -l, --list [=<signal>] list signal names, or convert one to a name
 -L, --table            list signal names and numbers

 -h, --help     display this help and exit
 -V, --version  output version information and exit

For more details see kill(1).
[root@23130a8f27e7 project_bert_seq20]# python -m paddle_serving_server.serve --model bert_seq20_model --port 9292 --thread 4 --name bert &>bert_log.txt &
[1] 142
[root@23130a8f27e7 project_bert_seq20]# curl -H "Content-Type:application/json" -X POST -d '{"feed":[{"words": "not too bad"}], "fetch":["pooled_output"]}' http://0.0.0.0:9292/bert/prediction
{"result":"Request Value Error"}
[root@23130a8f27e7 project_bert_seq20]# cat bert_log.txt
web service address:
http://172.17.0.2:9292/bert/prediction
 * Serving Flask app "serve" (lazy loading)
 * Environment: production
   WARNING: This is a development server. Do not use it in a production deployment.
   Use a production WSGI server instead.
 * Debug mode: off
 * Running on http://0.0.0.0:9292/ (Press CTRL+C to quit)
mkdir: cannot create directory 'workdir': File exists
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000   154 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000   154 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000   154 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000   154 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000   154 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000   154 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   154 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000   154 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   154 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000   154 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   154 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000   154 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   154 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000   154 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   154 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000   154 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   154 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running IR pass [simplify_with_basic_ops_pass]
--- Running IR pass [attention_lstm_fuse_pass]
--- Running IR pass [seqconv_eltadd_relu_fuse_pass]
--- Running IR pass [seqpool_cvm_concat_fuse_pass]
--- Running IR pass [fc_lstm_fuse_pass]
--- Running IR pass [mul_lstm_fuse_pass]
--- Running IR pass [fc_gru_fuse_pass]
--- Running IR pass [mul_gru_fuse_pass]
--- Running IR pass [seq_concat_fc_fuse_pass]
--- Running IR pass [fc_fuse_pass]
--- Running IR pass [repeated_fc_relu_fuse_pass]
--- Running IR pass [squared_mat_sub_fuse_pass]
--- Running IR pass [conv_bn_fuse_pass]
--- Running IR pass [conv_eltwiseadd_bn_fuse_pass]
--- Running IR pass [conv_transpose_bn_fuse_pass]
--- Running IR pass [conv_transpose_eltwiseadd_bn_fuse_pass]
--- Running IR pass [is_test_pass]
--- Running IR pass [runtime_context_cache_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0513 02:17:04.634415   175 config_manager.cpp:217] Not found key in configue: cluster
E0513 02:17:04.634845   175 config_manager.cpp:234] Not found key in configue: split_tag_name
E0513 02:17:04.634865   175 config_manager.cpp:235] Not found key in configue: tag_candidates
E0513 02:17:04.634902   175 config_manager.cpp:202] Not found key in configue: connect_timeout_ms
E0513 02:17:04.634920   175 config_manager.cpp:203] Not found key in configue: rpc_timeout_ms
E0513 02:17:04.634930   175 config_manager.cpp:205] Not found key in configue: hedge_request_timeout_ms
E0513 02:17:04.634940   175 config_manager.cpp:207] Not found key in configue: connect_retry_count
E0513 02:17:04.634951   175 config_manager.cpp:209] Not found key in configue: hedge_fetch_retry_count
E0513 02:17:04.634961   175 config_manager.cpp:211] Not found key in configue: max_connection_per_host
E0513 02:17:04.634971   175 config_manager.cpp:212] Not found key in configue: connection_type
E0513 02:17:04.634981   175 config_manager.cpp:219] Not found key in configue: load_balance_strategy
E0513 02:17:04.634992   175 config_manager.cpp:221] Not found key in configue: cluster_filter_strategy
E0513 02:17:04.635002   175 config_manager.cpp:226] Not found key in configue: protocol
E0513 02:17:04.635012   175 config_manager.cpp:227] Not found key in configue: compress_type
E0513 02:17:04.635022   175 config_manager.cpp:228] Not found key in configue: package_size
E0513 02:17:04.635032   175 config_manager.cpp:230] Not found key in configue: max_channel_per_request
E0513 02:17:04.635041   175 config_manager.cpp:234] Not found key in configue: split_tag_name
E0513 02:17:04.635051   175 config_manager.cpp:235] Not found key in configue: tag_candidates
I0513 02:17:04.653781   175 naming_service_thread.cpp:209] brpc::policy::ListNamingService("0.0.0.0:12000"): added 1
127.0.0.1 - - [13/May/2020 02:17:04] "POST /bert/prediction HTTP/1.1" 200 -

您好，

注意到您使用的是bert_seq20_model模型，该文件由prepare_model.py文件（在bert目录下）生成。而prepare_model.py依赖于paddlehub，但是没有看到您安装了相关的Python包，想知道您的模型文件是怎么获得的？
您在测试RPC的时候使用了bert_seq20_rpc.py文件，应该是做了些改动，可否展示下该文件的内容？
还注意到http有该输出127.0.0.1 - - [13/May/2020 02:17:04] "POST /bert/prediction HTTP/1.1" 200 -，http预测是否正常？
建议严格按照README的流程走

您好，

注意到您使用的是bert_seq20_model模型，该文件由prepare_model.py文件（在bert目录下）生成。而prepare_model.py依赖于paddlehub，但是没有看到您安装了相关的Python包，想知道您的模型文件是怎么获得的？

您在测试RPC的时候使用了bert_seq20_rpc.py文件，应该是做了些改动，可否展示下该文件的内容？

还注意到http有该输出127.0.0.1 - - [13/May/2020 02:17:04] "POST /bert/prediction HTTP/1.1" 200 -，http预测是否正常？

建议严格按照README的流程走

你好，问题1：使用的bert_seq20_model 模型是在本地Windows环境下通过paddle_serving_client.io保存的（https://github.com/PaddlePaddle/Serving/blob/develop/doc/BERT_10_MINS_CN.md，按照step1在本地Windows保存的）。随后将2个文件夹（bert_seq20_client和bert_seq20_model）通过docker cp到了容器内。本地Windows环境下安装了paddlehub==1.6.1 和paddlepaddle==1.7.2版本。问题2：bert_seq20_rpc.py文件内容基本上按照文档https://github.com/PaddlePaddle/Serving/blob/develop/doc/BERT_10_MINS_CN.md，的step4执行的，内容如下：

import sys
from paddle_serving_client import Client
from paddle_serving_app import ChineseBertReader

reader = ChineseBertReader()
fetch = ["pooled_output"]
endpoint_list = ["0.0.0.0:9292"]
client = Client()
client.load_client_config("bert_seq20_client/serving_client_conf.prototxt")
client.connect(endpoint_list)

for line in sys.stdin:
    feed_dict = reader.process(line.strip())
    result = client.predict(feed=feed_dict, fetch=fetch)

问题3：HTTP预测返回{"result":"Request Value Error"}，我估计可能是传入的数据不对导致。问题4：我正在另一台window电脑，刚装安好的docker环境下进行测试，重新走一遍。我是按照https://github.com/PaddlePaddle/Serving/blob/develop/doc/BERT_10_MINS_CN.md这个文档的步骤在进行测试，感觉与(https://github.com/PaddlePaddle/Serving/blob/develop/python/examples/bert/README_CN.md)有区别。

你好，另一台电脑的docker容器内安装了python包paddle-serving-client==0.2.1、paddle-serving-server==0.2.1、paddlehub==1.6.2、paddlepaddle==1.7.2。下午严格按照README的流程在走，输入命令python prepare_model.py 128后，出现报错。 prepare_model.py的代码与README中提供的是一样的

import paddlehub as hub
import paddle.fluid as fluid
import sys
import paddle_serving_client.io as serving_io

model_name = "bert_chinese_L-12_H-768_A-12"
module = hub.Module(model_name)
inputs, outputs, program = module.context(
    trainable=True, max_seq_len=int(sys.argv[1]))
place = fluid.core_avx.CPUPlace()
exe = fluid.Executor(place)
input_ids = inputs["input_ids"]
position_ids = inputs["position_ids"]
segment_ids = inputs["segment_ids"]
input_mask = inputs["input_mask"]
pooled_output = outputs["pooled_output"]
sequence_output = outputs["sequence_output"]

feed_var_names = [
    input_ids.name, position_ids.name, segment_ids.name, input_mask.name
]

target_vars = [pooled_output, sequence_output]

serving_io.save_model(
    "bert_seq{}_model".format(sys.argv[1]),
    "bert_seq{}_client".format(sys.argv[1]), {
        "input_ids": input_ids,
        "position_ids": position_ids,
        "segment_ids": segment_ids,
        "input_mask": input_mask,
    }, {"pooled_output": pooled_output,
        "sequence_output": sequence_output}, program)

报错信息：

[root@74479173b0e3 project_bert]# python prepare_model.py 128
[2020-05-13 07:07:05,799] [    INFO] - Installing bert_chinese_L-12_H-768_A-12 module
Downloading bert_chinese_L-12_H-768_A-12
[==================================================] 100.00%
Uncompress /root/.paddlehub/tmp/tmpVLGb_t/bert_chinese_L-12_H-768_A-12
[==================================================] 100.00%
[2020-05-13 07:08:22,366] [    INFO] - Successfully installed bert_chinese_L-12_H-768_A-12-1.1.0
[2020-05-13 07:08:30,923] [    INFO] - Load pretraining parameters from /root/.paddlehub/modules/bert_chinese_L_12_H_768_A_12/assets/params.
Traceback (most recent call last):
  File "prepare_model.py", line 10, in <module>
    place = fluid.core_avx.CPUPlace()
AttributeError: 'module' object has no attribute 'core_avx'

import paddlehub as hub
import paddle.fluid as fluid
import sys
import paddle_serving_client.io as serving_io

model_name = "bert_chinese_L-12_H-768_A-12"
module = hub.Module(model_name)
inputs, outputs, program = module.context(
    trainable=True, max_seq_len=int(sys.argv[1]))
place = fluid.core_avx.CPUPlace()
exe = fluid.Executor(place)
input_ids = inputs["input_ids"]
position_ids = inputs["position_ids"]
segment_ids = inputs["segment_ids"]
input_mask = inputs["input_mask"]
pooled_output = outputs["pooled_output"]
sequence_output = outputs["sequence_output"]

feed_var_names = [
    input_ids.name, position_ids.name, segment_ids.name, input_mask.name
]

target_vars = [pooled_output, sequence_output]

serving_io.save_model(
    "bert_seq{}_model".format(sys.argv[1]),
    "bert_seq{}_client".format(sys.argv[1]), {
        "input_ids": input_ids,
        "position_ids": position_ids,
        "segment_ids": segment_ids,
        "input_mask": input_mask,
    }, {"pooled_output": pooled_output,
        "sequence_output": sequence_output}, program)

报错信息：

[root@74479173b0e3 project_bert]# python prepare_model.py 128
[2020-05-13 07:07:05,799] [    INFO] - Installing bert_chinese_L-12_H-768_A-12 module
Downloading bert_chinese_L-12_H-768_A-12
[==================================================] 100.00%
Uncompress /root/.paddlehub/tmp/tmpVLGb_t/bert_chinese_L-12_H-768_A-12
[==================================================] 100.00%
[2020-05-13 07:08:22,366] [    INFO] - Successfully installed bert_chinese_L-12_H-768_A-12-1.1.0
[2020-05-13 07:08:30,923] [    INFO] - Load pretraining parameters from /root/.paddlehub/modules/bert_chinese_L_12_H_768_A_12/assets/params.
Traceback (most recent call last):
  File "prepare_model.py", line 10, in <module>
    place = fluid.core_avx.CPUPlace()
AttributeError: 'module' object has no attribute 'core_avx'

我将core_avx删除后，命令python prepare_model.py 128执行没问题并正常保存了模型文件。

[root@74479173b0e3 project_bert]# python prepare_model.py 128
[2020-05-13 07:25:28,599] [    INFO] - Installing bert_chinese_L-12_H-768_A-12 module
[2020-05-13 07:25:28,614] [    INFO] - Module bert_chinese_L-12_H-768_A-12 already installed in /root/.paddlehub/modules/bert_chinese_L_12_H_768_A_12
[2020-05-13 07:25:44,648] [    INFO] - Load pretraining parameters from /root/.paddlehub/modules/bert_chinese_L_12_H_768_A_12/assets/params.
[root@74479173b0e3 project_bert]# ls -l
total 824
drwxr-xr-x 2 root root   4096 May 13 07:25 bert_seq128_client
drwxr-xr-x 2 root root  24576 May 13 07:25 bert_seq128_model
-rw-r--r-- 1 root root 692569 Feb 28 02:17 data-c.txt
-rwxr-xr-x 1 root root    177 May 13 07:01 get_data.sh
-rwxr-xr-x 1 root root   1084 May 13 07:23 prepare_model.py
-rw-r--r-- 1 root root 109540 Mar 12 03:15 vocab.txt

你好，接下来按照文档启动RPC服务过程中，出现如下信息（有很多重复的，我截取了2段）：

[root@74479173b0e3 project_bert]# head data-c.txt | python bert_client.py --model bert_seq128_client/serving_client_conf.prototxt
--2020-05-13 07:43:23--  https://paddle-serving.bj.bcebos.com/reader/chinese_bert/vocab.txt
Resolving paddle-serving.bj.bcebos.com (paddle-serving.bj.bcebos.com)... 220.181.33.44, 220.181.33.43
Connecting to paddle-serving.bj.bcebos.com (paddle-serving.bj.bcebos.com)|220.181.33.44|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 109540 (107K) [text/plain]
Saving to: 'vocab.txt.1'

100%[============================================================================================================================================================================================================================>] 109,540     --.-K/s   in 0.09s

2020-05-13 07:43:24 (1.11 MB/s) - 'vocab.txt.1' saved [109540/109540]

WARNING: Logging before InitGoogleLogging() is written to STDERR
E0513 07:43:27.202705   953 config_manager.cpp:217] Not found key in configue: cluster
E0513 07:43:27.206037   953 config_manager.cpp:234] Not found key in configue: split_tag_name
E0513 07:43:27.207111   953 config_manager.cpp:235] Not found key in configue: tag_candidates
E0513 07:43:27.208784   953 config_manager.cpp:202] Not found key in configue: connect_timeout_ms
E0513 07:43:27.208850   953 config_manager.cpp:203] Not found key in configue: rpc_timeout_ms
E0513 07:43:27.208879   953 config_manager.cpp:205] Not found key in configue: hedge_request_timeout_ms
E0513 07:43:27.209749   953 config_manager.cpp:207] Not found key in configue: connect_retry_count
E0513 07:43:27.210227   953 config_manager.cpp:209] Not found key in configue: hedge_fetch_retry_count
E0513 07:43:27.211673   953 config_manager.cpp:211] Not found key in configue: max_connection_per_host
E0513 07:43:27.211725   953 config_manager.cpp:212] Not found key in configue: connection_type
E0513 07:43:27.211745   953 config_manager.cpp:219] Not found key in configue: load_balance_strategy
E0513 07:43:27.211760   953 config_manager.cpp:221] Not found key in configue: cluster_filter_strategy
E0513 07:43:27.211773   953 config_manager.cpp:226] Not found key in configue: protocol
E0513 07:43:27.211787   953 config_manager.cpp:227] Not found key in configue: compress_type
E0513 07:43:27.211802   953 config_manager.cpp:228] Not found key in configue: package_size
E0513 07:43:27.211815   953 config_manager.cpp:230] Not found key in configue: max_channel_per_request
E0513 07:43:27.211829   953 config_manager.cpp:234] Not found key in configue: split_tag_name
E0513 07:43:27.211843   953 config_manager.cpp:235] Not found key in configue: tag_candidates
I0513 07:43:27.223799   953 naming_service_thread.cpp:209] brpc::policy::ListNamingService("127.0.0.1:9292"): added 1
W0513 07:43:27.235792   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E111]Fail to connect SocketId=1@127.0.0.1:9292: Connection refused [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.236188   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 6843 int64_data: 3241 int64_data: 749 int64_data: 8024 int64_data: 7662 int64_data: 2533 int64_data: 1391 int64_data: 2533 int64_data: 2523 int64_data: 7676 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.239526   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.239817   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.241112   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data: 14 int64_data: 15 int64_data: 16 int64_data: 17 int64_data: 18 int64_data: 19 int64_data: 20 int64_data: 21 int64_data: 22 int64_data: 23 int64_data: 24 int64_data: 25 int64_data: 26 int64_data: 27
int64_data: 28 int64_data: 29 int64_data: 30 int64_data: 31 int64_data: 32 int64_data: 33 int64_data: 34 int64_data: 35 int64_data: 36 int64_data: 37 int64_data: 38 int64_data: 39 int64_data: 40 int64_data: 41 int64_data: 42 int64_data: 43 int64_data: 44 int64_data: 45 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 691 int64_data: 6205 int64_data: 6820 int64_data: 679 int64_data: 7231 int64_data: 8024 int64_data: 852 int64_data: 3221 int64_data: 6843 int64_data: 7623 int64_data: 6862 int64_data: 2428 int64_data: 1922 int64_data: 2714 int64_data: 749 int64_data: 8024 int64_data: 679 int64_data: 5543 int64_data: 2902 int64_data: 3198 int64_data: 6843 int64_data: 6809 int64_data: 8024 int64_data: 5018 int64_data: 753 int64_data: 1296 int64_data: 697 int64_data: 702 int64_data: 1914 int64_data: 2207 int64_data: 3198 int64_data: 749 int64_data: 8024 int64_data: 6820 int64_data: 3766 int64_data: 3300 int64_data: 1168 int64_data: 8024 int64_data: 6821 int64_data: 6862 int64_data: 2428 int64_data: 4696 int64_data: 3221 int64_data: 7004 int64_data: 749 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type:
0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.263612   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.264199   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.264725   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 2523 int64_data: 1962 int64_data: 8024 int64_data: 2523 int64_data: 2571 int64_data: 2218 int64_data: 6843 int64_data: 3341 int64_data: 749 int64_data: 8024 int64_data: 6468 int64_data: 6468 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
I0513 07:43:27.339118   973 socket.cpp:2370] Checking SocketId=0@127.0.0.1:9292

Server端的输出是什么呢？

一大串这样的重复信息

E0513 07:43:27.236188   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 6843 int64_data: 3241 int64_data: 749 int64_data: 8024 int64_data: 7662 int64_data: 2533 int64_data: 1391 int64_data: 2533 int64_data: 2523 int64_data: 7676 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.239526   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.239817   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.241112   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data: 14 int64_data: 15 int64_data: 16 int64_data: 17 int64_data: 18 int64_data: 19 int64_data: 20 int64_data: 21 int64_data: 22 int64_data: 23 int64_data: 24 int64_data: 25 int64_data: 26 int64_data: 27
int64_data: 28 int64_data: 29 int64_data: 30 int64_data: 31 int64_data: 32 int64_data: 33 int64_data: 34 int64_data: 35 int64_data: 36 int64_data: 37 int64_data: 38 int64_data: 39 int64_data: 40 int64_data: 41 int64_data: 42 int64_data: 43 int64_data: 44 int64_data: 45 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 691 int64_data: 6205 int64_data: 6820 int64_data: 679 int64_data: 7231 int64_data: 8024 int64_data: 852 int64_data: 3221 int64_data: 6843 int64_data: 7623 int64_data: 6862 int64_data: 2428 int64_data: 1922 int64_data: 2714 int64_data: 749 int64_data: 8024 int64_data: 679 int64_data: 5543 int64_data: 2902 int64_data: 3198 int64_data: 6843 int64_data: 6809 int64_data: 8024 int64_data: 5018 int64_data: 753 int64_data: 1296 int64_data: 697 int64_data: 702 int64_data: 1914 int64_data: 2207 int64_data: 3198 int64_data: 749 int64_data: 8024 int64_data: 6820 int64_data: 3766 int64_data: 3300 int64_data: 1168 int64_data: 8024 int64_data: 6821 int64_data: 6862 int64_data: 2428 int64_data: 4696 int64_data: 3221 int64_data: 7004 int64_data: 749 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type:
0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.263612   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.264199   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.264725   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 2523 int64_data: 1962 int64_data: 8024 int64_data: 2523 int64_data: 2571 int64_data: 2218 int64_data: 6843 int64_data: 3341 int64_data: 749 int64_data: 8024 int64_data: 6468 int64_data: 6468 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.265802   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.266100   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.266512   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 107 int64_data: 2523 int64_data: 1962 int64_data: 1391 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.269217   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.269704   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.270306   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data: 14 int64_data: 15 int64_data: 16 int64_data: 17 int64_data: 18 int64_data: 19 int64_data: 20 int64_data: 21 int64_data: 22 int64_data: 23 int64_data: 24 int64_data: 25 int64_data: 26 int64_data: 27
int64_data: 28 int64_data: 29 int64_data: 30 int64_data: 31 int64_data: 32 int64_data: 33 int64_data: 34 int64_data: 35 int64_data: 36 int64_data: 37 int64_data: 38 int64_data: 39 int64_data: 40 int64_data: 41 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 1259 int64_data: 6163 int64_data: 3302 int64_data: 1218 int64_data: 6963 int64_data: 2523 int64_data: 1962 int64_data: 8080 int64_data: 738 int64_data: 2523 int64_data: 3633 int64_data: 6226 int64_data: 4638 int64_data: 671 int64_data: 2157 int64_data: 1912 int64_data: 1297 int64_data: 8080 int64_data: 2218 int64_data: 3221 int64_data: 3315 int64_data: 782 int64_data: 679 int64_data: 1922 int64_data: 1599 int64_data: 3614 int64_data: 4494 int64_data: 7481 int64_data: 6996 int64_data: 4638 int64_data: 1366 int64_data: 1456 int64_data: 8080 int64_data: 678 int64_data: 3613 int64_data: 679 int64_data: 833 int64_data: 6848 int64_data: 6821 int64_data: 702 int64_data: 749 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.271711   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.272095   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.272543   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data: 14 int64_data: 15 int64_data: 16 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 6862 int64_data: 2428 int64_data: 2523 int64_data: 2571 int64_data: 8024 int64_data: 7649 int64_data: 5831 int64_data: 6963 int64_data: 679 int64_data: 7231 int64_data: 8024 int64_data: 2218 int64_data: 3221 int64_data: 679 int64_data: 1916 int64_data: 6793 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.273887   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.274248   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.274817   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 6843 int64_data: 2533 int64_data: 1922 int64_data: 2714 int64_data: 749 int64_data: 8080 int64_data: 1456 int64_data: 6887 int64_data: 2523 int64_data: 1962 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.278370   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.278760   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.279218   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 1962 int64_data: 8024 int64_data: 1456 int64_data: 6887 int64_data: 679 int64_data: 7231 int64_data: 8024 int64_data: 1114 int64_data: 3198 int64_data: 6843 int64_data: 6809 int64_data: 511 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.281093   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.281512   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.281841   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data: 14 int64_data: 15 int64_data: 16 int64_data: 17 int64_data: 18 int64_data: 19 int64_data: 20 int64_data: 21 int64_data: 22 int64_data: 23 int64_data: 24 int64_data: 25 int64_data: 26 int64_data: 27
int64_data: 28 int64_data: 29 int64_data: 30 int64_data: 31 int64_data: 32 int64_data: 33 int64_data: 34 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 7623 int64_data: 6843 int64_data: 1168 int64_data: 7305 int64_data: 7305 int64_data: 1366 int64_data: 8024 int64_data: 2578 int64_data: 2428 int64_data: 2523 int64_data: 1962 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_data: 2523 int64_data: 3472 int64_data: 1318 int64_data: 7660 int64_data: 4500 int64_data: 7234 int64_data: 5291 int64_data: 1259 int64_data: 4708 int64_data: 8024 int64_data: 1456 int64_data: 6887 int64_data: 2523 int64_data: 3472 int64_data: 8024 int64_data: 722 int64_data: 1400 int64_data: 6820 int64_data: 833 int64_data: 743 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
W0513 07:43:27.283169   953 stub_impl.hpp:136] Already thread initialized for stub
W0513 07:43:27.284179   953 predictor.hpp:129] inference call failed, message: [E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:9292 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0513 07:43:27.284786   953 general_model.cpp:245] failed call predictor with req: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 2923 int64_data: 1962 int64_data: 4638 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_data: 4384 int64_data: 924 int64_data: 1348 int64_data: 3300 int64_data: 1501 int64_data: 511 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "pooled_output"
I0513 07:43:27.339118   973 socket.cpp:2370] Checking SocketId=0@127.0.0.1:9292

这部分应该是Client端的错误信息（意思是预测错误，输出了该次预测的请求值），能否看一下Server端的错误信息？

这部分应该是Client端的错误信息（意思是预测错误，输出了该次预测的请求值），能否看一下Server端的错误信息？

请教一下，Server端的错误在哪里看。我看了一下目录，在目录log中有2个文件serving.INFO，serving.WARNING。 serving.INFO的信息

[root@74479173b0e3 log]# cat serving.INFO
Log file created at: 2020/05/13 07:32:43
Running on machine: 74479173b0e3
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0513 07:32:43.448406   896 resource.cpp:110] Successfully proc initialized memp
ool wrapper
I0513 07:32:43.449168   896 infer.h:768] model_toolkit_conf.engines(0).name: gen
eral_infer_0
I0513 07:32:43.449227   896 infer.h:67] InferEngineCreationParams: model_path =
bert_seq128_model/, enable_memory_optimization = 0, static_optimization = 0, for
ce_update_static_cache = 0
I0513 07:32:43.449456   896 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
I0513 07:32:43.553450   896 analysis_predictor.cc:833] MODEL VERSION: 1.7.2
I0513 07:32:43.553570   896 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.1
I0513 07:32:51.903512   896 graph_pattern_detector.cc:101] ---  detected 73 subg
raphs
I0513 07:32:52.711712   896 analysis_predictor.cc:462] ======= optimize end ====
===
W0513 07:32:52.716145   896 infer.h:473] Succ load common model[0x6511750], path
[bert_seq128_model/].
W0513 07:32:52.716892   896 infer.h:171] Succ load model_data_pathbert_seq128_mo
del/
W0513 07:32:52.716928   896 infer.h:606] Succ proc initialize version engine: 18
446744073709551615
W0513 07:32:52.716943   896 infer.h:580] Succ proc initialize engine: general_in
fer_0
W0513 07:32:52.716961   896 infer.h:785] Succ proc initialize engine: general_in
fer_0
W0513 07:32:52.717310   896 kv_manager.h:70] general_infer_0:
W0513 07:32:52.717334   896 kv_manager.h:72] Succ proc initialize kvmanager for
engine: general_infer_0
I0513 07:32:52.718040   896 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0513 07:32:52.718127   896 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0513 07:32:52.718137   896 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0513 07:32:52.718168   896 dag.cpp:158] DAG: workflow1
I0513 07:32:52.718178   896 dag.cpp:159] , Op Num: 3
I0513 07:32:52.718189   896 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0513 07:32:52.718199   896 dag.cpp:164]  depends: 0
I0513 07:32:52.718207   896 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0513 07:32:52.718216   896 dag.cpp:164]  depends: 1
I0513 07:32:52.718226   896 dag.cpp:168]  general_reader_0 0
I0513 07:32:52.718235   896 dag.cpp:162] , OP-3-general_response_0-GeneralRespon
seOp
I0513 07:32:52.718245   896 dag.cpp:164]  depends: 1
I0513 07:32:52.718410   896 dag.cpp:168]  general_infer_0 0
I0513 07:32:52.718420   896 dag.cpp:171]
I0513 07:32:52.718432   896 manager.h:86] Succ init item:workflow1 from conf:wor
kdir/workflow.prototxt, at:0!
W0513 07:32:52.718839   896 service.cpp:49] Succ get merger: default for service
: GeneralModelService
I0513 07:32:52.719110   896 service.cpp:61] service[GeneralModelService], enable
_map_request_to_workflow[0].
I0513 07:32:52.719151   896 predictor_metric.h:170] try to regist latency metric
[workflow_GeneralModelService_workflow1].
I0513 07:32:52.719225   896 predictor_metric.h:175] succ to regist latency metri
c[workflow_GeneralModelService_workflow1].
I0513 07:32:52.719239   896 predictor_metric.h:170] try to regist latency metric
[stage_GeneralModelService_workflow1_0].
I0513 07:32:52.719316   896 predictor_metric.h:175] succ to regist latency metri
c[stage_GeneralModelService_workflow1_0].
I0513 07:32:52.719331   896 predictor_metric.h:170] try to regist latency metric
[op_GeneralModelService_workflow1_0_general_reader_0].
I0513 07:32:52.719375   896 predictor_metric.h:175] succ to regist latency metri
c[op_GeneralModelService_workflow1_0_general_reader_0].
I0513 07:32:52.719389   896 predictor_metric.h:170] try to regist latency metric
[stage_GeneralModelService_workflow1_1].
I0513 07:32:52.719429   896 predictor_metric.h:175] succ to regist latency metri
c[stage_GeneralModelService_workflow1_1].
I0513 07:32:52.719440   896 predictor_metric.h:170] try to regist latency metric
[op_GeneralModelService_workflow1_1_general_infer_0].
I0513 07:32:52.719485   896 predictor_metric.h:175] succ to regist latency metri
c[op_GeneralModelService_workflow1_1_general_infer_0].
I0513 07:32:52.719497   896 predictor_metric.h:170] try to regist latency metric
[stage_GeneralModelService_workflow1_2].
I0513 07:32:52.719614   896 predictor_metric.h:175] succ to regist latency metri
c[stage_GeneralModelService_workflow1_2].
I0513 07:32:52.719635   896 predictor_metric.h:170] try to regist latency metric
[op_GeneralModelService_workflow1_2_general_response_0].
I0513 07:32:52.719769   896 predictor_metric.h:175] succ to regist latency metri
c[op_GeneralModelService_workflow1_2_general_response_0].
I0513 07:32:52.719805   896 service.cpp:126] Succ load infer_service: GeneralMod
elService!
I0513 07:32:52.719822   896 manager.h:184] Succ init item:GeneralModelService fr
om conf:workdir/infer_service.prototxt, at:0!
I0513 07:32:52.722102   898 server.cpp:147] Entrence reload worker, interval_s:
10
I0513 07:32:52.722196   898 server.cpp:150] Begin reload framework...
W0513 07:32:52.722236   898 infer.h:659] Succ reload version engine: 18446744073
709551615
I0513 07:32:52.722630   898 manager.h:131] Finish reload 1 workflow(s)
W0513 07:32:52.728175   905 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.728358   905 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.728413   905 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.728462   905 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.734341   905 infer.h:510] td_core[0x7f25fc004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.734441   905 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.734462   905 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.734483   905 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25fc0abc90
W0513 07:32:52.734560   906 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.734585   906 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.734623   906 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.734668   906 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.745218   906 infer.h:510] td_core[0x7f25f0004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.745398   906 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.745419   906 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.745440   906 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25f00abc90
W0513 07:32:52.745533   907 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.745558   907 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.745595   907 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.745640   907 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
I0513 07:32:52.751658   896 server.cpp:1037] Server[baidu::paddle_serving::predi
ctor::general_model::GeneralModelServiceImpl] is serving on port=9292.
W0513 07:32:52.756603   907 infer.h:510] td_core[0x7f25e8004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.756706   907 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.756726   907 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.756791   907 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25e80ab450
W0513 07:32:52.756888   904 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.756912   904 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.756951   904 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.756999   904 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
I0513 07:32:52.762444   896 server.cpp:1040] Check out http://74479173b0e3:9292
in web browser.
W0513 07:32:52.763550   904 infer.h:510] td_core[0x7f25dc004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.763729   904 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.763814   904 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.763945   904 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25dc0ab450
W0513 07:32:52.764032   908 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.764058   908 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.764104   908 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.764151   908 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.769788   908 infer.h:510] td_core[0x7f25d4004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.769904   908 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.769923   908 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.769944   908 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25d40ab450
W0513 07:32:52.770033   909 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.770057   909 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.770095   909 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.770237   909 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.776002   909 infer.h:510] td_core[0x7f25c8004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.776115   909 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.776139   909 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.776163   909 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25c80ab450
W0513 07:32:52.776228   903 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.776366   903 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.776459   903 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.776510   903 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.781024   903 infer.h:510] td_core[0x6d15830] clone model from pd_
core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.781127   903 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.781150   903 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.781174   903 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x686c1c0
W0513 07:32:52.781376   902 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.781483   902 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.781538   902 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.781589   902 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.790743   902 infer.h:510] td_core[0x7f25c8024870] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.790905   902 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.790930   902 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.790954   902 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25c816efb0
W0513 07:32:52.791028   901 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.791057   901 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.791098   901 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.791154   901 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.796718   901 infer.h:510] td_core[0x7f25d4025530] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.808945   901 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.809021   901 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.809048   901 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25d416f020
W0513 07:32:52.809128   900 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.809157   900 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.809199   900 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.809414   900 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.814954   900 infer.h:510] td_core[0x7f25dc0254e0] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.815058   900 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.815081   900 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.815107   900 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25dc16efb0
W0513 07:32:52.815178   899 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.815207   899 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.815248   899 memory.cpp:73] Succ thread initialize mempool wrappe
r
I0513 07:32:52.815373   899 analysis_predictor.cc:84] Profiler is deactivated, a
nd no profiling report will be generated.
W0513 07:32:52.820677   899 infer.h:510] td_core[0x7f25e80254d0] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.820834   899 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.820860   899 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
I0513 07:32:52.820886   899 resource.cpp:313] 0: Successfully thread initialized
 dynamic resource 0x7f25e816efb0
I0513 07:33:02.725986   898 server.cpp:150] Begin reload framework...
W0513 07:33:02.726189   898 infer.h:659] Succ reload version engine: 18446744073
709551615
I0513 07:33:02.726222   898 manager.h:131] Finish reload 1 workflow(s)
I0513 07:33:12.726313   898 server.cpp:150] Begin reload framework...
W0513 07:33:12.726452   898 infer.h:659] Succ reload version engine: 18446744073
709551615
I0513 07:33:12.726480   898 manager.h:131] Finish reload 1 workflow(s)
I0513 07:33:22.746150   898 server.cpp:150] Begin reload framework...
W0513 07:33:22.746281   898 infer.h:659] Succ reload version engine: 18446744073
709551615
I0513 07:33:22.746541   898 manager.h:131] Finish reload 1 workflow(s)
I0513 07:33:32.746665   898 server.cpp:150] Begin reload framework...
W0513 07:33:32.746795   898 infer.h:659] Succ reload version engine: 18446744073
709551615
I0513 07:33:32.746829   898 manager.h:131] Finish reload 1 workflow(s)

serving.WARNING的信息

[root@74479173b0e3 log]# cat serving.WARNING
Log file created at: 2020/05/13 07:32:43
Running on machine: 74479173b0e3
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0513 07:32:43.448406   896 resource.cpp:110] Successfully proc initialized memp
ool wrapper
W0513 07:32:52.716145   896 infer.h:473] Succ load common model[0x6511750], path
[bert_seq128_model/].
W0513 07:32:52.716892   896 infer.h:171] Succ load model_data_pathbert_seq128_mo
del/
W0513 07:32:52.716928   896 infer.h:606] Succ proc initialize version engine: 18
446744073709551615
W0513 07:32:52.716943   896 infer.h:580] Succ proc initialize engine: general_in
fer_0
W0513 07:32:52.716961   896 infer.h:785] Succ proc initialize engine: general_in
fer_0
W0513 07:32:52.717310   896 kv_manager.h:70] general_infer_0:
W0513 07:32:52.717334   896 kv_manager.h:72] Succ proc initialize kvmanager for
engine: general_infer_0
W0513 07:32:52.718839   896 service.cpp:49] Succ get merger: default for service
: GeneralModelService
W0513 07:32:52.722236   898 infer.h:659] Succ reload version engine: 18446744073
709551615
W0513 07:32:52.728175   905 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.728358   905 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.728413   905 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.734341   905 infer.h:510] td_core[0x7f25fc004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.734441   905 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.734462   905 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.734560   906 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.734585   906 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.734623   906 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.745218   906 infer.h:510] td_core[0x7f25f0004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.745398   906 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.745419   906 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.745533   907 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.745558   907 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.745595   907 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.756603   907 infer.h:510] td_core[0x7f25e8004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.756706   907 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.756726   907 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.756888   904 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.756912   904 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.756951   904 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.763550   904 infer.h:510] td_core[0x7f25dc004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.763729   904 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.763814   904 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.764032   908 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.764058   908 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.764104   908 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.769788   908 infer.h:510] td_core[0x7f25d4004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.769904   908 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.769923   908 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.770033   909 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.770057   909 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.770095   909 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.776002   909 infer.h:510] td_core[0x7f25c8004a00] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.776115   909 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.776139   909 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.776228   903 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.776366   903 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.776459   903 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.781024   903 infer.h:510] td_core[0x6d15830] clone model from pd_
core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.781127   903 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.781150   903 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.781376   902 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.781483   902 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.781538   902 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.790743   902 infer.h:510] td_core[0x7f25c8024870] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.790905   902 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.790930   902 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.791028   901 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.791057   901 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.791098   901 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.796718   901 infer.h:510] td_core[0x7f25d4025530] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.808945   901 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.809021   901 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.809128   900 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.809157   900 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.809199   900 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.814954   900 infer.h:510] td_core[0x7f25dc0254e0] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.815058   900 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.815081   900 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:32:52.815178   899 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.815207   899 resource.cpp:279] Successfully thread initialized me
mpool wrapper
W0513 07:32:52.815248   899 memory.cpp:73] Succ thread initialize mempool wrappe
r
W0513 07:32:52.820677   899 infer.h:510] td_core[0x7f25e80254d0] clone model fro
m pd_core[0x6511750] succ, cur_idx[0].
W0513 07:32:52.820834   899 infer.h:627] Succ thrd initialize version engine: 18
446744073709551615
W0513 07:32:52.820860   899 infer.h:796] Succ thrd initialize engine, name: gene
ral_infer_0
W0513 07:33:02.726189   898 infer.h:659] Succ reload version engine: 18446744073
709551615
W0513 07:33:12.726452   898 infer.h:659] Succ reload version engine: 18446744073
709551615
W0513 07:33:22.746281   898 infer.h:659] Succ reload version engine: 18446744073
709551615
W0513 07:33:32.746795   898 infer.h:659] Succ reload version engine: 18446744073
709551615

你好，我下午提供的信息是否正确。如果不正确，麻烦指正，我好及时提供有用的信息去处理这个问题。

serving.INFO和serving.WARN似乎没有什么有效信息，是否可以开两个窗口，一个开Server，另一个开Client，看看Server有什么输出到控制台？

开2个命令窗口，分别走RPC和HTTP，可以这么理解吗？还有一个疑问，我注意到readme文档里的server是gpu模式的脚本，我适当的修改或删除部分代码改为cpu模式的脚本，可以这样做吗？

开2个命令窗口，分别走RPC和HTTP，可以这么理解吗？

不是的，整个Serving分为Server端和Client端，可以使用PRC或者HTTP方式启动Server。以RPC方式为例（HTTP方式，Client端只需要能发送HTTP请求即可）：

Server端使用的是paddle-serving-server包，用来启动服务，对应命令是python -m paddle_serving_server.serve --model bert_seq128_model/ --port 9292；
Client端使用的是paddle-serving-client包，用来获取RPC服务，对应的是bert_client.py文件，命令为head data-c.txt | python bert_client.py --model bert_seq128_client/serving_client_conf.prototxt

建议测试下RPC方式。

我注意到readme文档里的server是gpu模式的脚本，我适当的修改或删除部分代码改为cpu模式的脚本，可以这样做吗？

可以的。

开2个命令窗口，分别走RPC和HTTP，可以这么理解吗？

不是的，整个Serving分为Server端和Client端，可以使用PRC或者HTTP方式启动Server。以RPC方式为例（HTTP方式，Client端只需要能发送HTTP请求即可）：

Server端使用的是paddle-serving-server包，用来启动服务，对应命令是python -m paddle_serving_server.serve --model bert_seq128_model/ --port 9292；

Client端使用的是paddle-serving-client包，用来获取RPC服务，对应的是bert_client.py文件，命令为head data-c.txt | python bert_client.py --model bert_seq128_client/serving_client_conf.prototxt

建议测试下RPC方式。

我注意到readme文档里的server是gpu模式的脚本，我适当的修改或删除部分代码改为cpu模式的脚本，可以这样做吗？

可以的。

好的，明白了。明天上班发过去。

server端信息：

[root@74479173b0e3 project_bert]# python -m paddle_serving_server.serve --model
bert_seq128_model/ --port 9292
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openbla
s-0.2.1/serving -enable_model_toolkit -inferservice_path workdir -inferservice_f
ile infer_service.prototxt -max_concurrency 0 -num_threads 10 -port 9292 -reload
_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow
_path workdir -workflow_file workflow.prototxt -bthread_concurrency 10 -max_body
_size 536870912
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralText
ResponseOp
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralText
ReaderOp
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralInfe
rOp
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralDist
KVQuantInferOp
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralDist
KVInferOp
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralRead
erOp
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralCopy
Op
I0100 00:00:00.000000    54 op_repository.h:65] RAW: Succ regist op: GeneralResp
onseOp
I0100 00:00:00.000000    54 service_manager.h:61] RAW: Service[LoadGeneralModelS
ervice] insert successfully!
I0100 00:00:00.000000    54 load_general_model_service.pb.h:299] RAW: Success re
gist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_g
eneral_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000    54 service_manager.h:61] RAW: Service[GeneralModelServi
ce] insert successfully!
I0100 00:00:00.000000    54 general_model_service.pb.h:1473] RAW: Success regist
 service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model2
3GeneralModelServiceImplE]
I0100 00:00:00.000000    54 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    54 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::bai
du::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000    54 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    54 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->:
:baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in m
acro!
I0100 00:00:00.000000    54 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11Infer
EngineE
W0100 00:00:00.000000    54 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigm
oidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYS
IS_DIR_SIGMOID in macro!
I0100 00:00:00.000000    54 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    54 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu
::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000    54 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    54 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::ba
idu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000    54 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEn
gineE
W0100 00:00:00.000000    54 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoi
dCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_D
IR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running IR pass [simplify_with_basic_ops_pass]
--- Running IR pass [attention_lstm_fuse_pass]
--- Running IR pass [seqconv_eltadd_relu_fuse_pass]
--- Running IR pass [seqpool_cvm_concat_fuse_pass]
--- Running IR pass [fc_lstm_fuse_pass]
--- Running IR pass [mul_lstm_fuse_pass]
--- Running IR pass [fc_gru_fuse_pass]
--- Running IR pass [mul_gru_fuse_pass]
--- Running IR pass [seq_concat_fc_fuse_pass]
--- Running IR pass [fc_fuse_pass]
--- Running IR pass [repeated_fc_relu_fuse_pass]
--- Running IR pass [squared_mat_sub_fuse_pass]
--- Running IR pass [conv_bn_fuse_pass]
--- Running IR pass [conv_eltwiseadd_bn_fuse_pass]
--- Running IR pass [conv_transpose_bn_fuse_pass]
--- Running IR pass [conv_transpose_eltwiseadd_bn_fuse_pass]
--- Running IR pass [is_test_pass]
--- Running IR pass [runtime_context_cache_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

client端信息：

[root@74479173b0e3 project_bert]# head data-c.txt | python bert_client.py --mode
l bert_seq128_client/serving_client_conf.prototxt
**重复的信息太多，屏幕只能显示出这些**
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shap
e: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 1962 int64_data: 80
24 int64_data: 1456 int64_data: 6887 int64_data: 679 int64_data: 7231 int64_data
: 8024 int64_data: 1114 int64_data: 3198 int64_data: 6843 int64_data: 6809 int64
_data: 511 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "po
oled_output"
W0514 03:28:09.625357    87 stub_impl.hpp:136] Already thread initialized for st
ub
W0514 03:28:09.627621    87 predictor.hpp:129] inference call failed, message: [
E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list
://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:92
92 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0514 03:28:09.629330    87 general_model.cpp:245] failed call predictor with re
q: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 floa
t_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1
float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data
: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_
data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data:
14 int64_data: 15 int64_data: 16 int64_data: 17 int64_data: 18 int64_data: 19 in
t64_data: 20 int64_data: 21 int64_data: 22 int64_data: 23 int64_data: 24 int64_d
ata: 25 int64_data: 26 int64_data: 27 int64_data: 28 int64_data: 29 int64_data:
30 int64_data: 31 int64_data: 32 int64_data: 33 int64_data: 34 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_dat
a: 7623 int64_data: 6843 int64_data: 1168 int64_data: 7305 int64_data: 7305 int6
4_data: 1366 int64_data: 8024 int64_data: 2578 int64_data: 2428 int64_data: 2523
 int64_data: 1962 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_data:
 2523 int64_data: 3472 int64_data: 1318 int64_data: 7660 int64_data: 4500 int64_
data: 7234 int64_data: 5291 int64_data: 1259 int64_data: 4708 int64_data: 8024 i
nt64_data: 1456 int64_data: 6887 int64_data: 2523 int64_data: 3472 int64_data: 8
024 int64_data: 722 int64_data: 1400 int64_data: 6820 int64_data: 833 int64_data
: 743 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_nam
es: "pooled_output"
W0514 03:28:09.634766    87 stub_impl.hpp:136] Already thread initialized for st
ub
I0514 03:28:09.636576   112 socket.cpp:2370] Checking SocketId=0@127.0.0.1:9292
W0514 03:28:09.637763    87 predictor.hpp:129] inference call failed, message: [
E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list
://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:92
92 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0514 03:28:09.638770    87 general_model.cpp:245] failed call predictor with re
q: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shap
e: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 2923 int64_data: 19
62 int64_data: 4638 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_dat
a: 4384 int64_data: 924 int64_data: 1348 int64_data: 3300 int64_data: 1501 int64
_data: 511 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "po
oled_output"

命令上没有问题，似乎是Client没有成功连接到Server。

猜想会不会是网络配置问题？前面提到

uci_housing模型可以正常HTTP和RPC预测

bert的操作与测试uci_housing是一致的吗？

我先把HTTP的发一下，uci_housing的随后发过来： server端：

[root@74479173b0e3 project_bert]# python bert_web_service.py bert_seq128_model/
9292
web service address:
http://172.17.0.2:9292/bert/prediction
 * Serving Flask app "paddle_serving_server.web_service" (lazy loading)
 * Environment: production
   WARNING: This is a development server. Do not use it in a production deployme
nt.
   Use a production WSGI server instead.
 * Debug mode: off
 * Running on http://0.0.0.0:9292/ (Press CTRL+C to quit)
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openbla
s-0.2.1/serving -enable_model_toolkit -inferservice_path workdir -inferservice_f
ile infer_service.prototxt -max_concurrency 0 -num_threads 16 -port 12000 -reloa
d_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflo
w_path workdir -workflow_file workflow.prototxt -bthread_concurrency 16 -max_bod
y_size 67108864
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralText
ResponseOp
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralText
ReaderOp
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralInfe
rOp
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralDist
KVQuantInferOp
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralDist
KVInferOp
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralRead
erOp
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralCopy
Op
I0100 00:00:00.000000   137 op_repository.h:65] RAW: Succ regist op: GeneralResp
onseOp
I0100 00:00:00.000000   137 service_manager.h:61] RAW: Service[LoadGeneralModelS
ervice] insert successfully!
I0100 00:00:00.000000   137 load_general_model_service.pb.h:299] RAW: Success re
gist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_g
eneral_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000   137 service_manager.h:61] RAW: Service[GeneralModelServi
ce] insert successfully!
I0100 00:00:00.000000   137 general_model_service.pb.h:1473] RAW: Success regist
 service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model2
3GeneralModelServiceImplE]
I0100 00:00:00.000000   137 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   137 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::bai
du::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000   137 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   137 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->:
:baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in m
acro!
I0100 00:00:00.000000   137 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11Infer
EngineE
W0100 00:00:00.000000   137 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigm
oidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYS
IS_DIR_SIGMOID in macro!
I0100 00:00:00.000000   137 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   137 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu
::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000   137 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   137 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::ba
idu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000   137 factory.h:121] RAW: Succ insert one factory, tag: FL
UID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEn
gineE
W0100 00:00:00.000000   137 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: :
:baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoi
dCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_D
IR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running IR pass [simplify_with_basic_ops_pass]
--- Running IR pass [attention_lstm_fuse_pass]
--- Running IR pass [seqconv_eltadd_relu_fuse_pass]
--- Running IR pass [seqpool_cvm_concat_fuse_pass]
--- Running IR pass [fc_lstm_fuse_pass]
--- Running IR pass [mul_lstm_fuse_pass]
--- Running IR pass [fc_gru_fuse_pass]
--- Running IR pass [mul_gru_fuse_pass]
--- Running IR pass [seq_concat_fc_fuse_pass]
--- Running IR pass [fc_fuse_pass]
--- Running IR pass [repeated_fc_relu_fuse_pass]
--- Running IR pass [squared_mat_sub_fuse_pass]
--- Running IR pass [conv_bn_fuse_pass]
--- Running IR pass [conv_eltwiseadd_bn_fuse_pass]
--- Running IR pass [conv_transpose_bn_fuse_pass]
--- Running IR pass [conv_transpose_eltwiseadd_bn_fuse_pass]
--- Running IR pass [is_test_pass]
--- Running IR pass [runtime_context_cache_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

client端，此时是在另一个cmd窗口输入的指令：

[root@74479173b0e3 project_bert]# curl -H "Content-Type:application/json" -X POST -d '{"feed":[{"words": "hello"}], "fetch":["pooled_output"]}' http://0.0.0.0:9292/bert/prediction
{"result":"Request Value Error"}

随后在server端显示如下信息：

WARNING: Logging before InitGoogleLogging() is written to STDERR
E0514 05:50:36.113992   172 config_manager.cpp:217] Not found key in configue: c
luster
E0514 05:50:36.115360   172 config_manager.cpp:234] Not found key in configue: s
plit_tag_name
E0514 05:50:36.116163   172 config_manager.cpp:235] Not found key in configue: t
ag_candidates
E0514 05:50:36.117307   172 config_manager.cpp:202] Not found key in configue: c
onnect_timeout_ms
E0514 05:50:36.117904   172 config_manager.cpp:203] Not found key in configue: r
pc_timeout_ms
E0514 05:50:36.118444   172 config_manager.cpp:205] Not found key in configue: h
edge_request_timeout_ms
E0514 05:50:36.120609   172 config_manager.cpp:207] Not found key in configue: c
onnect_retry_count
E0514 05:50:36.122220   172 config_manager.cpp:209] Not found key in configue: h
edge_fetch_retry_count
E0514 05:50:36.122902   172 config_manager.cpp:211] Not found key in configue: m
ax_connection_per_host
E0514 05:50:36.125314   172 config_manager.cpp:212] Not found key in configue: c
onnection_type
E0514 05:50:36.127590   172 config_manager.cpp:219] Not found key in configue: l
oad_balance_strategy
E0514 05:50:36.128018   172 config_manager.cpp:221] Not found key in configue: c
luster_filter_strategy
E0514 05:50:36.128160   172 config_manager.cpp:226] Not found key in configue: p
rotocol
E0514 05:50:36.129156   172 config_manager.cpp:227] Not found key in configue: c
ompress_type
E0514 05:50:36.132169   172 config_manager.cpp:228] Not found key in configue: p
ackage_size
E0514 05:50:36.133106   172 config_manager.cpp:230] Not found key in configue: m
ax_channel_per_request
E0514 05:50:36.134562   172 config_manager.cpp:234] Not found key in configue: s
plit_tag_name
E0514 05:50:36.136922   172 config_manager.cpp:235] Not found key in configue: t
ag_candidates
I0514 05:50:36.187589   172 naming_service_thread.cpp:209] brpc::policy::ListNam
ingService("0.0.0.0:12000"): added 1
127.0.0.1 - - [14/May/2020 05:50:36] "POST /bert/prediction HTTP/1.1" 200 -

Serving的HTTP实现是基于RPC的，所以我们可以暂时先看RPC的问题

这是uci_housing模型测试的信息。 HTTP方式的server端信息：

[root@74479173b0e3 project_uci_housing]# python -m paddle_serving_server.serve --model uci_housing_model --thread 4 --port 9292 --name uci
web service address:
http://172.17.0.2:9292/uci/prediction
 * Serving Flask app "serve" (lazy loading)
 * Environment: production
   WARNING: This is a development server. Do not use it in a production deployment.
   Use a production WSGI server instead.
 * Debug mode: off
 * Running on http://0.0.0.0:9292/ (Press CTRL+C to quit)
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.1/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 16 -port 12000 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 16 -max_body_size 67108864
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000   156 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000   156 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000   156 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000   156 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000   156 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000   156 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   156 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000   156 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   156 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000   156 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   156 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000   156 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   156 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000   156 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   156 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000   156 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   156 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running IR pass [simplify_with_basic_ops_pass]
--- Running IR pass [attention_lstm_fuse_pass]
--- Running IR pass [seqconv_eltadd_relu_fuse_pass]
--- Running IR pass [seqpool_cvm_concat_fuse_pass]
--- Running IR pass [fc_lstm_fuse_pass]
--- Running IR pass [mul_lstm_fuse_pass]
--- Running IR pass [fc_gru_fuse_pass]
--- Running IR pass [mul_gru_fuse_pass]
--- Running IR pass [seq_concat_fc_fuse_pass]
--- Running IR pass [fc_fuse_pass]
--- Running IR pass [repeated_fc_relu_fuse_pass]
--- Running IR pass [squared_mat_sub_fuse_pass]
--- Running IR pass [conv_bn_fuse_pass]
--- Running IR pass [conv_eltwiseadd_bn_fuse_pass]
--- Running IR pass [conv_transpose_bn_fuse_pass]
--- Running IR pass [conv_transpose_eltwiseadd_bn_fuse_pass]
--- Running IR pass [is_test_pass]
--- Running IR pass [runtime_context_cache_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

HTTP方式的client端的信息（另一个cmd窗口输入命令）：

[root@74479173b0e3 project_uci_housing]# curl -H "Content-Type:application/json"
 -X POST -d '{"feed":[{"x": [0.0137, -0.1136, 0.2553, -0.0692, 0.0582, -0.0727,
-0.1583, -0.0584, 0.6283, 0.4919, 0.1856, 0.0795, -0.0332]}], "fetch":["price"]}
' http://0.0.0.0:9292/uci/prediction
{"result":{"price":[[18.901151657104492]]}}

随后HTTP方式的server端出现如下信息：

WARNING: Logging before InitGoogleLogging() is written to STDERR
E0514 06:20:41.139304   177 config_manager.cpp:217] Not found key in configue: cluster
E0514 06:20:41.142256   177 config_manager.cpp:234] Not found key in configue: split_tag_name
E0514 06:20:41.143733   177 config_manager.cpp:235] Not found key in configue: tag_candidates
E0514 06:20:41.144699   177 config_manager.cpp:202] Not found key in configue: connect_timeout_ms
E0514 06:20:41.145424   177 config_manager.cpp:203] Not found key in configue: rpc_timeout_ms
E0514 06:20:41.145689   177 config_manager.cpp:205] Not found key in configue: hedge_request_timeout_ms
E0514 06:20:41.146451   177 config_manager.cpp:207] Not found key in configue: connect_retry_count
E0514 06:20:41.146996   177 config_manager.cpp:209] Not found key in configue: hedge_fetch_retry_count
E0514 06:20:41.147683   177 config_manager.cpp:211] Not found key in configue: max_connection_per_host
E0514 06:20:41.148910   177 config_manager.cpp:212] Not found key in configue: connection_type
E0514 06:20:41.149502   177 config_manager.cpp:219] Not found key in configue: load_balance_strategy
E0514 06:20:41.150950   177 config_manager.cpp:221] Not found key in configue: cluster_filter_strategy
E0514 06:20:41.151302   177 config_manager.cpp:226] Not found key in configue: protocol
E0514 06:20:41.151638   177 config_manager.cpp:227] Not found key in configue: compress_type
E0514 06:20:41.151981   177 config_manager.cpp:228] Not found key in configue: package_size
E0514 06:20:41.152410   177 config_manager.cpp:230] Not found key in configue: max_channel_per_request
E0514 06:20:41.153069   177 config_manager.cpp:234] Not found key in configue: split_tag_name
E0514 06:20:41.153656   177 config_manager.cpp:235] Not found key in configue: tag_candidates
I0514 06:20:41.160951   177 naming_service_thread.cpp:209] brpc::policy::ListNamingService("0.0.0.0:12000"): added 1
127.0.0.1 - - [14/May/2020 06:20:41] "POST /uci/prediction HTTP/1.1" 200 -

RPC方式的server端信息：

[root@74479173b0e3 project_uci_housing]# python -m paddle_serving_server.serve --model uci_housing_model --thread 4 --port 9292
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.1/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 4 -port 9292 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 4 -max_body_size 536870912
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000   233 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000   233 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000   233 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000   233 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000   233 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000   233 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   233 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000   233 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   233 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000   233 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   233 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000   233 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   233 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000   233 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   233 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000   233 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000   233 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running IR pass [simplify_with_basic_ops_pass]
--- Running IR pass [attention_lstm_fuse_pass]
--- Running IR pass [seqconv_eltadd_relu_fuse_pass]
--- Running IR pass [seqpool_cvm_concat_fuse_pass]
--- Running IR pass [fc_lstm_fuse_pass]
--- Running IR pass [mul_lstm_fuse_pass]
--- Running IR pass [fc_gru_fuse_pass]
--- Running IR pass [mul_gru_fuse_pass]
--- Running IR pass [seq_concat_fc_fuse_pass]
--- Running IR pass [fc_fuse_pass]
--- Running IR pass [repeated_fc_relu_fuse_pass]
--- Running IR pass [squared_mat_sub_fuse_pass]
--- Running IR pass [conv_bn_fuse_pass]
--- Running IR pass [conv_eltwiseadd_bn_fuse_pass]
--- Running IR pass [conv_transpose_bn_fuse_pass]
--- Running IR pass [conv_transpose_eltwiseadd_bn_fuse_pass]
--- Running IR pass [is_test_pass]
--- Running IR pass [runtime_context_cache_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

RPC方式的client端信息：

[root@74479173b0e3 project_uci_housing]# python uci_housing_client.py
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0514 06:29:52.656567   241 config_manager.cpp:217] Not found key in configue: c
luster
E0514 06:29:52.659443   241 config_manager.cpp:234] Not found key in configue: s
plit_tag_name
E0514 06:29:52.660214   241 config_manager.cpp:235] Not found key in configue: t
ag_candidates
E0514 06:29:52.660782   241 config_manager.cpp:202] Not found key in configue: c
onnect_timeout_ms
E0514 06:29:52.661767   241 config_manager.cpp:203] Not found key in configue: r
pc_timeout_ms
E0514 06:29:52.662431   241 config_manager.cpp:205] Not found key in configue: h
edge_request_timeout_ms
E0514 06:29:52.662936   241 config_manager.cpp:207] Not found key in configue: c
onnect_retry_count
E0514 06:29:52.663599   241 config_manager.cpp:209] Not found key in configue: h
edge_fetch_retry_count
E0514 06:29:52.664764   241 config_manager.cpp:211] Not found key in configue: m
ax_connection_per_host
E0514 06:29:52.665154   241 config_manager.cpp:212] Not found key in configue: c
onnection_type
E0514 06:29:52.666313   241 config_manager.cpp:219] Not found key in configue: l
oad_balance_strategy
E0514 06:29:52.666756   241 config_manager.cpp:221] Not found key in configue: c
luster_filter_strategy
E0514 06:29:52.667333   241 config_manager.cpp:226] Not found key in configue: p
rotocol
E0514 06:29:52.668470   241 config_manager.cpp:227] Not found key in configue: c
ompress_type
E0514 06:29:52.669553   241 config_manager.cpp:228] Not found key in configue: p
ackage_size
E0514 06:29:52.671277   241 config_manager.cpp:230] Not found key in configue: m
ax_channel_per_request
E0514 06:29:52.671941   241 config_manager.cpp:234] Not found key in configue: s
plit_tag_name
E0514 06:29:52.672369   241 config_manager.cpp:235] Not found key in configue: t
ag_candidates
I0514 06:29:52.689071   241 naming_service_thread.cpp:209] brpc::policy::ListNam
ingService("127.0.0.1:9292"): added 1
{'price': array([[18.901152]], dtype=float32)}

uci_housing模型的测试是正常的可以打印出一致的价格出来。

随后又测了一次bert。 server端信息：

[root@74479173b0e3 project_bert]# python -m paddle_serving_server.serve --model bert_seq128_model/ --port 9292
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.1/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 10 -port 9292 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 10 -max_body_size 536870912
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000    64 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000    64 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000    64 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000    64 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000    64 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000    64 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    64 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000    64 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    64 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000    64 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    64 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000    64 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    64 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000    64 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    64 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000    64 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    64 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running IR pass [simplify_with_basic_ops_pass]
--- Running IR pass [attention_lstm_fuse_pass]
--- Running IR pass [seqconv_eltadd_relu_fuse_pass]
--- Running IR pass [seqpool_cvm_concat_fuse_pass]
--- Running IR pass [fc_lstm_fuse_pass]
--- Running IR pass [mul_lstm_fuse_pass]
--- Running IR pass [fc_gru_fuse_pass]
--- Running IR pass [mul_gru_fuse_pass]
--- Running IR pass [seq_concat_fc_fuse_pass]
--- Running IR pass [fc_fuse_pass]
--- Running IR pass [repeated_fc_relu_fuse_pass]
--- Running IR pass [squared_mat_sub_fuse_pass]
--- Running IR pass [conv_bn_fuse_pass]
--- Running IR pass [conv_eltwiseadd_bn_fuse_pass]
--- Running IR pass [conv_transpose_bn_fuse_pass]
--- Running IR pass [conv_transpose_eltwiseadd_bn_fuse_pass]
--- Running IR pass [is_test_pass]
--- Running IR pass [runtime_context_cache_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

client端信息：

[root@74479173b0e3 project_bert]# head data-c.txt | python bert_client.py --mode
l bert_seq128_client/serving_client_conf.prototxt
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0514 06:59:52.767055    79 config_manager.cpp:217] Not found key in configue: c
luster
E0514 06:59:52.768278    79 config_manager.cpp:234] Not found key in configue: s
plit_tag_name
E0514 06:59:52.768699    79 config_manager.cpp:235] Not found key in configue: t
ag_candidates
E0514 06:59:52.769083    79 config_manager.cpp:202] Not found key in configue: c
onnect_timeout_ms
E0514 06:59:52.769448    79 config_manager.cpp:203] Not found key in configue: r
pc_timeout_ms
E0514 06:59:52.769881    79 config_manager.cpp:205] Not found key in configue: h
edge_request_timeout_ms
E0514 06:59:52.770282    79 config_manager.cpp:207] Not found key in configue: c
onnect_retry_count
E0514 06:59:52.770642    79 config_manager.cpp:209] Not found key in configue: h
edge_fetch_retry_count
E0514 06:59:52.771828    79 config_manager.cpp:211] Not found key in configue: m
ax_connection_per_host
E0514 06:59:52.772544    79 config_manager.cpp:212] Not found key in configue: c
onnection_type
E0514 06:59:52.773105    79 config_manager.cpp:219] Not found key in configue: l
oad_balance_strategy
E0514 06:59:52.773519    79 config_manager.cpp:221] Not found key in configue: c
luster_filter_strategy
E0514 06:59:52.773900    79 config_manager.cpp:226] Not found key in configue: p
rotocol
E0514 06:59:52.774366    79 config_manager.cpp:227] Not found key in configue: c
ompress_type
E0514 06:59:52.775128    79 config_manager.cpp:228] Not found key in configue: p
ackage_size
E0514 06:59:52.775825    79 config_manager.cpp:230] Not found key in configue: m
ax_channel_per_request
E0514 06:59:52.775971    79 config_manager.cpp:234] Not found key in configue: s
plit_tag_name
E0514 06:59:52.776662    79 config_manager.cpp:235] Not found key in configue: t
ag_candidates
I0514 06:59:52.838665    79 naming_service_thread.cpp:209] brpc::policy::ListNam
ingService("127.0.0.1:9292"): added 1
W0514 06:59:54.044497    97 init.cc:209] Warning: PaddlePaddle catches a failure
 signal, it may not work properly
W0514 06:59:54.047056    97 init.cc:211] You could check whether you killed Padd
lePaddle thread/process accidentally or report the case to PaddlePaddle
W0514 06:59:54.048082    97 init.cc:214] The detail failure signal is:

W0514 06:59:54.051225    97 init.cc:217] *** Aborted at 1589439593 (unix time) t
ry "date -d @1589439593" if you are using GNU date ***
W0514 06:59:54.188490    97 init.cc:217] PC: @                0x0 (unknown)
W0514 06:59:54.205145    97 init.cc:217] *** SIGILL (@0x7fda91b2db4e) received b
y PID 79 (TID 0x7fda8bfff700) from PID 18446744071859002190; stack trace: ***
W0514 06:59:54.211547    97 init.cc:217]     @     0x7fdac17225f0 (unknown)
W0514 06:59:54.221117    97 init.cc:217]     @     0x7fda91b2db4e brpc::Socket::
SharedPart::UpdateStatsEverySecond()
W0514 06:59:54.223759    97 init.cc:217]     @     0x7fda91af1199 brpc::GlobalUp
date()
W0514 06:59:54.232777    97 init.cc:217]     @     0x7fda91c11c4f bthread::TaskG
roup::task_runner()
W0514 06:59:54.236673    97 init.cc:217]     @     0x7fda91c22971 bthread_make_f
context
Illegal instruction (core dumped)

你好，请试用一下最新版本的client和server，看是否还有这个问题 client安装包 https://paddle-serving.bj.bcebos.com/whl/paddle_serving_client-0.2.2-cp27-none-linux_x86_64.whl cpu server安装包 https://paddle-serving.bj.bcebos.com/whl/paddle_serving_server-0.2.2-py2-none-any.whl

你好，请试用一下最新版本的client和server，看是否还有这个问题 client安装包 https://paddle-serving.bj.bcebos.com/whl/paddle_serving_client-0.2.2-cp27-none-linux_x86_64.whl cpu server安装包 https://paddle-serving.bj.bcebos.com/whl/paddle_serving_server-0.2.2-py2-none-any.whl

好的，我安装最新版试一下。

你好，我已经安装了最新版本的client和server。随后首先对uci_housing模型进行了测试，HTTP和RPC都正常，可以打印出price。对bert模型进行测试时，出现以下信息。 HTTP方式的server端信息：

[root@74479173b0e3 project_bert]# python bert_web_service.py bert_seq128_model/ 9292
web service address:
http://172.17.0.2:9292/bert/prediction
 * Serving Flask app "paddle_serving_server.web_service" (lazy loading)
 * Environment: production
   WARNING: This is a development server. Do not use it in a production deployment.
   Use a production WSGI server instead.
 * Debug mode: off
 * Running on http://0.0.0.0:9292/ (Press CTRL+C to quit)
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.2/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 16 -port 12000 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 16 -max_body_size 67108864
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000    52 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000    52 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000    52 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000    52 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

HTTP方式的client端信息（另一个cmd窗口执行命令）：

[root@74479173b0e3 project_bert]# curl -H "Content-Type:application/json" -X POS
T -d '{"feed":[{"words": "hello"}], "fetch":["pooled_output"]}' http://0.0.0.0:9
292/bert/prediction
{"result":"Request Value Error"}

随后HTTP方式的server端信息：

WARNING: Logging before InitGoogleLogging() is written to STDERR
I0514 07:47:15.769819    73 naming_service_thread.cpp:209] brpc::policy::ListNamingService("0.0.0.0:12000"): added 1
127.0.0.1 - - [14/May/2020 07:47:15] "POST /bert/prediction HTTP/1.1" 200 -

RPC方式的server端信息：

[root@74479173b0e3 project_bert]# python -m paddle_serving_server.serve --model bert_seq128_model/ --port 9292
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.2/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 10 -port 9292 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 10 -max_body_size 536870912
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000    51 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000    51 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000    51 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000    51 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000    51 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000    51 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    51 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000    51 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    51 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000    51 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    51 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000    51 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    51 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000    51 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    51 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000    51 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    51 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

RPC方式的client端信息（另一个cmd窗口执行命令）：

[root@74479173b0e3 project_bert]# head data-c.txt | python bert_client.py --mode
l bert_seq128_client/serving_client_conf.prototxt
**重复的信息太多，屏幕只能显示出这些**
E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list
://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:92
92 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0514 08:01:11.673215    66 general_model.cpp:246] failed call predictor with re
q: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shap
e: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 1962 int64_data: 80
24 int64_data: 1456 int64_data: 6887 int64_data: 679 int64_data: 7231 int64_data
: 8024 int64_data: 1114 int64_data: 3198 int64_data: 6843 int64_data: 6809 int64
_data: 511 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "po
oled_output"
W0514 08:01:11.675367    66 predictor.hpp:129] inference call failed, message: [
E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list
://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:92
92 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0514 08:01:11.675837    66 general_model.cpp:246] failed call predictor with re
q: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 floa
t_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1
float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data
: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_
data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data:
14 int64_data: 15 int64_data: 16 int64_data: 17 int64_data: 18 int64_data: 19 in
t64_data: 20 int64_data: 21 int64_data: 22 int64_data: 23 int64_data: 24 int64_d
ata: 25 int64_data: 26 int64_data: 27 int64_data: 28 int64_data: 29 int64_data:
30 int64_data: 31 int64_data: 32 int64_data: 33 int64_data: 34 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_dat
a: 7623 int64_data: 6843 int64_data: 1168 int64_data: 7305 int64_data: 7305 int6
4_data: 1366 int64_data: 8024 int64_data: 2578 int64_data: 2428 int64_data: 2523
 int64_data: 1962 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_data:
 2523 int64_data: 3472 int64_data: 1318 int64_data: 7660 int64_data: 4500 int64_
data: 7234 int64_data: 5291 int64_data: 1259 int64_data: 4708 int64_data: 8024 i
nt64_data: 1456 int64_data: 6887 int64_data: 2523 int64_data: 3472 int64_data: 8
024 int64_data: 722 int64_data: 1400 int64_data: 6820 int64_data: 833 int64_data
: 743 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_nam
es: "pooled_output"
W0514 08:01:11.682314    66 predictor.hpp:129] inference call failed, message: [
E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list
://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:92
92 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0514 08:01:11.682747    66 general_model.cpp:246] failed call predictor with re
q: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shap
e: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 2923 int64_data: 19
62 int64_data: 4638 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_dat
a: 4384 int64_data: 924 int64_data: 1348 int64_data: 3300 int64_data: 1501 int64
_data: 511 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "po
oled_output"
I0514 08:01:11.754920    88 socket.cpp:2370] Checking SocketId=0@127.0.0.1:9292

server端应该有个log/serving.INFO，里面有没有报错信息

你好，这是昨天最后一次进行RPC之后的log/serving.INFO信息（到发这条消息时没有进行其他的服务启动的操作）。

[root@74479173b0e3 project_bert]# cd log
[root@74479173b0e3 log]# ls -l
total 200
-rw-r--r-- 1 root root 15127 May 13 07:33 serving.74479173b0e3.invalid-user.log.INFO.20200513-073243.896
-rw-r--r-- 1 root root 15127 May 14 03:19 serving.74479173b0e3.invalid-user.log.INFO.20200514-031814.54
-rw-r--r-- 1 root root 19937 May 14 04:01 serving.74479173b0e3.invalid-user.log.INFO.20200514-040058.137
-rw-r--r-- 1 root root 19706 May 14 06:52 serving.74479173b0e3.invalid-user.log.INFO.20200514-065136.361
-rw-r--r-- 1 root root 15395 May 14 06:59 serving.74479173b0e3.invalid-user.log.INFO.20200514-065913.64
-rw-r--r-- 1 root root 20217 May 14 07:47 serving.74479173b0e3.invalid-user.log.INFO.20200514-074655.52
-rw-r--r-- 1 root root 15407 May 14 08:00 serving.74479173b0e3.invalid-user.log.INFO.20200514-075938.51
-rw-r--r-- 1 root root  7654 May 13 07:33 serving.74479173b0e3.invalid-user.log.WARNING.20200513-073243.896
-rw-r--r-- 1 root root  7654 May 14 03:19 serving.74479173b0e3.invalid-user.log.WARNING.20200514-031814.54
-rw-r--r-- 1 root root 11057 May 14 04:01 serving.74479173b0e3.invalid-user.log.WARNING.20200514-040058.137
-rw-r--r-- 1 root root 10967 May 14 06:52 serving.74479173b0e3.invalid-user.log.WARNING.20200514-065136.361
-rw-r--r-- 1 root root  7564 May 14 06:59 serving.74479173b0e3.invalid-user.log.WARNING.20200514-065913.64
-rw-r--r-- 1 root root 11147 May 14 07:47 serving.74479173b0e3.invalid-user.log.WARNING.20200514-074655.52
-rw-r--r-- 1 root root  7744 May 14 08:00 serving.74479173b0e3.invalid-user.log.WARNING.20200514-075938.51
lrwxrwxrwx 1 root root    61 May 14 07:59 serving.INFO -> serving.74479173b0e3.invalid-user.log.INFO.20200514-075938.51
lrwxrwxrwx 1 root root    64 May 14 07:59 serving.WARNING -> serving.74479173b0e3.invalid-user.log.WARNING.20200514-075938.51
[root@74479173b0e3 log]# cat serving.INFO
Log file created at: 2020/05/14 07:59:38
Running on machine: 74479173b0e3
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0514 07:59:38.813650    51 resource.cpp:110] Successfully proc initialized mempool wrapper
I0514 07:59:38.814407    51 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0514 07:59:38.814450    51 infer.h:74] InferEngineCreationParams: model_path = bert_seq128_model/, enable_memory_optimization = 0, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0514 07:59:38.814563    51 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0514 07:59:38.847803    51 analysis_predictor.cc:833] MODEL VERSION: 1.7.2
I0514 07:59:38.847915    51 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0514 07:59:38.848754    51 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0514 07:59:45.465029    51 analysis_predictor.cc:462] ======= optimize end =======
W0514 07:59:45.538545    51 infer.h:487] Succ load common model[0x6c79830], path[bert_seq128_model/].
W0514 07:59:45.599220    51 infer.h:185] Succ load model_data_pathbert_seq128_model/
W0514 07:59:45.599253    51 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0514 07:59:45.599269    51 infer.h:594] Succ proc initialize engine: general_infer_0
W0514 07:59:45.599287    51 infer.h:799] Succ proc initialize engine: general_infer_0
W0514 07:59:45.599731    51 kv_manager.h:70] general_infer_0:
W0514 07:59:45.599758    51 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0514 07:59:45.600956    51 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0514 07:59:45.601070    51 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0514 07:59:45.601080    51 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0514 07:59:45.601210    51 dag.cpp:158] DAG: workflow1
I0514 07:59:45.601230    51 dag.cpp:159] , Op Num: 3
I0514 07:59:45.601240    51 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0514 07:59:45.601250    51 dag.cpp:164]  depends: 0
I0514 07:59:45.601259    51 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0514 07:59:45.601269    51 dag.cpp:164]  depends: 1
I0514 07:59:45.601279    51 dag.cpp:168]  general_reader_0 0
I0514 07:59:45.601289    51 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0514 07:59:45.601298    51 dag.cpp:164]  depends: 1
I0514 07:59:45.601307    51 dag.cpp:168]  general_infer_0 0
I0514 07:59:45.601317    51 dag.cpp:171]
I0514 07:59:45.601330    51 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0514 07:59:45.602025    51 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0514 07:59:45.612027    51 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0514 07:59:45.612223    51 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0514 07:59:45.628476    51 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0514 07:59:45.628574    51 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0514 07:59:45.628873    51 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0514 07:59:45.628962    51 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0514 07:59:45.629016    51 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0514 07:59:45.629034    51 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0514 07:59:45.629073    51 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0514 07:59:45.629086    51 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0514 07:59:45.629241    51 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0514 07:59:45.629477    51 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0514 07:59:45.629537    51 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0514 07:59:45.629663    51 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0514 07:59:45.629721    51 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0514 07:59:45.629742    51 service.cpp:126] Succ load infer_service: GeneralModelService!
I0514 07:59:45.629762    51 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0514 07:59:45.673197    53 server.cpp:147] Entrence reload worker, interval_s: 10
I0514 07:59:45.673326    53 server.cpp:150] Begin reload framework...
W0514 07:59:45.673378    53 infer.h:673] Succ reload version engine: 18446744073709551615
I0514 07:59:45.673404    53 manager.h:131] Finish reload 1 workflow(s)
W0514 07:59:45.757856    60 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.757949    60 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.757989    60 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.758038    60 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.764763    60 infer.h:524] td_core[0x7f8e84004a00] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.764863    60 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.764883    60 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.764904    60 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e840d46a0
W0514 07:59:45.764986    59 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.765010    59 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.765048    59 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.765092    59 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.773568    59 infer.h:524] td_core[0x7f8e7c004a00] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.773717    59 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.773737    59 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.773758    59 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e7c0d46a0
W0514 07:59:45.773846    61 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.773871    61 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.773908    61 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.773950    61 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.783344    61 infer.h:524] td_core[0x7f8e70004a00] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.783439    61 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.783458    61 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.783478    61 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e700d45f0
W0514 07:59:45.783563    58 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.783588    58 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.783751    58 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.783879    58 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.791024    58 infer.h:524] td_core[0x7f8e68004a00] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.791286    58 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.791388    58 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.791513    58 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e680d45f0
W0514 07:59:45.791613    62 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.791685    62 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.791731    62 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.791780    62 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.801510    62 infer.h:524] td_core[0x7f8e5c004a00] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.801622    62 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.801914    62 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.801935    62 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e5c0d45f0
W0514 07:59:45.802053    63 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.802084    63 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.802246    63 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.802418    63 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0514 07:59:45.812374    51 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=9292.
W0514 07:59:45.813482    63 infer.h:524] td_core[0x7f8e54004a00] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.813545    63 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.813570    63 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.813594    63 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e540d45f0
W0514 07:59:45.813710    64 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.813807    64 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.813841    64 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.813889    64 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.819582    64 infer.h:524] td_core[0x744b990] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.819764    64 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.819788    64 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.819811    64 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x8597bb0
W0514 07:59:45.819890    57 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.819918    57 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.819959    57 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.820013    57 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.827796    57 infer.h:524] td_core[0x7f8e5402c2c0] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.827900    57 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.827924    57 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.827947    57 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e541be610
W0514 07:59:45.828017    56 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.828049    56 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.828091    56 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.828194    56 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.836817    56 infer.h:524] td_core[0x7f8e5c02c310] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.836939    56 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.837077    56 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.837105    56 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e5c1c0610
W0514 07:59:45.837270    55 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.837311    55 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.837358    55 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.837411    55 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.845721    55 infer.h:524] td_core[0x7f8e680f2020] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.845832    55 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.845856    55 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.845880    55 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e681c1b60
W0514 07:59:45.845949    54 memory.cpp:73] Succ thread initialize mempool wrapper
W0514 07:59:45.845978    54 resource.cpp:279] Successfully thread initialized mempool wrapper
W0514 07:59:45.846019    54 memory.cpp:73] Succ thread initialize mempool wrapper
I0514 07:59:45.846071    54 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0514 07:59:45.857704    54 infer.h:524] td_core[0x7f8e7002c2b0] clone model from pd_core[0x6c79830] succ, cur_idx[0].
W0514 07:59:45.857805    54 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0514 07:59:45.857827    54 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0514 07:59:45.857851    54 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8e701c0600
I0514 07:59:45.907757    51 server.cpp:1040] Check out http://74479173b0e3:9292 in web browser.
I0514 07:59:55.673565    53 server.cpp:150] Begin reload framework...
W0514 07:59:55.673689    53 infer.h:673] Succ reload version engine: 18446744073709551615
I0514 07:59:55.673718    53 manager.h:131] Finish reload 1 workflow(s)
I0514 08:00:05.686846    53 server.cpp:150] Begin reload framework...
W0514 08:00:05.687045    53 infer.h:673] Succ reload version engine: 18446744073709551615
I0514 08:00:05.687077    53 manager.h:131] Finish reload 1 workflow(s)
I0514 08:00:15.687741    53 server.cpp:150] Begin reload framework...
W0514 08:00:15.687871    53 infer.h:673] Succ reload version engine: 18446744073709551615
I0514 08:00:15.687901    53 manager.h:131] Finish reload 1 workflow(s)
I0514 08:00:25.689365    53 server.cpp:150] Begin reload framework...
W0514 08:00:25.689498    53 infer.h:673] Succ reload version engine: 18446744073709551615
I0514 08:00:25.689529    53 manager.h:131] Finish reload 1 workflow(s)
I0514 08:00:35.693441    53 server.cpp:150] Begin reload framework...
W0514 08:00:35.693555    53 infer.h:673] Succ reload version engine: 18446744073709551615
I0514 08:00:35.693586    53 manager.h:131] Finish reload 1 workflow(s)

看日志server端是正常的，在client端启动之前export GLOG_v=3，重新执行client端，可以打出来更多debug信息看一下

你好，这是在client端启动之前export GLOG_v=3后的信息，HTTP和RPC方式都有。 HTTP方式的server端信息：

[root@74479173b0e3 project_bert]# python bert_web_service.py bert_seq128_model/ 9292
web service address:
http://172.17.0.2:9292/bert/prediction
 * Serving Flask app "paddle_serving_server.web_service" (lazy loading)
 * Environment: production
   WARNING: This is a development server. Do not use it in a production deployment.
   Use a production WSGI server instead.
 * Debug mode: off
 * Running on http://0.0.0.0:9292/ (Press CTRL+C to quit)
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.2/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 16 -port 12000 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 16 -max_body_size 67108864
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000    65 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000    65 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000    65 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000    65 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000    65 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000    65 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    65 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000    65 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    65 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000    65 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    65 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000    65 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    65 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000    65 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    65 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000    65 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    65 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

HTTP方式的client端信息（另一个cmd窗口执行命令）：

[root@74479173b0e3 /]# cd project_bert
[root@74479173b0e3 project_bert]# export GLOG_v=3
[root@74479173b0e3 project_bert]# curl -H "Content-Type:application/json" -X POS
T -d '{"feed":[{"words": "hello"}], "fetch":["pooled_output"]}' http://0.0.0.0:9
292/bert/prediction
{"result":"Request Value Error"}

随后HTTP方式的server端信息：

WARNING: Logging before InitGoogleLogging() is written to STDERR
I0515 08:18:38.918069    86 naming_service_thread.cpp:209] brpc::policy::ListNamingService("0.0.0.0:12000"): added 1
127.0.0.1 - - [15/May/2020 08:18:39] "POST /bert/prediction HTTP/1.1" 200 -

RPC方式的server端信息：

[root@74479173b0e3 project_bert]# python -m paddle_serving_server.serve --model bert_seq128_model/ --port 9292
mkdir: cannot create directory 'workdir': File exists
Going to Run Command
/usr/lib/python2.7/site-packages/paddle_serving_server/serving-cpu-noavx-openblas-0.2.2/serving -enable_model_toolkit -inferservice_path workdir -inferservice_file infer_service.prototxt -max_concurrency 0 -num_threads 10 -port 9292 -reload_interval_s 10 -resource_path workdir -resource_file resource.prototxt -workflow_path workdir -workflow_file workflow.prototxt -bthread_concurrency 10 -max_body_size 536870912
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralDistKVInferOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralTextReaderOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralCopyOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralDistKVQuantInferOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralReaderOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralInferOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralTextResponseOp
I0100 00:00:00.000000    52 op_repository.h:65] RAW: Succ regist op: GeneralResponseOp
I0100 00:00:00.000000    52 service_manager.h:61] RAW: Service[LoadGeneralModelService] insert successfully!
I0100 00:00:00.000000    52 load_general_model_service.pb.h:299] RAW: Success regist service[LoadGeneralModelService][PN5baidu14paddle_serving9predictor26load_general_model_service27LoadGeneralModelServiceImplE]
I0100 00:00:00.000000    52 service_manager.h:61] RAW: Service[GeneralModelService] insert successfully!
I0100 00:00:00.000000    52 general_model_service.pb.h:1473] RAW: Success regist service[GeneralModelService][PN5baidu14paddle_serving9predictor13general_model23GeneralModelServiceImplE]
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:25] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuAnalysisCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:31] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:37] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuAnalysisDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_ANALYSIS_DIR_SIGMOID in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:42] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:47] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine<FluidCpuNativeDirCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR in macro!
I0100 00:00:00.000000    52 factory.h:121] RAW: Succ insert one factory, tag: FLUID_CPU_NATIVE_DIR_SIGMOID, base type N5baidu14paddle_serving9predictor11InferEngineE
W0100 00:00:00.000000    52 fluid_cpu_engine.cpp:53] RAW: Succ regist factory: ::baidu::paddle_serving::predictor::FluidInferEngine< FluidCpuNativeDirWithSigmoidCore>->::baidu::paddle_serving::predictor::InferEngine, tag: FLUID_CPU_NATIVE_DIR_SIGMOID in macro!
--- Running analysis [ir_graph_build_pass]
--- Running analysis [ir_graph_clean_pass]
--- Running analysis [ir_analysis_pass]
--- Running analysis [ir_params_sync_among_devices_pass]
--- Running analysis [adjust_cudnn_workspace_size_pass]
--- Running analysis [inference_op_replace_pass]
--- Running analysis [ir_graph_to_program_pass]

RPC方式的client端信息（另一个cmd窗口执行命令）：

[root@74479173b0e3 project_bert]# export GLOG_v=3
[root@74479173b0e3 project_bert]# head data-c.txt | python bert_client.py --mode
l bert_seq128_client/serving_client_conf.prototxt
**重复的信息太多，屏幕只能显示出这些**
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "po
oled_output"
I0515 07:59:20.419092    67 endpoint.cpp:53] Succ thrd initialize all vars: 1
I0515 07:59:20.419921    67 predictor_sdk.cpp:129] Succ thrd initialize endpoint
:general_model
I0515 07:59:20.420442    67 general_model.cpp:160] fetch general model predictor
 done.
I0515 07:59:20.420825    67 general_model.cpp:161] float feed name size: 1
I0515 07:59:20.421686    67 general_model.cpp:162] int feed name size: 3
I0515 07:59:20.422096    67 general_model.cpp:163] max body size : 536870912
I0515 07:59:20.422480    67 general_model.cpp:170] prepare batch 0
I0515 07:59:20.422816    67 general_model.cpp:183] batch [0] int_feed_name and f
loat_feed_name prepared
I0515 07:59:20.424125    67 general_model.cpp:186] tensor_vec size 4 float shape
 1
I0515 07:59:20.424664    67 general_model.cpp:191] prepare float feed input_mask
 shape size 2
I0515 07:59:20.424757    67 general_model.cpp:203] batch [0] float feed value pr
epared
I0515 07:59:20.424845    67 general_model.cpp:210] prepare int feed position_ids
 shape size 2
I0515 07:59:20.425168    67 general_model.cpp:216] feed var name position_ids in
dex 0first data 0
I0515 07:59:20.425634    67 general_model.cpp:210] prepare int feed input_ids sh
ape size 2
I0515 07:59:20.425742    67 general_model.cpp:216] feed var name input_ids index
 1first data 101
I0515 07:59:20.425829    67 general_model.cpp:210] prepare int feed segment_ids
shape size 2
I0515 07:59:20.426605    67 general_model.cpp:216] feed var name segment_ids ind
ex 2first data 0
I0515 07:59:20.428706    67 general_model.cpp:224] batch [0] int feed value prep
ared
W0515 07:59:20.429289    67 predictor.hpp:129] inference call failed, message: [
E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list
://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:92
92 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0515 07:59:20.430721    67 general_model.cpp:246] failed call predictor with re
q: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 floa
t_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1
float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data
: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_
data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 13 int64_data:
14 int64_data: 15 int64_data: 16 int64_data: 17 int64_data: 18 int64_data: 19 in
t64_data: 20 int64_data: 21 int64_data: 22 int64_data: 23 int64_data: 24 int64_d
ata: 25 int64_data: 26 int64_data: 27 int64_data: 28 int64_data: 29 int64_data:
30 int64_data: 31 int64_data: 32 int64_data: 33 int64_data: 34 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_data: 101 int64_dat
a: 7623 int64_data: 6843 int64_data: 1168 int64_data: 7305 int64_data: 7305 int6
4_data: 1366 int64_data: 8024 int64_data: 2578 int64_data: 2428 int64_data: 2523
 int64_data: 1962 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_data:
 2523 int64_data: 3472 int64_data: 1318 int64_data: 7660 int64_data: 4500 int64_
data: 7234 int64_data: 5291 int64_data: 1259 int64_data: 4708 int64_data: 8024 i
nt64_data: 1456 int64_data: 6887 int64_data: 2523 int64_data: 3472 int64_data: 8
024 int64_data: 722 int64_data: 1400 int64_data: 6820 int64_data: 833 int64_data
: 743 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_da
ta: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int6
4_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data
: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_
data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 in
t64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
0 int64_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_nam
es: "pooled_output"
I0515 07:59:20.434094    67 endpoint.cpp:53] Succ thrd initialize all vars: 1
I0515 07:59:20.434592    67 predictor_sdk.cpp:129] Succ thrd initialize endpoint
:general_model
I0515 07:59:20.434741    67 general_model.cpp:160] fetch general model predictor
 done.
I0515 07:59:20.434849    67 general_model.cpp:161] float feed name size: 1
I0515 07:59:20.435729    67 general_model.cpp:162] int feed name size: 3
I0515 07:59:20.435954    67 general_model.cpp:163] max body size : 536870912
I0515 07:59:20.436165    67 general_model.cpp:170] prepare batch 0
I0515 07:59:20.436311    67 general_model.cpp:183] batch [0] int_feed_name and f
loat_feed_name prepared
I0515 07:59:20.436518    67 general_model.cpp:186] tensor_vec size 4 float shape
 1
I0515 07:59:20.436630    67 general_model.cpp:191] prepare float feed input_mask
 shape size 2
I0515 07:59:20.436741    67 general_model.cpp:203] batch [0] float feed value pr
epared
I0515 07:59:20.436847    67 general_model.cpp:210] prepare int feed position_ids
 shape size 2
I0515 07:59:20.437081    67 general_model.cpp:216] feed var name position_ids in
dex 0first data 0
I0515 07:59:20.437206    67 general_model.cpp:210] prepare int feed input_ids sh
ape size 2
I0515 07:59:20.437310    67 general_model.cpp:216] feed var name input_ids index
 1first data 101
I0515 07:59:20.437527    67 general_model.cpp:210] prepare int feed segment_ids
shape size 2
I0515 07:59:20.437633    67 general_model.cpp:216] feed var name segment_ids ind
ex 2first data 0
I0515 07:59:20.437741    67 general_model.cpp:224] batch [0] int feed value prep
ared
W0515 07:59:20.438131    67 predictor.hpp:129] inference call failed, message: [
E112]1/1 channels failed, fail_limit=1 [C0][E112]Fail to select server from list
://127.0.0.1:9292 lb=la [R1][E112]Fail to select server from list://127.0.0.1:92
92 lb=la [R2][E112]Fail to select server from list://127.0.0.1:9292 lb=la
E0515 07:59:20.438843    67 general_model.cpp:246] failed call predictor with re
q: insts { tensor_array { float_data: 1 float_data: 1 float_data: 1 float_data:
1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 1 float_da
ta: 1 float_data: 1 float_data: 1 float_data: 1 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_da
ta: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 floa
t_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0
float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data
: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_
data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 fl
oat_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 float_data:
0 float_data: 0 float_data: 0 float_data: 0 float_data: 0 elem_type: 1 shape: 12
8 shape: 1 } tensor_array { int64_data: 0 int64_data: 1 int64_data: 2 int64_data
: 3 int64_data: 4 int64_data: 5 int64_data: 6 int64_data: 7 int64_data: 8 int64_
data: 9 int64_data: 10 int64_data: 11 int64_data: 12 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 elem_type: 0 shap
e: 128 shape: 1 } tensor_array { int64_data: 101 int64_data: 2923 int64_data: 19
62 int64_data: 4638 int64_data: 8024 int64_data: 1259 int64_data: 6163 int64_dat
a: 4384 int64_data: 924 int64_data: 1348 int64_data: 3300 int64_data: 1501 int64
_data: 511 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } tensor_array { int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 i
nt64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data:
 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_d
ata: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int
64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0
 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_dat
a: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64_data: 0 int64
_data: 0 int64_data: 0 elem_type: 0 shape: 128 shape: 1 } } fetch_var_names: "po
oled_output"

这是紧接着上一步操作后cat的log/serving.INFO和serving.WARNING信息。

[root@74479173b0e3 project_bert]# cd log
[root@74479173b0e3 log]# ls -l
total 256
-rw-r--r-- 1 root root 15127 May 13 07:33 serving.74479173b0e3.invalid-user.log.INFO.20200513-073243.896
-rw-r--r-- 1 root root 15127 May 14 03:19 serving.74479173b0e3.invalid-user.log.INFO.20200514-031814.54
-rw-r--r-- 1 root root 19937 May 14 04:01 serving.74479173b0e3.invalid-user.log.INFO.20200514-040058.137
-rw-r--r-- 1 root root 19706 May 14 06:52 serving.74479173b0e3.invalid-user.log.INFO.20200514-065136.361
-rw-r--r-- 1 root root 15395 May 14 06:59 serving.74479173b0e3.invalid-user.log.INFO.20200514-065913.64
-rw-r--r-- 1 root root 20217 May 14 07:47 serving.74479173b0e3.invalid-user.log.INFO.20200514-074655.52
-rw-r--r-- 1 root root 15407 May 14 08:00 serving.74479173b0e3.invalid-user.log.INFO.20200514-075938.51
-rw-r--r-- 1 root root 15176 May 15 07:58 serving.74479173b0e3.invalid-user.log.INFO.20200515-075725.52
-rw-r--r-- 1 root root 20217 May 15 08:18 serving.74479173b0e3.invalid-user.log.INFO.20200515-081707.65
-rw-r--r-- 1 root root  7654 May 13 07:33 serving.74479173b0e3.invalid-user.log.WARNING.20200513-073243.896
-rw-r--r-- 1 root root  7654 May 14 03:19 serving.74479173b0e3.invalid-user.log.WARNING.20200514-031814.54
-rw-r--r-- 1 root root 11057 May 14 04:01 serving.74479173b0e3.invalid-user.log.WARNING.20200514-040058.137
-rw-r--r-- 1 root root 10967 May 14 06:52 serving.74479173b0e3.invalid-user.log.WARNING.20200514-065136.361
-rw-r--r-- 1 root root  7564 May 14 06:59 serving.74479173b0e3.invalid-user.log.WARNING.20200514-065913.64
-rw-r--r-- 1 root root 11147 May 14 07:47 serving.74479173b0e3.invalid-user.log.WARNING.20200514-074655.52
-rw-r--r-- 1 root root  7744 May 14 08:00 serving.74479173b0e3.invalid-user.log.WARNING.20200514-075938.51
-rw-r--r-- 1 root root  7654 May 15 07:58 serving.74479173b0e3.invalid-user.log.WARNING.20200515-075725.52
-rw-r--r-- 1 root root 11147 May 15 08:18 serving.74479173b0e3.invalid-user.log.WARNING.20200515-081707.65
lrwxrwxrwx 1 root root    61 May 15 08:17 serving.INFO -> serving.74479173b0e3.invalid-user.log.INFO.20200515-081707.65
lrwxrwxrwx 1 root root    64 May 15 08:17 serving.WARNING -> serving.74479173b0e3.invalid-user.log.WARNING.20200515-081707.65
[root@74479173b0e3 log]# cat serving.INFO
Log file created at: 2020/05/15 08:17:07
Running on machine: 74479173b0e3
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0515 08:17:07.656668    65 resource.cpp:110] Successfully proc initialized mempool wrapper
I0515 08:17:07.675093    65 infer.h:782] model_toolkit_conf.engines(0).name: general_infer_0
I0515 08:17:07.675143    65 infer.h:74] InferEngineCreationParams: model_path = bert_seq128_model/, enable_memory_optimization = 0, enable_ir_optimization = 0, static_optimization = 0, force_update_static_cache = 0
I0515 08:17:07.675338    65 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0515 08:17:07.708691    65 analysis_predictor.cc:833] MODEL VERSION: 1.7.2
I0515 08:17:07.708889    65 analysis_predictor.cc:835] PREDICTOR VERSION: 1.7.2
I0515 08:17:07.709621    65 analysis_predictor.cc:440] ir_optim is turned off, no IR pass will be executed
I0515 08:17:13.145032    65 analysis_predictor.cc:462] ======= optimize end =======
W0515 08:17:13.151778    65 infer.h:487] Succ load common model[0x57e5830], path[bert_seq128_model/].
W0515 08:17:13.151985    65 infer.h:185] Succ load model_data_pathbert_seq128_model/
W0515 08:17:13.152002    65 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0515 08:17:13.152015    65 infer.h:594] Succ proc initialize engine: general_infer_0
W0515 08:17:13.152030    65 infer.h:799] Succ proc initialize engine: general_infer_0
W0515 08:17:13.152818    65 kv_manager.h:70] general_infer_0:
W0515 08:17:13.152856    65 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
I0515 08:17:13.156495    65 dag.cpp:217] (general_reader_0) in_degree[0]: 0
I0515 08:17:13.156847    65 dag.cpp:217] (general_infer_0) in_degree[1]: 1
I0515 08:17:13.156859    65 dag.cpp:217] (general_response_0) in_degree[2]: 1
I0515 08:17:13.156893    65 dag.cpp:158] DAG: workflow1
I0515 08:17:13.156903    65 dag.cpp:159] , Op Num: 3
I0515 08:17:13.156913    65 dag.cpp:162] , OP-1-general_reader_0-GeneralReaderOp
I0515 08:17:13.156921    65 dag.cpp:164]  depends: 0
I0515 08:17:13.156930    65 dag.cpp:162] , OP-2-general_infer_0-GeneralInferOp
I0515 08:17:13.156939    65 dag.cpp:164]  depends: 1
I0515 08:17:13.156949    65 dag.cpp:168]  general_reader_0 0
I0515 08:17:13.156957    65 dag.cpp:162] , OP-3-general_response_0-GeneralResponseOp
I0515 08:17:13.156965    65 dag.cpp:164]  depends: 1
I0515 08:17:13.156975    65 dag.cpp:168]  general_infer_0 0
I0515 08:17:13.156983    65 dag.cpp:171]
I0515 08:17:13.156998    65 manager.h:86] Succ init item:workflow1 from conf:workdir/workflow.prototxt, at:0!
W0515 08:17:13.158041    65 service.cpp:49] Succ get merger: default for service: GeneralModelService
I0515 08:17:13.158289    65 service.cpp:61] service[GeneralModelService], enable_map_request_to_workflow[0].
I0515 08:17:13.158382    65 predictor_metric.h:170] try to regist latency metric[workflow_GeneralModelService_workflow1].
I0515 08:17:13.158483    65 predictor_metric.h:175] succ to regist latency metric[workflow_GeneralModelService_workflow1].
I0515 08:17:13.158496    65 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_0].
I0515 08:17:13.158542    65 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_0].
I0515 08:17:13.158555    65 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0515 08:17:13.158597    65 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_0_general_reader_0].
I0515 08:17:13.158612    65 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_1].
I0515 08:17:13.158696    65 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_1].
I0515 08:17:13.158715    65 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0515 08:17:13.158762    65 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_1_general_infer_0].
I0515 08:17:13.158936    65 predictor_metric.h:170] try to regist latency metric[stage_GeneralModelService_workflow1_2].
I0515 08:17:13.158988    65 predictor_metric.h:175] succ to regist latency metric[stage_GeneralModelService_workflow1_2].
I0515 08:17:13.159004    65 predictor_metric.h:170] try to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0515 08:17:13.159060    65 predictor_metric.h:175] succ to regist latency metric[op_GeneralModelService_workflow1_2_general_response_0].
I0515 08:17:13.159080    65 service.cpp:126] Succ load infer_service: GeneralModelService!
I0515 08:17:13.159099    65 manager.h:184] Succ init item:GeneralModelService from conf:workdir/infer_service.prototxt, at:0!
I0515 08:17:13.169253    67 server.cpp:147] Entrence reload worker, interval_s: 10
I0515 08:17:13.169351    67 server.cpp:150] Begin reload framework...
W0515 08:17:13.169389    67 infer.h:673] Succ reload version engine: 18446744073709551615
I0515 08:17:13.169411    67 manager.h:131] Finish reload 1 workflow(s)
W0515 08:17:13.169482    70 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.169505    70 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.169541    70 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.169590    70 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.189319    70 infer.h:524] td_core[0x7f8da8004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.189409    70 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.189426    70 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.189445    70 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8da80d46a0
W0515 08:17:13.189512    71 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.189535    71 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.189574    71 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.189615    71 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0515 08:17:13.197846    65 server.cpp:1037] Server[baidu::paddle_serving::predictor::general_model::GeneralModelServiceImpl] is serving on port=12000.
W0515 08:17:13.207140    71 infer.h:524] td_core[0x7f8da4004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.207290    71 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.207309    71 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.207329    71 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8da40d46a0
W0515 08:17:13.207413    72 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.207437    72 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.207471    72 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.207515    72 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.214334    72 infer.h:524] td_core[0x7f8d98004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.214426    72 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.214444    72 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.214463    72 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d980d45f0
W0515 08:17:13.214548    73 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.214572    73 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.214607    73 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.214648    73 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.223640    73 infer.h:524] td_core[0x7f8d90004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.223915    73 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.223938    73 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.223958    73 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d900d45f0
W0515 08:17:13.224056    69 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.224082    69 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.224118    69 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.224251    69 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
I0515 08:17:13.227035    65 server.cpp:1040] Check out http://74479173b0e3:12000 in web browser.
W0515 08:17:13.232362    69 infer.h:524] td_core[0x7f8d84004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.232455    69 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.232473    69 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.232492    69 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d840d45f0
W0515 08:17:13.232571    74 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.232595    74 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.232630    74 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.232997    74 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.239702    74 infer.h:524] td_core[0x7f8d7c004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.239811    74 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.239835    74 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.239857    74 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d7c0d45f0
W0515 08:17:13.239966    75 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.239991    75 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.240023    75 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.240069    75 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.245709    75 infer.h:524] td_core[0x5fb4900] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.245823    75 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.245846    75 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.245869    75 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7105aa0
W0515 08:17:13.245942    76 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.245970    76 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.246011    76 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.246055    76 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.253460    76 infer.h:524] td_core[0x7f8d7c02b640] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.253571    76 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.253592    76 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.253616    76 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d7c1be610
W0515 08:17:13.253711    77 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.253765    77 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.253810    77 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.253865    77 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.263388    77 infer.h:524] td_core[0x7f8d8402c310] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.263586    77 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.263613    77 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.263638    77 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d841c0610
W0515 08:17:13.263806    78 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.263845    78 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.263886    78 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.263937    78 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.270725    78 infer.h:524] td_core[0x7f8d9002c2c0] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.270823    78 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.270844    78 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.270867    78 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d901be610
W0515 08:17:13.270934    79 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.270961    79 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.271004    79 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.271056    79 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.278002    79 infer.h:524] td_core[0x7f8d9802c2b0] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.278107    79 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.278129    79 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.278153    79 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d981c0600
W0515 08:17:13.278290    80 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.278319    80 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.278360    80 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.278409    80 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.285084    80 infer.h:524] td_core[0x7f8da40f8700] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.285259    80 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.285284    80 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.285307    80 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8da41d6b60
W0515 08:17:13.285375    81 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.285403    81 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.285444    81 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.285487    81 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.292038    81 infer.h:524] td_core[0x7f8da8301a20] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.292300    81 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.292326    81 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.292351    81 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8da83d15f0
W0515 08:17:13.292493    68 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.292532    68 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.292573    68 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.292623    68 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.299314    68 infer.h:524] td_core[0x7f8db0004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.299412    68 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.299540    68 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.299567    68 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8db00d45f0
W0515 08:17:13.299726    84 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.299768    84 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.299809    84 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.299859    84 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.307338    84 infer.h:524] td_core[0x7f8dd80079b0] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.307448    84 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.307471    84 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.307494    84 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8dd80d75e0
W0515 08:17:13.307569    83 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.307596    83 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.307641    83 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.307765    83 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.314637    83 infer.h:524] td_core[0x5fbe440] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.314853    83 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.314877    83 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.314901    83 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x71f1f80
W0515 08:17:13.317205    82 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.317322    82 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.317379    82 memory.cpp:73] Succ thread initialize mempool wrapper
I0515 08:17:13.317440    82 analysis_predictor.cc:84] Profiler is deactivated, and no profiling report will be generated.
W0515 08:17:13.324643    82 infer.h:524] td_core[0x7f8d7c100a70] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.324815    82 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.324838    82 infer.h:810] Succ thrd initialize engine, name: general_infer_0
I0515 08:17:13.324862    82 resource.cpp:313] 0: Successfully thread initialized dynamic resource 0x7f8d7c2aafd0
I0515 08:17:23.174440    67 server.cpp:150] Begin reload framework...
W0515 08:17:23.174559    67 infer.h:673] Succ reload version engine: 18446744073709551615
I0515 08:17:23.174588    67 manager.h:131] Finish reload 1 workflow(s)
I0515 08:17:33.174754    67 server.cpp:150] Begin reload framework...
W0515 08:17:33.174908    67 infer.h:673] Succ reload version engine: 18446744073709551615
I0515 08:17:33.174943    67 manager.h:131] Finish reload 1 workflow(s)
I0515 08:17:43.175190    67 server.cpp:150] Begin reload framework...
W0515 08:17:43.175314    67 infer.h:673] Succ reload version engine: 18446744073709551615
I0515 08:17:43.175346    67 manager.h:131] Finish reload 1 workflow(s)
I0515 08:17:53.176642    67 server.cpp:150] Begin reload framework...
W0515 08:17:53.176792    67 infer.h:673] Succ reload version engine: 18446744073709551615
I0515 08:17:53.176825    67 manager.h:131] Finish reload 1 workflow(s)
I0515 08:18:03.180347    67 server.cpp:150] Begin reload framework...
W0515 08:18:03.180483    67 infer.h:673] Succ reload version engine: 18446744073709551615
I0515 08:18:03.180514    67 manager.h:131] Finish reload 1 workflow(s)
[root@74479173b0e3 log]# cat serving.WARNING
Log file created at: 2020/05/15 08:17:07
Running on machine: 74479173b0e3
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
W0515 08:17:07.656668    65 resource.cpp:110] Successfully proc initialized mempool wrapper
W0515 08:17:13.151778    65 infer.h:487] Succ load common model[0x57e5830], path[bert_seq128_model/].
W0515 08:17:13.151985    65 infer.h:185] Succ load model_data_pathbert_seq128_model/
W0515 08:17:13.152002    65 infer.h:620] Succ proc initialize version engine: 18446744073709551615
W0515 08:17:13.152015    65 infer.h:594] Succ proc initialize engine: general_infer_0
W0515 08:17:13.152030    65 infer.h:799] Succ proc initialize engine: general_infer_0
W0515 08:17:13.152818    65 kv_manager.h:70] general_infer_0:
W0515 08:17:13.152856    65 kv_manager.h:72] Succ proc initialize kvmanager for engine: general_infer_0
W0515 08:17:13.158041    65 service.cpp:49] Succ get merger: default for service: GeneralModelService
W0515 08:17:13.169389    67 infer.h:673] Succ reload version engine: 18446744073709551615
W0515 08:17:13.169482    70 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.169505    70 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.169541    70 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.189319    70 infer.h:524] td_core[0x7f8da8004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.189409    70 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.189426    70 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.189512    71 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.189535    71 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.189574    71 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.207140    71 infer.h:524] td_core[0x7f8da4004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.207290    71 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.207309    71 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.207413    72 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.207437    72 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.207471    72 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.214334    72 infer.h:524] td_core[0x7f8d98004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.214426    72 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.214444    72 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.214548    73 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.214572    73 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.214607    73 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.223640    73 infer.h:524] td_core[0x7f8d90004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.223915    73 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.223938    73 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.224056    69 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.224082    69 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.224118    69 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.232362    69 infer.h:524] td_core[0x7f8d84004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.232455    69 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.232473    69 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.232571    74 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.232595    74 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.232630    74 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.239702    74 infer.h:524] td_core[0x7f8d7c004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.239811    74 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.239835    74 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.239966    75 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.239991    75 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.240023    75 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.245709    75 infer.h:524] td_core[0x5fb4900] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.245823    75 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.245846    75 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.245942    76 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.245970    76 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.246011    76 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.253460    76 infer.h:524] td_core[0x7f8d7c02b640] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.253571    76 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.253592    76 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.253711    77 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.253765    77 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.253810    77 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.263388    77 infer.h:524] td_core[0x7f8d8402c310] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.263586    77 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.263613    77 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.263806    78 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.263845    78 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.263886    78 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.270725    78 infer.h:524] td_core[0x7f8d9002c2c0] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.270823    78 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.270844    78 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.270934    79 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.270961    79 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.271004    79 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.278002    79 infer.h:524] td_core[0x7f8d9802c2b0] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.278107    79 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.278129    79 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.278290    80 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.278319    80 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.278360    80 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.285084    80 infer.h:524] td_core[0x7f8da40f8700] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.285259    80 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.285284    80 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.285375    81 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.285403    81 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.285444    81 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.292038    81 infer.h:524] td_core[0x7f8da8301a20] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.292300    81 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.292326    81 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.292493    68 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.292532    68 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.292573    68 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.299314    68 infer.h:524] td_core[0x7f8db0004a00] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.299412    68 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.299540    68 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.299726    84 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.299768    84 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.299809    84 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.307338    84 infer.h:524] td_core[0x7f8dd80079b0] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.307448    84 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.307471    84 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.307569    83 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.307596    83 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.307641    83 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.314637    83 infer.h:524] td_core[0x5fbe440] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.314853    83 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.314877    83 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:13.317205    82 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.317322    82 resource.cpp:279] Successfully thread initialized mempool wrapper
W0515 08:17:13.317379    82 memory.cpp:73] Succ thread initialize mempool wrapper
W0515 08:17:13.324643    82 infer.h:524] td_core[0x7f8d7c100a70] clone model from pd_core[0x57e5830] succ, cur_idx[0].
W0515 08:17:13.324815    82 infer.h:641] Succ thrd initialize version engine: 18446744073709551615
W0515 08:17:13.324838    82 infer.h:810] Succ thrd initialize engine, name: general_infer_0
W0515 08:17:23.174559    67 infer.h:673] Succ reload version engine: 18446744073709551615
W0515 08:17:33.174908    67 infer.h:673] Succ reload version engine: 18446744073709551615
W0515 08:17:43.175314    67 infer.h:673] Succ reload version engine: 18446744073709551615
W0515 08:17:53.176792    67 infer.h:673] Succ reload version engine: 18446744073709551615
W0515 08:18:03.180483    67 infer.h:673] Succ reload version engine: 18446744073709551615

PaddlePaddle / Serving

docker容器中，HTTP和RPC服务进行bert模型预测时报错 #555