xmxoxo / BERT-train2deploy

BERT模型从训练到部署
517 stars 165 forks source link

请问下怎么设置CPU部署 #13

Closed shichengcn closed 4 years ago

shichengcn commented 4 years ago

服务端部署与启动 cd /mnt/sda1/transdat/bert-demo/bert/bert_svr

export BERT_BASE_DIR=/mnt/sda1/transdat/bert-demo/bert/chinese_L-12_H-768_A-12 export TRAINED_CLASSIFIER=/mnt/sda1/transdat/bert-demo/bert/output export EXP_NAME=mobile_0 export CUDA_VISIBLE_DEVICES=-1 bert-base-serving-start -model_dir $TRAINED_CLASSIFIER/$EXP_NAME -bert_model_dir $BERT_BASE_DIR -model_pb_dir $TRAINED_CLASSIFIER/$EXP_NAME -mode CLASS -max_seq_len 128 -http_port 8091 -port 5575 -port_out 5576 \ 注释掉 -device_map 1

仍旧会使用GPU1