search

hush66 / DNN-Partition-demo

A DNN model partition demo
30 stars 5 forks source link

请问有用支持提前退出或者模型分割的模型推断框架嘛 #6

Open PshySimon opened 3 years ago

PshySimon commented 3 years ago

在CPU上用pytorch推断实在是太慢了，onnx比pytorch要快上不少额...