search

dotnet / machinelearning

ML.NET is an open source and cross-platform machine learning framework for .NET.
https://dot.net/ml
MIT License
8.97k stars 1.87k forks source link

Poor reasoning performance #6052

Open shiqiangz-git opened 2 years ago

shiqiangz-git commented 2 years ago

Gpu concurrent reasoning is too slow, CPU reasoning occupancy is too high, resNet50 image classification

shiqiangz-git commented 2 years ago

With gpu 1080ti

michaelgsharp commented 2 years ago

Can you share any results/numbers you are seeing along with what you would expect to be seeing? And share a sample project that repros the situation.

shiqiangz-git commented 2 years ago

Can you share any results/numbers you are seeing along with what you would expect to be seeing? And share a sample project that repros the situa

Can you share any results/numbers you are seeing along with what you would expect to be seeing? And share a sample project that repros the situation.

Sorry, I can't share my project. I just import about 670,000 pictures, then train them with resnet50, and then build webapi with pudectpool. If I use CPU, the CPU utilization rate slowly rises, and the gpu speed is not ideal. Can you tell me the reason? The performance has not reached an acceptable range, and the CPU utilization rate of a few pictures is 100.

shiqiangz-git commented 2 years ago

6,7w pictures