dotnet / machinelearning-modelbuilder

Simple UI tool to build custom machine learning models.
Creative Commons Attribution 4.0 International
264 stars 56 forks source link

Unclear whether image classification is training on local GPU - Workaround: Set environment variable TF_CPP_MIN_LOG_LEVEL=3 #2343

Closed luisquintanilla closed 1 year ago

luisquintanilla commented 1 year ago

System Information (please complete the following information):

Describe the bug Training image classification scenario doesn't produce display progress in the output window making it difficult to know whether any progress is happening. When training is cancelled, it just hangs.

To Reproduce

Train image classification scenario on local GPU environment.

Expected behavior Progress displays in output window and training completes successfully.

Screenshots

Training

image

Cancel training

image

Additional context

ImageClassification-FHT35X.txt

JakeRadMSFT commented 1 year ago

I hit this and tried to set TF_CPP_MIN_LOG_LEVEL=3 from developer command prompt.

LittleLittleCloud commented 1 year ago

https://github.com/dotnet/machinelearning-modelbuilder/issues/2319

JakeRadMSFT commented 1 year ago

I hit this and tried to set TF_CPP_MIN_LOG_LEVEL=3 from developer command prompt.

Nevermind - this did work!

luisquintanilla commented 1 year ago

Okay to not hold the release for this issue since VS will be fixing in December and we have a known workaround.

luisquintanilla commented 1 year ago

Add workaround to release notes.

beccamc commented 1 year ago

Included in release notes https://github.com/dotnet/machinelearning-modelbuilder/blob/main/docs/release-notes/16.14.0.md