ml5js / ml5-library

Friendly machine learning for the web! 🤖
https://ml5js.org
Other
6.49k stars 901 forks source link

YOLO on a custom (transfer tranied) ImageNet model #359

Closed deadbeef101010 closed 4 years ago

deadbeef101010 commented 5 years ago

YOLO on a custom (transfer tranied) ImageNet model

Hello we (son and self) are working on a high-school project to detect mites and then locate those mites on diseased bees. Of course we are assuming many things are ideal to keep things simple. We are far from experts and are seeking some pointers.

We plan to do transfer learning (TF) on ImageNet and KNN classification of the mites, then wanted to use YOLO to locate those mites in an input image. However we have questions as follows:

The next step would then be to use the trained ImageNet model on the new classification to locate the mites in an input image that could have other objects too, however, the YOLO API does not allow to specify our new classifier. Is this even possible? Are we on the correct path?

Thanks for your help, sorry if this is not the place for this---if not, please indicate where to post instead.

Swizz commented 5 years ago

I am also interested in using a custom YOLO pre-trained model to locate only specifics objects on an image.

Any update on this ?

joeyklee commented 4 years ago

Hi @Poohgit!

The short answer:

The longer answer: +It seems you can do transfer learning on YOLO but this requires some more python tooling and probably a GPU? https://github.com/ultralytics/yolov3/wiki/Example:-Transfer-Learning

joeyklee commented 4 years ago

Just making a note that for custom trained object detectors I believe a functionality that one can do in RunwayML. Maybe worth looking into there. Closing this issue now. Thanks!