search

uf-mil / mil

Monorepo of the Machine Intelligence Lab at the University of Florida
https://mil.ufl.edu/docs
Other
45 stars 29 forks source link

Computer vision for drone tins #1269

Open cbrxyz opened 2 weeks ago

cbrxyz commented 2 weeks ago

What needs to change?

Similar to #1268, we will need to develop a computer vision model to detect the red, green, and blue tins that lay on the drone landing pads. To the down camera, these will look like red, green, and blue circles. We will be using the drone camera's built-in vision model at first, and if this does not perform well, then we will develop our own in-house model.

How would this task be tested?

  1. Ensure that the tins are detected in a wide variety of environmental conditions.
mohana-pamidi commented 4 days ago

Update: Collected data for pictures of the tins has been added to label studio, and I will continue to add more by the end of today.

cbrxyz commented 1 day ago

@mohana-pamidi

Great job on uploading the data! It looks great! The only issue is that the frames might be a little too similar, which could make the model hyperfocus on just the environments that your videos are shot in. Could you take the data that you have, and take every 7th or 8th image and re-upload those images as a new project in Label Studio?

Also, it looks like the dataset might be a bit unbalanced... it looks like there's quite a few red tin images, but not as many green/blue. You could consider getting some more images of the green and blue tins. Also, I would try to get some outside videos with the sun shining onto the tins and some videos with shade covering the tins (since they will usually be outside).