AmericanRedCross / street-view-green-view

BSD 3-Clause "New" or "Revised" License
15 stars 15 forks source link

investigate a way to detect (and if there) mask the vehicle roof #15

Open danbjoseph opened 7 months ago

danbjoseph commented 7 months ago

images might have the roof of the collecting vehicle in it (the camera could also be on a vertical selfie stick held by someone walking, or on the helmet of someone riding a motorcycle, or...)

for our MVP we're just looking at the relative green view index across the dataset, so as long as the camera height above the car is the same and the same vehicle was always used and so the roof is always the same % of the image, we should be fine... but we should ideally have a way to detect if there is a large amount of vehicle in the bottom third of the image, and if there is, then segment it out and mask it in the analysis.

solution should be able to run locally (not dependent on internet/ an API service) and have an open source license.

some examples of images that do have a vehicle roof visible that we want to use include this An9LPuVP__95KLo-N1Rrz3QUF1JysT6W2zoVbcNLvtvMdhWf_0DGRWqmdWYq4CKvWFiy7LxuBE7UncXq9SDoGxCW4kHTG8yhTJUqTH6ZN0PNTb2gwlxs4cqLrpmMYB3OBsWOX_dd4cu-9aHLxn-k3os

and this An-Ec3_VNyWnIMw4ErCwg9mbwCXubAtvQHjng6cxVdd_9Kl2FTt7BvGv2XXMZ64VQI0QE--9bOY30-WLHmbG5XPhwUYnChcpod6cer2Qy_vtkv8wJzUx8uU66dlKUBUaB6KJ7DZGfcFQDkLBXJrduQ

and this An-osqrLIb42BqAotjtBsHsIkjZGzybhRFbxhvqSqXua56jVpQnyv-2ryDRLQNIrKysYqoqaVRVPCqCiWq-xpl3zY5NC2S9a8nT_Lummb_TUAAIQS4FMaizyMC-ilyvl787-Y2LUYygScREJkMmghcw

and this An9gOUMNlxtzcxT1ajOavmG6h0qjhqbqI5bDYxVapsVVNlcpN5pABlE_qpZHhob54UML1ZgIOYRkx6VhcIL_Jq0Y0P9bZDnAExhCrRKYUVxKxZJ0WjWv0s02_ZACsPy5-uIK5LwDxQ3WMOW3KOyISKk

danbjoseph commented 7 months ago

for example: https://huggingface.co/badmatr11x/semantic-image-segmentation

Screenshot 2024-02-16 at 12 36 13 PM
pekingPow commented 6 months ago

Can we extract useful information using the roof of the car? Are we losing visual data that could be optimized?

danbjoseph commented 6 months ago

Nothing that I can think of. But I would be interested to hear ideas.