Shared-Reality-Lab / IMAGE-server

IMAGE project server components
Other
2 stars 7 forks source link

Create a handler for people based images #469

Closed rohanakut closed 2 years ago

rohanakut commented 2 years ago

This issue mainly deals with creation of handlers for people category. The additional ML models implemented in #455 would be used in creating renderings for these images. An example image for which this handler should work is mentioned below

Screen Shot 2022-08-01 at 4 58 01 PM (Source - https://www.theguardian.com/uk-news/2022/aug/01/david-trimble-funeral-politicians-unite-pay-tribute)

The following should be the tasks of the handler

There are a few additional models which could be run. However, these models need to be tested before implementing them

rohanakut commented 2 years ago

The azure classifier does not classify image as "people", despite the image having multiple people. For example the following image the azure classifier returns 400 error. Screen Shot 2022-08-01 at 5 09 37 PM (Source - https://www.cbc.ca/news/canada/first-person-colonization-my-family-1.6515342)

Since the Azure Classifier is not reliable for detecting "people" category, there needs to be a custom check to determine of there are people in the image and if the image belongs to people category. The same has been added to task list.

rohanakut commented 2 years ago

Update: The first renderings were generated using the tasks described above. However, the renderings could contain more information like celebrity names, clothing information etc. Hence I have updated the task list to add these preprocessors.

rohanakut commented 2 years ago

@jeffbl closing this, since it is completed