Create a list of specialized ML based models

[rohanakut]

As mentioned in #220 , the Azure content tags would be used to categories the input image into different categories. On the basis of these categories we need to select the appropriate specialized models to get better quality renderings.

For example, for the mentioned image, the following tags are generated : "outdoor", "animal". Since the category is "animal" we should trigger a animal classifier which could determine the breed of the animal, the color of the animal and any other information necessary.

Hence, in this issue the main aim is to create a list of different specialised ML models which would run based on the categories mentioned in link

[rohanakut]

@jeffbl could you put this issue in the appropriate sprint?

[jeffbl]

Note that Azure has this functionality as "domain specific models", although they only have landmarks and celeberties, so it sounds like this would be using the mentioned API and adding on your own generated models for other categories.

[rohanakut]

A list of models which could be used for this issue: Celebrity Recognition: https://docs.microsoft.com/en-us/azure/cognitive-services/computer-vision/concept-detecting-domain-content Landmark Detection: https://docs.microsoft.com/en-us/azure/cognitive-services/computer-vision/concept-detecting-domain-content Emotion Detection: https://github.com/serengil/deepface Animal Classification :

1. https://www.kaggle.com/datasets/iamsouravbanerjee/animal-image-dataset-90-different-animals. (classification)
2. https://www.kaggle.com/datasets/antoreepjana/animals-detection-images-dataset. (object detection)
3. https://www.kaggle.com/code/yourwanghao/learn-yolov5-on-animal-datasets (object detection)

Dominant Color Detection: https://towardsdatascience.com/image-color-identification-with-machine-learning-and-image-processing-using-python-f3dd0606bdca Weather detection: https://github.com/berkgulay/weather-prediction-from-image https://www.kaggle.com/datasets/pratik2901/multiclass-weather-dataset https://www.kaggle.com/datasets/jagadeesh23/weather-classification (cloudy, sunny, rainy, snowy, foggy, sunset) Action Recognition: https://github.com/dronefreak/human-action-classification

[jeffbl]

@rohanakut Is there a new work item for this, to actually implement these as part of your thesis work? If so, should this be closed, if this is the final list you're going to use?

[rohanakut]

@jeffbl Closing this issue, since #455 would deal with the implementation of the models mentioned above