Smart cropping results not as expected

[jeffpaul]

Describe the bug I've tested ClassifAI 1.5.1 on WordPress 5.5.1, 5.4, and 5.3 and am seeing that image tags and alt text work as expected (yay!) but the smart cropping feature isn't providing the desired result (boo!).

Steps to Reproduce

1. Upload an image to the media library, example:
2. See that cropped thumbnail only captures the top of the dog:
3. Click "edit" to see that alt text and image tags worked as expected.

Expected behavior Resulting crop would more closely match what Azure Computer Vision demonstrates on their site:

Screenshots See in-line in this issue.

Environment information

• Device: Mac mini (2018)
• OS: macOS 10.15.6
• Browser and version: Firefox 80.0.1 (64-bit)
• WordPress version: 5.5.1, 5.4, and 5.3 tested
• ClassifAI 1.5.1

ClassifAI image processing settings:

Additional context

I'll try and dig up the Azure API docs to see if something changed since our original implementation, but open to other triaging to help on this.

[jeffpaul]

Looks like we're referencing v2.0 of their API: https://github.com/10up/classifai/blob/bdee8d423393123dbf6602647cd049b38cd89c0d/includes/Classifai/Providers/Azure/SmartCropping.php#L29

They've since updated to v2.1, v3.0, and have a preview up for v3.1.

[jeffpaul]

Not seeing any major announcements on their blog: https://azure.microsoft.com/en-us/blog/topics/cognitive-services/

[helen]

Well that's a little annoying, maybe we should bump to 3.0 for all of the different endpoints we're using?

[jeffpaul]

@helen that's at least worth researching. Also credit to @oscarssanchez for helping call out this issue and provide good reproduction steps.