titu1994 / neural-image-assessment

Implementation of NIMA: Neural Image Assessment in Keras
MIT License
783 stars 221 forks source link

Van Gogh's Mona Lisa is only 4.266 points??? #64

Open h3clikejava opened 3 years ago

h3clikejava commented 3 years ago

Use MobileNet Weights test Van Gogh's Mona Lisa only display NIMA Score : 4.266 +- (1.817) Feels little practical

image

And there are another question about NASNet Mobile, I can get same result via MobileNet, but when I used NASNet will get different result in the same picture... Has anyone encountered the same problem? I have already and ensure resize the picture to 224x224

One more thing. This is my result by MobileNet image

gohjiayi commented 3 years ago

I agree that NIMA is rather practical, art is subjective even for humans. Interesting insights you have gathered!!

One possible high-level explanation I have for the difference in results - MobileNet and NASNet Mobile are light-weight models while NASNet is not. You can dig into the specifics if you're interested but it's commonly observed that they will behave differently (e.g. YOLO vs YOLO Tiny, although they are obj det models but you get the point!).