search

rodgzilla / image_gluing

gluing images to form a bigger picture
MIT License
0 stars 0 forks source link

Build the similarity scoring function #2

Open rodgzilla opened 5 years ago

rodgzilla commented 5 years ago

The idea of the similarity function is to compare what the network "sees" in our image gluing to what it "sees" in the target picture. To do this, the idea is to take a publicly available pretrained neural network and compare the output of some of the convolution features.

The idea is presented in the equation (2) of the following paper Perceptual Losses for Real-Time Style Transfer and Super-Resolution:

image

This formula is used to quantify how similar are the contents of two images, y the one we are trying to reproduce, and ŷ the one we are building. Φ(y) is a vector that represents the content of y.

I will build a notebook that demonstrates this concept.

rodgzilla commented 5 years ago

The notebook that shows how to perform feature extraction using a VGG16 network in PyTorch.