Anime-fy Yourself

Code and documentation for my talk, Anime-fy Yourself Using Core ML

Screen recording of the sample app running on an M1 Mac

Setting up your environment

To setup your environment, see SETUP.md.

Convert from PyTorch to Core ML

To convert @bryandlee's PyTorch implementation of AnimeGANv2 to Core ML, run the following command:

python convert_to_nn.py 512

Running like this, the output image sizes will be 512 x 512px. If you want a different resolution, you can run the script with a different parameter. Currently only square image formats are supported.

This script will save a file called _AnimeGANv2512.mlmodel in the same directory, from which it was run. This model can be imported into Xcode and used in the sample project.

Comparing outputs

Additionally a script to compare the outputs of the PyTorch and Core ML models is available in the python directory.

python compare 512 MyCoolImage.jpg

Running this will print the cosine similarity of the PyTorch and Core ML model outputs. To do so, it flattens the output image and treats them as large 1D vectors. This may or may not be useful.

It will also save the PyTorch and CoreML generated images under the following names (based on the name of the passed in file):

• MyCoolImage_pt.png
• MyCoolImage_cml.png

Here are some example images and their cosine similarities:

Original	PyTorch	Core ML	Cosine Similarity
			91.04%
			80.48%