People photo matting

[allenwu5]

User Story As a user, I want to apply People photo matting to my photo, so that I can switch background easily

Task

• [x] Use Instance Segmentation to get People photo matting
• [ ] Change background of people photo matting

[allenwu5]

Ref:

• Apple CoreML DeeplabV3
  • https://github.com/tucan9389/ImageSegmentation-CoreML
  • https://enlight.nyc/projects/image-segmentation-mobile-app
  • https://heartbeat.fritz.ai/simple-semantic-image-segmentation-in-an-ios-application-deeplabv3-implementation-7f9d0cd6ea1a
• Photo Segmentation Mattes / Portrait Segmentation API
  • Prerequisite: Photo taken in portrait mode
  • Use devices which has a dual camera (e.g. iPhone 8 Plus) or a TrueDepth camera (e.g. iPhone X)
  • https://developer.apple.com/videos/play/wwdc2019/260/
  • https://blog.photoeditorsdk.com/almost-getting-sherlocked-by-apples-core-image-team-76249c370320/
  • https://github.com/shu223/iOS-Depth-Sampler
• Classic way - GrabCutIOS
  • https://github.com/naver/grabcutios