hustvl / ViTMatte

[Information Fusion (Vol.103, Mar. '24)] Boosting Image Matting with Pretrained Plain Vision Transformers
MIT License
325 stars 33 forks source link

How to Generated Trimap for an input image ? #13

Open minkvirparia opened 1 year ago

minkvirparia commented 1 year ago

I want to get an trimap of the input image, so that I can get foreground image using this two things (input image & corresponding trimap). Actually I want to build an PoC (Proof of Concept) which takes any image and generates its foreground image.

JingfengYao commented 1 year ago

Maybe you could refer to this issue.

LukaGiorgadze commented 8 months ago

@minkvirparia Did you solve the problem? I have the same question - how's possible to generate trimap programmatically and not manually?

JingfengYao commented 7 months ago

If you mean generate from alpha mattes for training or generate from a segmentation map like MatAny, it is possible. However, if you mean automatic object detection, I'm afraid not.

For this purpose, you may refer to the keywords 'human matting'. Here is some great work: RVM(human video matting), SIM(semantic image matting), MODNet(realtime human matting).

LukaGiorgadze commented 7 months ago

If you mean generate from alpha mattes for training or generate from a segmentation map like MatAny, it is possible. However, if you mean automatic object detection, I'm afraid not.

For this purpose, you may refer to the keywords 'human matting'. Here is some great work: RVM(human video matting), SIM(semantic image matting), MODNet(realtime human matting).

Yes, I mean generate from alpha mattes/maps. I have tools that generate this stuff, but VitMatte requires trimap, so how can I generate trimap from this kind of map?

tmpl5bdony3

JingfengYao commented 7 months ago

@LukaGiorgadze In ViTMatte, we generate in this way: https://github.com/hustvl/ViTMatte/blob/c2605975063bacd49852b9709cc1e0ebe58e4972/data/dim_dataset.py#L509

LukaGiorgadze commented 7 months ago

@LukaGiorgadze In ViTMatte, we generate in this way:

https://github.com/hustvl/ViTMatte/blob/c2605975063bacd49852b9709cc1e0ebe58e4972/data/dim_dataset.py#L509

Thank you @JingfengYao! This is helpful!

I love your work, it's absolutely amazing!

btw I suggest you add a sponsor button so people can sponsor with some bucks 💸

JingfengYao commented 7 months ago

@LukaGiorgadze Thanks 😄