search

zhihou7 / HOI-CL

Series of work (ECCV2020, CVPR2021, CVPR2021, ECCV2022) about Compositional Learning for Human-Object Interaction Exploration
https://sites.google.com/view/hoi-cl
MIT License
76 stars 11 forks source link

unseen zero-shot seeting #22

Open xuliwalker opened 2 years ago

xuliwalker commented 2 years ago

Hi, thanks for your work! I am interested in the unseen composition and unseen object zero-shot setting in FCL paper, and I am wondering where can I find the code for generating the training and testing sets for these two zero-shot settings. Thank you!

zhihou7 commented 2 years ago

Those HOI ids are for rare first zero-shot setting. https://github.com/zhihou7/FCL/blob/12bc2d4bef4fd2d7d295b33d15f023ae266bc519/lib/ult/ult.py#L400, while this line is for non-rare first zero-shot setting (https://github.com/zhihou7/FCL/blob/12bc2d4bef4fd2d7d295b33d15f023ae266bc519/lib/ult/ult.py#L427).

This line (https://github.com/zhihou7/FCL/blob/12bc2d4bef4fd2d7d295b33d15f023ae266bc519/lib/ult/ult.py#L534) shows how I remove the unseen classes during training.

For json format input (e.g. qpic), I guess this script might help you. https://gist.github.com/zhihou7/d3c7563a1b8244bf3914ed0853c7ea04

Please notice the category id between different repositories might be different. You should convert it by yourself.

Regards,