search

allenai / ai2thor

An open-source platform for Visual AI.
http://ai2thor.allenai.org
Apache License 2.0
1.09k stars 210 forks source link

Optical flow support #1115

Open mjlbach opened 1 year ago

mjlbach commented 1 year ago

It appears there is an optical flow shader and an undocumented action.renderFlowImage in the initialize constructor. When I add this parameter, it seems to hang. Is this a work-in-progress that I could help finish?

mattdeitke commented 1 year ago

Hi @mjlbach!

I think it might have been used a long time ago for the IQA paper, but not much since then.

Pinging @AlvaroHG to get his thoughts, whose more familiar with shaders and may know how it works :)

mjlbach commented 1 year ago

Hi @mattdeitke!

Thanks for getting back, it looks like it does work, but you have to render instance segmentation as well or it hangs. Would be nice to have it documented for others :)

Best, Michael

mattdeitke commented 1 year ago

Ah, good to know! Yeah, should be able to document it.