search

JeffWang987 / OpenOccupancy

[ICCV 2023] OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perception
Apache License 2.0
590 stars 50 forks source link

Any attempts on multi-frame training? #17

Closed zehuichen123 closed 1 year ago

zehuichen123 commented 1 year ago

Hi, I am trying to adapt BEVDet4D style multi-frame inputs to OpenOcc. However, the results are not satisfying (with a slight performance drop: 8.7->8.6 mIoU). I am wondering if you have tried this. Thanks.

JeffWang987 commented 1 year ago

I haven't tried it yet. Can you provide detailed metrics for each category to explain the counterintuitive performance drop? Specifically, I'm curious if the multi-frame setting overfits to large-structured regions such as roads or is negatively impacted by moving objects like cars.

zehuichen123 commented 1 year ago

Sorry. I wrote some bugs in the code. The multi-frame training can improve performance.

chenzyhust commented 1 year ago

Sorry. I wrote some bugs in the code. The multi-frame training can improve performance.

May I ask how much multi-frame training has improved?