SokratG / Surround-View

MIT License
149 stars 48 forks source link

how to fine-tune the original external parameters? #6

Closed fanDongHust closed 2 years ago

fanDongHust commented 2 years ago

When the lens is corrected, on the actual road, the orientation of the lens changes, because the road is uneven, or the tire pressure is unstable, etc., the external parameters calibrated by the chessboard pattern is not valid no longer, then how to fine-tune the original external parameters, to reduce the error of the splicing results? image

Thank you!

SokratG commented 2 years ago

When the lens is corrected, on the actual road, the orientation of the lens changes, because the road is uneven, or the tire pressure is unstable, etc., the external parameters calibrated by the chessboard pattern is not valid no longer, then how to fine-tune the original external parameters, to reduce the error of the splicing results? image

Thank you!

This is not trivial or not well defined task. You compute some geometrical parameters of your cameras and then change them, ofc, you must re-compute new parameters. I tried found the solution of this task, when I research this area and didn't found unique solution. My suggestion how it could be solved:

  1. Use online(auto-) calibration technique by auto detecting feature points and compute camera parameters by this points. But this can be computationally intensive and dependent on the computational resources of your hardware platform.
  2. Also I found this presentation - they use visual odometry for reduce image displacement, but I not well understand the idea and not found the papers about this. If you understand that's may help.
  3. Use Deep Learning for warp your camera image for get a good view - this is may be hard and nobody did it. It would be a novel and it has a interesting research area.
fanDongHust commented 2 years ago

Thanks for your reply very much. I have found some papers with open source code already. But the results are not good enough in practice.