metadriverse / metadrive

MetaDrive: Open-source driving simulator
https://metadriverse.github.io/metadrive/
Apache License 2.0
797 stars 112 forks source link

Issues in headless / offscreen rendering; add example #644

Closed pengzhenghao closed 9 months ago

pengzhenghao commented 9 months ago

What changes do you make in this PR?

resolve: https://github.com/metadriverse/metadrive/issues/632

might solve: https://github.com/metadriverse/metadrive/issues/643

Known issue: #645 #649

Checklist

pengzhenghao commented 9 months ago

Two severe bugs:

  1. BEV images will be injected into the image buffer (engine.win) so depth image is overwritten:
  2. Semantic map is wrong after 2nd steps.

BEV: bev_30

DEPTH: depth_30

RGB: rgb_30

Semantic at 1step: semantic_0

Semantic at 30step: semantic_30

pengzhenghao commented 9 months ago

The above result can be reproduced from:

metadrive/tests/local_tests/local_test_headless_rendering.py

in this branch fix-offscreen

jnewb1 commented 9 months ago

this also seems to be related to my failures over here running in docker: https://github.com/metadriverse/metadrive/pull/619