search

jeetv / GMVD_dataset

Generalized Multi-View Detection (GMVD) dataset curated using GTA V and Unity. Accepted at WACV 2023 Workshop (Real-World Surveillance: Applications and Challenges).
Other
14 stars 0 forks source link

What tools did you use to generate this dataset? #1

Closed ZichengDuan closed 1 year ago

ZichengDuan commented 2 years ago

Hi, I have read your brilliant work and your GMVD dataset, however, I wonder how you generate this dataset in GTAV? Specifically, what tools/plugins did you utilize? And also how are the cameras synchronized? How did you introduces multivew cameras into one scene? since most of the current dataset methods only have one camera perspective for each scene. Much appreciate it!

jeetv commented 2 years ago

Hi, Thank you for interest. We are using scripthook to interact with GTAV, http://www.dev-c.com/gtav/ and http://www.dev-c.com/nativedb/ For multi-camera setup we need to set the camera in a loop for a scene and there is function name "GAMEPLAY::SET_TIME_SCALE" which slows down the game and through that we can get synchronized frames.

ZichengDuan commented 2 years ago

@jeetv Thanks for your reply! I am now trying to reproduce your dataset generation works. Another thing that confuses me is that how do you define the size of the bird eye view plane? i.e how do you define the origin of the BEV plane? This is a critical problem since multiview deataset requires the pedestrian's world coordinates.

jeetv commented 1 year ago

@ZichengDuan, You can get game coordinates by moving the player in the scene and can define the ground plane. Then you can define the origin of the plane and can transform it from game coordinates to world coordinates.

jeetv commented 1 year ago

Since there is no activity closing the issue. Re-open if required