About evaluating the performance Details of different control policies

microsoft / AirSim-Drone-Racing-VAE-Imitation

Code associated with our paper "Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations": https://arxiv.org/abs/1909.06993

MIT License

199 stars 57 forks source link

About evaluating the performance Details of different control policies #7

Closed daydreamer2023 closed 3 years ago

daydreamer2023 commented 3 years ago

How should I evaluate the performance of different control policies in Fig.7 ? I am a new hand using Airim. I did not find enough details in the paper and code to reproduce it. Can you give some clues?

rogeriobonatti commented 3 years ago

I did not include the code for this in the repo because I did the evaluation by manually counting the number of gates the drone went through, and manually filling in a spreadsheet before plotting using the "seaborn" library. However, it would also be possible to write some code to automatically generate this evaluation. You would need to set a criterion for resetting the episode, and write something to count when the drone actually goes through the gate by looking at its position.