autowarefoundation / autoware

Autoware - the world's leading open-source software project for autonomous driving
https://www.autoware.org/
Apache License 2.0
9.09k stars 3.04k forks source link

Performance analysis of a multi-container Autoware deployment #5059

Open oguzkaganozt opened 2 months ago

oguzkaganozt commented 2 months ago

Discussed in https://github.com/orgs/autowarefoundation/discussions/5012

Originally posted by **oguzkaganozt** July 18, 2024 ## Motivation Now that the **Open AD Kit** containers are being used by different parties on different demos/activities etc. Testing **multi-containe**r behaviour and conducting a performance analysis can lead the way through the best possible aproach on how to upsteam multi-container deployment to the Autoware. ## Possible Approach **Phase 1** Utilizing [Reaction Analyzer Tool](https://github.com/autowarefoundation/autoware.universe/blob/3eed12c36903a3763f0ccd73f7bdce75c0bb3622/tools/reaction_analyzer/README.md#L4) for measuring end-to-end latency of the system with 2 containers being [planning-control & perception-localization](https://github.com/autowarefoundation/autoware/tree/feat/planning-perception-modules) by using pre-recorded rosbags and map. **Phase 2** Replicating [TUM](https://arxiv.org/abs/2404.12683)'s take on modular Autoware's setup on a smaller scale by using **7 modular containers** with the help of [Reaction Analyzer Tool](https://github.com/autowarefoundation/autoware.universe/blob/3eed12c36903a3763f0ccd73f7bdce75c0bb3622/tools/reaction_analyzer/README.md#L4) for measuring end-to-end latency of the system ## Definition of done Performance analysis report comparing **bare-metal, Phase-1 and Phase-2** deployment results in a summarized format.
oguzkaganozt commented 2 days ago

Performance Test Comparison Report_ Autoware Universe vs OpenADKit v2.pdf Open_AD_Kit_Project_Documentation.pdf