usdot-fhwa-stol / carma-analytics-fotda

CARMA Analytics is a secure, scalable and cloud agnostic data architecture to enable research analysis on big data sets by defining repeatable and scalable processes for ingesting data, creation of a data repository to fuse, process and perform quality assurance.

Apache License 2.0

3 stars 3 forks source link

Cf 908 c1t metrics #77

Closed john-chrosniak closed 1 month ago

john-chrosniak commented 1 month ago

PR Details

Description

This PR adds scripts to compute the metrics specified in the C1T test plan.

Related GitHub Issue

NA

Related Jira Key

Motivation and Context

As part of the C1T Port Drayage test plan, the team has determined a list of metrics that will be used to characterize the performance expectations of the system. Additional data analysis scripts are needed to parse the ROS bags recorded from the C1T vehicles and verify the performance expectations are being met.

How Has This Been Tested?

Tested using a bag collected running a simple port drayage test on the turtlebot in the Gazebo simulator.

Types of changes

[ ] Defect fix (non-breaking change that fixes an issue)
[x] New feature (non-breaking change that adds functionality)
[ ] Breaking change (fix or feature that cause existing functionality to change)

Checklist:

[ ] I have added any new packages to the sonar-scanner.properties file
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

john-chrosniak commented 1 month ago

test_results

Main script that runs all metric tests

john-chrosniak commented 1 month ago

speed_plot Vehicle target vs. actual speed plots

willjohnsonk commented 1 month ago

Also I would pass any generated graphs by Jackie and Andrew before finalizing

john-chrosniak commented 1 month ago

speed_vs_time New speed vs. time plot

john-chrosniak commented 1 month ago

labeled_speeds Route driven with vehicle speed used to color the lines and slowdown points annotated

john-chrosniak commented 1 month ago

vehicle_speed slowdown_speed Plots from red truck tracking the garage route