There are lots of ways to use AI with drone, too many to cover in this single enhancement request but I think a good start would be making it easier for developers to test externally developed models with ArduPilot vehicles in SITL.
This enhancement request involves creating scripts and wiki documentation to help developers setup a development and testing environment for vision based AI models to be integrated with ArduPilot vehicles (primarily multicopters, rovers and boats).
[ ] decide which AI models will be supported (perhaps TensorFlow and/or OpenCV AI
[ ] choose a simulator (probably webots or AirSim)
[ ] ensure the simulator's onboard camera output is available to the AI model
[ ] ensure the AI model's outputs can control the vehicle
[ ] create scripts to setup the development environment
[ ] create documentation on how to setup and use the development environment
[ ] create a ready-to-use example demonstrating the use of the environment. Ideas include
yalexx
commented
1 year ago
There are lots of ways to use AI with drone, too many to cover in this single enhancement request but I think a good start would be making it easier for developers to test externally developed models with ArduPilot vehicles in SITL.
This enhancement request involves creating scripts and wiki documentation to help developers setup a development and testing environment for vision based AI models to be integrated with ArduPilot vehicles (primarily multicopters, rovers and boats).