This project integrates our Augmented Reality app (AugRE) with a fixed-wing drone platform controlled via QGroundControl (QGC). A dedicated onboard computer performs real-time object detection (e.g., cars from the gimbal camera) and, using depth estimation, converts detections into GPS-based markers viewable on an ATAK tablet or a Virtual SandTable.
The system also supports voice and hand gesture control, allowing users to issue commands such as takeoff, land, and orbit through intuitive interactions.
Video Material: AugRE: Fixed Wing Drone Visualization on 3D Map and with Real World Overlay via HoloLens 2 Headsets