• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
UT Shield
The University of Texas at Austin
  • Research
  • People
  • Facilities
  • Publications
  • Our Github
  • Contact

Defense

January 12, 2026, Filed Under: AugRe, Autonomous Platforms, Defense, Nuclear, Research

AugRE

AugRE (Augmented Robot Environment) is a scalable mixed reality-based human-robot teaming system that enables users to easily command, control, and supervise large multi-agent unmanned ground and aerial vehicles. The current system enables multiple users to collaborate with up to 50 robotic agents simultaneously in unknown indoor and outdoor environments. The system features real-time localization, an efficient by directional communication layer, and spatially aligned holographic representations that enable users to easily visualize and interact with real-time robot sensor data. Check out the AugRE project page to learn more: https://utnuclearroboticspublic.github.io/Augmented-Robot-Environment/

  • Github (https://utnuclearroboticspublic.github.io/Augmented-Robot-Environment/)
  • Publications:
    • AugRE: Augmented Robot Environment to Facilitate Human-Robot Teaming and Communication: https://ieeexplore.ieee.org/document/9900721
    • Augmented Reality User Interface for Command, Control, and Supervision of Large Multi-Agent Teams: https://arxiv.org/abs/2401.05665
    • AugRE Video AugRE: Augmented Robot Environment to Facilitate Human-Robot Teaming and Communication
  • Videos: Youtube Playlist

December 2, 2025, Filed Under: AugRe, Defense, Research

AugRe Drone Integration

This project integrates our Augmented Reality app (AugRE) with a fixed-wing drone platform controlled via QGroundControl (QGC). A dedicated onboard computer performs real-time object detection (e.g., cars from the gimbal camera) and, using depth estimation, converts detections into GPS-based markers viewable on an ATAK tablet or a Virtual SandTable.

The system also supports voice and hand gesture control, allowing users to issue commands such as takeoff, land, and orbit through intuitive interactions.

Video: AugRE: Fixed Wing Drone Visualization on 3D Map and with Real World Overlay via HoloLens 2 Headsets

Primary Sidebar

Recent Posts

  • Digital Twin Augmented Reality – Radiation in AR
  • AugRE
  • Affordance Templates for Complex DOE Robotics Tasks
  • AugRe Drone Integration
  • Autonomous Alpha Radiation Sensing and Reporting

UT Home | Emergency Information | Site Policies | Web Accessibility | Web Privacy | Adobe Reader

© The University of Texas at Austin 2026