DroCo - Multi-Drone Control Vizualization Tool

visualization tool, drone control, multi-drone system, augmented virtuality

DroCo is a tool for effective drone remote control using mixed reality, that also supports communication and cooperation on a mission with multiple drones. The proposed solution is inspired by the high mental load of the pilot in the control of the drone, especially in the performance of more complex missions (multiple drones, remote target, proximity to infrastructure etc.). The system is based on the extension of the 3D virtual model with real data (augmented virtuality). It uses temporal and spatial registration of:    1. off-line data (map data, elevation data, 3D building models),    2. on-line data (video-stream, reconstructed 3D structures, location      information, flight data), and    3. virtual control objects (navigation points and directions, spatial areas and      geo-fences, position of other drones, distance to nearby objects, preview      map, or view from other drones).       The system thus allows you to pilot the drone in FPV (first-person-view),      but at any time it can switch to TPV (third-person-view), so that one can look      around freely in a situation with poor orientation, further directs the pilot to other      mission objectives, points out close objects or other drones, etc. The system is currently      being expanded with the functions of multiple drones, sharing more sensory information across      the system, increasing the security of network communication. The development also aims to use      a system for drone control training for pilots, increase the realism of drone behavior in simulated mode,      more efficient mission management and visualization of the status for the operator of the whole event.       

https://github.com/robofit/drone_vstool

For information on license conditions, please contact: Ing. Kristýna Dvořáčkova, MSc., Information Technology Research Center, Faculty of Information Technology, Brno University of Technology, Božetěchova 2, 612 66 Brno, tel. 541 141 466.