Large-scale outdoor augmented reality scenes using camera pose based on learned descriptors

patent

US11568642B2

United States Patent and Trademark Office (USPTO), Alexandria, US

In order to use the result by another entity, it is always necessary to acquire a license

The licensor requires a license fee for the result

Adobe VUT Brno

Lukáč Michal (FIT)
Wang Oliver
Brejcha Jan, Ing., Ph.D. (RG CPHOTO)
Hold-Geoffroy Yannick
Čadík Martin, doc. Ing., Ph.D. (DCGM)

camera pose estimation, outdoor scenes, augmented reality, learned descriptors

We introduce a solution to large scale Augmented Reality for outdoor scenes by registering camera images to textured Digital Elevation Models (DEMs). To accommodate the inherent differences in appearance between real images and DEMs, we train a cross-domain feature descriptor using Structure From Motion (SFM) guided reconstructions to acquire training data. Our method runs efficiently on a mobile device and outperforms existing learned and hand-designed feature descriptors for this task.