HeadPhones: Ad Hoc Mobile Multi-Display Environments through Head Tracking

Abstract

We present HeadPhones (Headtracking + smartPhones), a novel approach for the spatial registration of multiple mobile devices into an ad hoc multi-display environment. We propose to employ the user's head as external reference frame for the registration of multiple mobile devices into a common coordinate system. Our approach allows for dynamic repositioning of devices during runtime without the need for external infrastructure such as separate cameras or fiducials. Specifically, our only requirements are local network connections and mobile devices with built-in front facing cameras. This way, HeadPhones enables spatially-aware multi-display applications in mobile contexts. A user study and accuracy evaluation indicate the feasibility of our approach.

Media

30 Second Teaser

Main Video (4:46 min)

Code

The code for HeadPhones is available here.

Publications

  • Jens Grubert & Matthias Kranz. HeadPhones: Ad Hoc Mobile Multi-Display Environments through Head Tracking. In Proceedings of ACM CHI 2017, May 6-11 2017, Denver, pp. 3966-3971. open access paper | teaser video | full video
  • Jens Grubert & Matthias Kranz. Towards Ad Hoc Mobile Multi-display Environments on Commodity Mobile Devices. In Proceedings of IEEE VR 2017, March 20-23 2017, Los Angeles, pp. 461 - 462. paper | DOI
  • Jens Grubert & Matthias Kranz. mpCubee: Towards a Mobile Perspective Cubic Display using Mobile Phones. In Proceedings of IEEE VR 2017, March 20-23 2017, Los Angeles, pp. 459-460. paper | DOI