Hyperlinking reality via camera phones

ABSTRACT

Novel user interface concept for camera phones, demonstrated in this video, is based on state-of-the-art computer vision techniques. Instead of typing keywords on a small and inconvenient keypad, the user just snaps a photo of his surroundings and objects on the photo become hyperlinks to information. The photo of the user's environment on the camera phone's screen thus becomes a natural interaction device allowing intuitive access to information with a simple tap of a finger.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Algorithms, Design, Performance

Keywords:
augmented reality, computer vision, mobile devices, user interfaces