Gestures for mixed-initiative news video browsing on mobile devices

ABSTRACT

Although small screen sizes and limited input methods are challenges for mobile devices, there are affordances like gestures and motion detection through on-device sensors. A prototype system has been implemented on a HTC Dream (T-Mobile G1) mobile phone demonstrating an "adaptive TV-channel" like mixed-initiative interface used to solicit user relevance feedback, provide recommendations and facilitate news video watching. The user is provided on-screen finger gesture operations to vote-up, vote-down or skip a video. Shaking the device resets the video sequence. This creates a cognitively palatable stream of videos and a seamless lower-latency user experience easily operated with one hand.

REFERENCES

• 1: E. Horvitz. Principles of mixed-initiative user interfaces. In Proc. ACM SIGCHI Conf. Human Factors in Computing Systems, 1999.
• 2: H. Knoche and J. McCarthy. Design requirements for mobile tv. In Proc. Mobile HCI, 2005, 2005.
• 3: J. S. A. Lee and N. Jayant. Mixed-initiative multimedia for mobile devices: a voting-based user interface for news videos. In MULTIMEDIA '06: Proceedings of the 14th annual ACM international conference on Multimedia, pages 611--614, 2006.
• 4: J. S. A. Lee and N. Jayant. Mixed-initiative multimedia for mobile devices: design of a semantically-relevant low-latency system for news video recommendations. In Proceedings of IEEE SEC 2009, March 2009.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors, Management

Keywords:
gesture, information retrieval, mixed-initiative, mobile, multimedia, user interaction, user interface