Mobile refinding of web information using a voice interface: an exploratory study

ABSTRACT

Refinding information found on the web is a considerable problem for many users, especially when in mobile situations. In this paper, we explore how a voice-controlled service, accessible by telephone, could help to support mobile users' needs for refinding specific information previously found on the web. We outline challenges in creating such a service and describe architectural and user interfaces issues involved in an exploratory prototype system called WebContext.We also present the results of a study - motivated by our experience with WebContext - to explore what people remember about information that they are trying to refind and how they express information refinding requests in a collaborative conversation. The results and observations from our study: 1) add support and extend prior research on the importance of waypoints in the refinding process, 2) provide evidence that refinding may be accomplished using an iterative, two-stage model in which users first search for the information source, and then browse for the particular information being sought, revealing details of their information need as they make progress, and 3) give insights into the use of annotations added to web pages by the user to help in a collaborative refinding process. We also note the importance of context and artifacts in the refinding process and comment on the possible implications of our findings for the design of tools and interfaces for information refinding with a special emphasis on implications for voice interfaces for mobile refinding.

REFERENCES

• 1: Serge Abiteboul, Querying Semi-Structured Data, Proceedings of the 6th International Conference on Database Theory, p.1-18, January 08-10, 1997
• 2: Eytan Adar , David Kargar , Lynn Andrea Stein, Haystack: per-user information environments, Proceedings of the eighth international conference on Information and knowledge management, p.413-422, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319950.323231]
• 3: Thomas Bonura , James R. Miller, Drop zones: an extension to LiveDoc, ACM SIGCHI Bulletin, v.30 n.2, p.59-63, April 1998 [doi>10.1145/279044.279157]
• 4: Jay Budzik , Kristian J. Hammond, User interactions with everyday applications as context for just-in-time information access, Proceedings of the 5th international conference on Intelligent user interfaces, p.44-51, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325776]
• 5: Robert G. Capra, III , Manuel A. Pérez-Quiñones , Naren Ramakrishnan, WebContext: remote access to shared context, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971517]
• 6: Ed H. Chi , Peter Pirolli , Kim Chen , James Pitkow, Using information scent to model user information needs and actions and the Web, Proceedings of the SIGCHI conference on Human factors in computing systems, p.490-497, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365325]
• 7: Clark, H. H. and Schaefer, E. F. (1987). Collaborating on Contributions to Conversations. Language and Cognitive Processes 2(1): 19--41.
• 8: Susan Dumais , Edward Cutrell , JJ Cadiz , Gavin Jancke , Raman Sarin , Daniel C. Robbins, Stuff I've seen: a system for personal information retrieval and re-use, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860451]
• 9: GVU Center at Georgia Tech. (1998). GVU's 10th WWW User Survey (October 1998). Retrieved 19 March 2002, from <http://www.gvu.gatech.edu/user_surveys/survey-1998-10/>.
• 10: William Jones , Harry Bruce , Susan Dumais, Keeping found things found on the web, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502607]
• 11: Jones, W., Bruce, H. and Dumais, S. (2003). How Do People Get Back to Information on the Web? How Can They Do It Better? In Proceedings of the 9th IFIP TC13 International Conference on Human-Computer Interaction (INTERACT 2003), Zurich, Switzerland, September 1-5, 2003.
• 12: Susanne Jul , George W. Furnas, Navigation in electronic worlds: a CHI 97 workshop, ACM SIGCHI Bulletin, v.29 n.4, p.44-49, Oct. 1997 [doi>10.1145/270950.270979]
• 13: Lawrence, S. (2000). Context in Web Search. IEEE Data Engineering Bulletin 23(3): 25--32.
• 14: Henry Lieberman , Bonnie A. Nardi , David Wright, Training agents to recognize text by example, Proceedings of the third annual conference on Autonomous Agents, p.116-122, April 1999, Seattle, Washington, United States [doi>10.1145/301136.301176]
• 15: Maglio, P. and Barrett, R. (1997). How to Build Modeling Agents to Support Web Searchers. In Proceedings of the Sixth International Conference on User Modeling (UM97, June 2-5, 1997). Springer Wien New York, 5--16.
• 16: J. Terry Mayes , Stephen W. Draper , Alison M. McGregor , Keith Oatley, Information flow in a user interface: the effect of experience and context on the recall of MacWrite screens, Proceedings of the Fourth Conference of the British Computer Society on People and computers IV, p.275-289, October 1988, Univ. of Manchester, United Kingdom
• 17: Metz, C. (2005). Total Recall. PC Magazine, March 2, 2005. Article accessed from <http://www.pcmag.com/article2/0,1759,1771688,00.asp> on May 1, 2005.
• 18: James R. Miller , Thomas Bonura, From documents to objects: an overview of LiveDoc, ACM SIGCHI Bulletin, v.30 n.2, p.53-58, April 1998 [doi>10.1145/279044.279155]
• 19: Bonnie A. Nardi , James R. Miller , David J. Wright, Collaborative, programmable intelligent agents, Communications of the ACM, v.41 n.3, p.96-104, March 1998 [doi>10.1145/272287.272331]
• 20: Svetlozer Nestorov , Serge Abiteboul , Rajeev Motwani, Inferring structure in semistructured data, ACM SIGMOD Record, v.26 n.4, p.39-43, Dec. 1997 [doi>10.1145/271074.271084]
• 21: Milind S. Pandit , Sameer Kalbag, The selection recognition agent: instant access to relevant information and operations, Proceedings of the 2nd international conference on Intelligent user interfaces, p.47-52, January 06-09, 1997, Orlando, Florida, United States [doi>10.1145/238218.238285]
• 22: Mark Perry , Kenton O'hara , Abigail Sellen , Barry Brown , Richard Harper, Dealing with mobility: understanding access anytime, anywhere, ACM Transactions on Computer-Human Interaction (TOCHI), v.8 n.4, p.323-347, December 2001 [doi>10.1145/504704.504707]
• 23: D. A. Quan , R. Karger, How to make a semantic web browser, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988707]
• 24: Ramakrishnan, N. (2002). The Traits of the Personable. Technical Report cs.AI/0205022, Computing Research Repository (CoRR).
• 25: Bradley J. Rhodes, Margin notes: building a contextually aware associative memory, Proceedings of the 5th international conference on Intelligent user interfaces, p.219-224, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325850]
• 26: Rhodes, B. J. and Starner, T. (1996). The Remembrance Agent: A continuously running automated information retrieval system. In Proceedings of The First International Conference on The Practical Application of Intelligent Agents and Multi Agent Technology (PAAM'96). (pp. 487--495). April 1996.
• 27: Jaime Teevan , Christine Alvarado , Mark S. Ackerman , David R. Karger, The perfect search engine is not enough: a study of orienteering behavior in directed search, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985745]
• 28: Wen, J. (2003), Post-Valued Recall Web Pages: User Disorientation Hits The Big Time, IT & Society 1(3):184--194.

INDEX TERMS

Keywords:
conversation analysis, information management, information refinding, speech recognition, voice user interfaces