Model-directed web transactions under constrained modalities

ABSTRACT

Online transactions (e.g., buying a book on the Web) typically involve a number of steps spanning several pages. Conducting such transactions under constrained interaction modalities as exemplified by small screen handhelds or interactive speech interfaces - the primary mode of communication for visually impaired individuals - is a strenuous, fatigue-inducing activity. But usually one needs to browse only a small fragment of a Web page to perform a transactional step such as a form fillout, selecting an item from a search results list, etc. We exploit this observation to develop an automata-based process model that delivers only the "relevant" page fragments at each transactional step, thereby reducing information overload on such narrow interaction bandwidths. We realize this model by coupling techniques from content analysis of Web documents, automata learning and statistical classification. The process model and associated techniques have been incorporated into Guide-O, a prototype system that facilitates online transactions using speech/keyboard interface (Guide-O-Speech), or with limited-display size handhelds (Guide-O-Mobile). Performance of Guide-O and its user experience are reported.

REFERENCES

• 1: S. Agarwal, S. Handschuh, and S. Staab. Surfing the service web. In Intl. Semantic Web Conf. (ISWC), 2003.
• 2: D. Angluin. On the complexity of minimum inference of regular sets. Information and Control, 39(3):337--350, 1978.
• 3: Chieko Asakawa , Takashi Itoh, User interface of a Home Page Reader, Proceedings of the third international ACM conference on Assistive technologies, p.149-156, April 15-17, 1998, Marina del Rey, California, United States [doi>10.1145/274497.274526]
• 4: George Buchanan , Sarah Farrant , Matt Jones , Harold Thimbleby , Gary Marsden , Michael Pazzani, Improving mobile internet usability, Proceedings of the 10th international conference on World Wide Web, p.673-680, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372181]
• 5: Orkut Buyukkokten , Hector Garcia-Molina , Andreas Paepcke , Terry Winograd, Power browser: efficient Web browsing for PDAs, Proceedings of the SIGCHI conference on Human factors in computing systems, p.430-437, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332470]
• 6: L. Chen, N. Shadbolt, C. A. Goble, F. Tao, S. J. Cox, C. Puleston, and P. R. Smart. Towards a knowledge-based approach to semantic service composition. In Intl. Semantic Web Conf. (ISWC), 2003.
• 7: Yu Chen , Wei-Ying Ma , Hong-Jiang Zhang, Detecting web page structure for adaptive viewing on small form factor devices, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775184]
• 8: Ed H. Chi , Peter Pirolli , Kim Chen , James Pitkow, Using information scent to model user information needs and actions and the Web, Proceedings of the SIGCHI conference on Human factors in computing systems, p.490-497, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365325]
• 9: Philipp Cimiano , Siegfried Handschuh , Steffen Staab, Towards the self-annotating web, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988735]
• 10: Stephen Dill , Nadav Eiron , David Gibson , Daniel Gruhl , R. Guha , Anant Jhingran , Tapas Kanungo , Sridhar Rajagopalan , Andrew Tomkins , John A. Tomlin , Jason Y. Zien, SemTag and seeker: bootstrapping the semantic web via automated semantic annotation, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775178]
• 11: M. Dzbor, J. Domingue, and E. Motta. Magpie - towards a semantic web browser. In Intl. Semantic Web Conf. (ISWC), 2003.
• 12: Murielle Florins , Jean Vanderdonckt, Graceful degradation of user interfaces as a design method for multiplatform systems, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964469]
• 13: B. Hammond, A. Sheth, and K. Kochut. Semantic enhancement engine: A modular document enhancement platform for semantic applications over heterogenous content. In V. Kashyap and L. Shklar, editors, Real World Semantic Applications. IOS Press, 2002.
• 14: J. Heflin, J. A. Hendler, and S. Luke. SHOE: A blueprint for the semantic web. In D. Fensel, J. A. Hendler, H. Lieberman, and W. Wahlster, editors, Spinning the Semantic Web.
• 15: A. Hess, E. Johnston, and N. Kushmerick. Assam: A tool for semi-automatically annotating semantic web services. In Intl. Semantic Web Conf. (ISWC), 2004.
• 16: José Kahan , Marja-Ritta Koivunen, Annotea: an open RDF infrastructure for shared Web annotations, Proceedings of the 10th international conference on World Wide Web, p.623-632, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372166]
• 17: Alberto H. F. Laender , Berthier A. Ribeiro-Neto , Altigran S. da Silva , Juliana S. Teixeira, A brief survey of web data extraction tools, ACM SIGMOD Record, v.31 n.2, June 2002 [doi>10.1145/565117.565137]
• 18: Saikat Mukherjee , I. V. Ramakrishnan , Amarjeet Singh, Bootstrapping Semantic Annotation for Content-Rich HTML Documents, Proceedings of the 21st International Conference on Data Engineering (ICDE'05), p.583-593, April 05-08, 2005 [doi>10.1109/ICDE.2005.28]
• 19: K. Murphy. Passively Learning Finite Automata, 1995.
• 20: J. Oncina and P. Garc. Inferring regular languages in polynomial update time. World Scientific Publishing, 1991. Pattern Recognition and Image Analysis.
• 21: Abhijit A. Patil , Swapna A. Oundhakar , Amit P. Sheth , Kunal Verma, Meteor-s web service annotation framework, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988747]
• 22: E. Pontelli , D. Gillan , W. Xiong , E. Saad , G. Gupta , A. I. Karshmer, Navigation of HTML tables, frames, and XML fragments, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638256]
• 23: B. Popov, A. Kiryakov, A. Kirilov, D. Manov, D. Ognyanoff, and M. Goranov. Kim - semantic annotation platform. In Intl. Semantic Web Conf. (ISWC), 2003.
• 24: I. V. Ramakrishnan , Amanda Stent , Guizhen Yang, Hearsay: enabling audio browsing on hypertext content, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988684]
• 25: T. V. Raman, Audio system for technical readings, Cornell University, Ithaca, NY, 1994
• 26: Lakshmish Ramaswamy , Arun Iyengar , Ling Liu , Fred Douglis, Automatic detection of fragments in dynamically generated web pages, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988732]
• 27: Jinghai Rao , Peep Küngas , Mihhail Matskin, Logic-based Web Services Composition: From Service Description to Process Model, Proceedings of the IEEE International Conference on Web Services (ICWS'04), p.446, June 06-09, 2004 [doi>10.1109/ICWS.2004.71]
• 28: John T. Richards , Vicki L. Hanson, Web accessibility: a broader view, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988683]
• 29: Marta Sabou , Chris Wroe , Carole Goble , Gilad Mishne, Learning domain ontologies for Web service descriptions: an experiment in bioinformatics, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1060745.1060776]
• 30: Ruihua Song , Haifeng Liu , Ji-Rong Wen , Wei-Ying Ma, Learning block importance models for web pages, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988700]
• 31: Hironobu Takagi , Chieko Asakawa , Kentarou Fukuda , Junji Maeda, Site-wide annotation: reconstructing existing pages to be accessible, Proceedings of the fifth international ACM conference on Assistive technologies, July 08-10, 2002, Edinburgh, Scotland [doi>10.1145/638249.638265]
• 32: P. Traverso and M. Pistore. Automated composition of semantic web services into executable processes. In Intl. Semantic Web Conf. (ISWC), 2004.
• 33: W. M. P. van der Aalst , A. J. M. M. Weijters, Process mining: a research agenda, Computers in Industry, v.53 n.3, p.231-244, April 2004 [doi>10.1016/j.compind.2003.10.001]
• 34: Andreas Wombacher , Peter Fankhauser , Erich Neuhold, Transforming BPEL into Annotated Deterministic Finite State Automata for Service Discovery, Proceedings of the IEEE International Conference on Web Services (ICWS'04), p.316, June 06-09, 2004 [doi>10.1109/ICWS.2004.117]
• 35: Christopher C. Yang , Fu Lee Wang, Fractal summarization for mobile devices to access large documents on the web, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775183]
• 36: Lan Yi , Bing Liu , Xiaoli Li, Eliminating noisy information in Web pages for data mining, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C. [doi>10.1145/956750.956785]
• 37: Xinyi Yin , Wee Sun Lee, Using link analysis to improve layout on mobile devices, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988718]
• 38: Shipeng Yu , Deng Cai , Ji-Rong Wen , Wei-Ying Ma, Improving pseudo-relevance feedback in web information retrieval using web page segmentation, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775155]
• 39: M. Zajicek, C. Powell, and C. Reeves. Web search and orientation with brookestalk. In Proceedings of Tech. and Persons with Disabilities Conf., 1999.
• 40: Zhen Zhang , Bin He , Kevin Chen-Chuan Chang, Understanding Web query interfaces: best-effort parsing with hidden syntax, Proceedings of the 2004 ACM SIGMOD international conference on Management of data, June 13-18, 2004, Paris, France [doi>10.1145/1007568.1007583]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Document analysis

General Terms:
Algorithms, Human Factors

Keywords:
assisstive device, content adaption, web transaction