MORE for less: model recovery from visual interfaces for multi-device application design

ABSTRACT

An emerging approach to multi-device application development requires developers to build an abstract semantic model that is translated into specific implementations for web browsers, PDAs, voice systems and other user interfaces. Specifying abstract semantics can be difficult for designers accustomed to working with concrete screen-oriented layout. We present an approach to model recovery: inferring semantic models from existing applications, enabling developers to use familiar tools but still reap the benefits of multi-device deployment. We describe MORE, a system that converts the visual layout of HTML forms into a semantic model with explicit captions and logical grouping. We evaluate MOREs performance on forms from existing Web applications, and demonstrate that in most cases the difference between the recovered model and a hand-authored model is under 5%

REFERENCES

• 1: Timothy W. Bickmore , Bill N. Schilit, Digestor: device-independent access to the World Wide Web, Selected papers from the sixth international conference on World Wide Web, p.1075-1082, September 1997, Santa Clara, California, United States
• 2: G. A. Di Lucca , G. Casazza , M. Di Penta , G. Antoniol, An Approach for Reverse Engineering of Web-Based Applications, Proceedings of the Eighth Working Conference on Reverse Engineering (WCRE'01), p.231, October 02-05, 2001
• 3: Bergman, L.D., Banavar, G., Soroker, D., Sussman, J., Combining Handcrafting and Automatic Generation of User-Interfaces for Pervasive Devices, Proceedings of CADUI III (2002), pp. 155--166.
• 4: Bouillon, L., Vonderdonckt, J., Souchon, N., Recovering Alternative Presentation Models of a Web Page with VAQUITA, Proceedings of CADUI 02, pp. 311--322.
• 5: Angel Puerta , Jacob Eisenstein, Towards a general computational framework for model-based interface development systems, Proceedings of the 4th international conference on Intelligent user interfaces, p.171-178, January 05-08, 1999, Los Angeles, California, United States [doi>10.1145/291080.291108]
• 6: L. Paganelli , F. Paterno, Automatic reconstruction of the underlying interaction design of web applications, Proceedings of the 14th international conference on Software engineering and knowledge engineering, July 15-19, 2002, Ischia, Italy [doi>10.1145/568760.568836]
• 7: Ricca, F., Tonella, P., Baxter I.D., Restructuring Web Applications via Transformation Rules, Proceedings of SCAM 01, 150--160
• 8: Michael Sannella, Skyblue: a multi-way local propagation constraint solver for user interface construction, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.137-146, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192485]
• 9: Gurminder Singh , Chun Hong Kok , Teng Ye Ngan, Druid: a system for demonstrational rapid user interface development, Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology, p.167-177, October 03-05, 1990, Snowbird, Utah, United States [doi>10.1145/97924.97943]
• 10: Robert St. Amant , Henry Lieberman , Richard Potter , Luke Zettlemoyer, Programming by example: visual generalization in programming by example, Communications of the ACM, v.43 n.3, p.107-114, March 2000 [doi>10.1145/330534.330549]
• 11: Stroulia, E., Kapoor, R.V., Reverse Engineering Interaction Plans for Legacy Interface Migration, Proceedings of CADUI 02, pp. 295--310.
• 12: Piyawadee Sukaviriya , James D. Foley , Todd Griffith, A second generation user interface design environment: the model and the runtime architecture, Proceedings of the SIGCHI conference on Human factors in computing systems, p.375-382, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169299]
• 13: Pedro Szekely , Ping Luo , Robert Neches, Beyond interface builders: model-based interface tools, Proceedings of the SIGCHI conference on Human factors in computing systems, p.383-390, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169305]
• 14: UIML, http://www.uiml.org
• 15: XForms, <http://www.w3c.org/Markup/Forms/>
• 16: XIML, <http://www.ximl.org/>

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.7 Distribution, Maintenance, and Enhancement
          Subjects: Restructuring, reverse engineering, and reengineering

General Terms:
Algorithms, Design, Experimentation, Human Factors

Keywords:
model recovery, multi-device application development, reverse engineering, rule systems, semantic modeling