A visual retrieval environment for hypermedia information systems

ABSTRACT

We present a graph-based object model that may be used as a uniform framework for direct manipulation of multimedia information. After an introduction motivating the need for abstraction and structuring mechanisms in hypermedia systems, we introduce the data model and the notion of perspective, a form of data abstraction that acts as a user interface to the system, providing control over the visibility of the objects and their properties. A perspective is defined to include an intension and an extension. The intension is defined in terms of a pattern, a subgraph of the schema graph, and the extension is the set of pattern-matching instances. Perspectives, as well as database schema and instances, are graph structures that can be manipulated in various ways. The resulting uniform approach is well suited to a visual interface. A visual interface for complex information systems provides high semantic power, thus exploiting the semantic expressibility of the underlying data model, while maintaining ease of interaction with the system. In this way, we reach the goal of decreasing cognitive load on the user, with the additional advantage of always maintaining the same interaction style. We present a visual retrieval environment that effectively combines filtering, browsing, and navigation to provide an integrated view of the retrieval problem. Design and implementation issues are outlined for MORE (Multimedia Object Retrieval Environment), a prototype system relying on the proposed model. The focus is on the main user interface functionalities, and actual interaction sessions are presented including schema creation, information loading, and information retrieval.

REFERENCES

• 1: Foto Afrati , Constantinos D. Koutras, A hypertext model supporting query mechanisms, Hypertext: concepts, systems and applications, Cambridge University Press, New York, NY, 1992
• 2: Bernd Amann , Michel Scholl, Gram: a graph data model and query languages, Proceedings of the ACM conference on Hypertext, p.201-211, November 30-December 04, 1992, Milan, Italy [doi>10.1145/168466.168527]
• 3: Marc Andries , Marc Gemis , Jan Paredaens , Inge Thyssens , Jan Van den Bussche, Concepts for Graph-Oriented Object Manipulation, Proceedings of the 3rd International Conference on Extending Database Technology: Advances in Database Technology, p.21-38, March 23-27, 1992
• 4: Michele Angelaccio , Tiziana Catarci , Giuseppe Santucci, QBD*: A Graphical Query Language with Recursion, IEEE Transactions on Software Engineering, v.16 n.10, p.1150-1163, October 1990 [doi>10.1109/32.60295]
• 5: Aron}xo, A., AMI~L, E., ANOBH.W;AVA, B. 1991. Experiences with SUPER, a database visual environment. In Proceedings of the 2nd International Conference on Database and Expert Systems. Springer-Verlag, Berlin, 172-178.
• 6: Carlo Batini , Tiziana Catarci , Maria Francesca Costabile , Stefano Levialdi, Visual Query Systems: A Taxonomy, Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II, p.153-168, September 30-October 03, 1991
• 7: C. Beeri, A formal approach to object-oriented databases, Data & Knowledge Engineering, v.5 n.4, p.353-382, Oct. 1990 [doi>10.1016/0169-023X(90)90020-E]
• 8: Catriel Beeri , Yoram Kornatzky, A logical query language for hypertext systems, Hypertext: concepts, systems and applications, Cambridge University Press, New York, NY, 1992
• 9: Nicholas J. Belkin , W. Bruce Croft, Information filtering and information retrieval: two sides of the same coin?, Communications of the ACM, v.35 n.12, p.29-38, Dec. 1992 [doi>10.1145/138859.138861]
• 10: E. Bertino , M. Negri , G. Pelagatti , L. Sbattella, Object-Oriented Query Languages: The Notion and the Issues, IEEE Transactions on Knowledge and Data Engineering, v.4 n.3, p.223-237, June 1992 [doi>10.1109/69.142014]
• 11: Daniel Bryce , Richard Hull, SNAP: A Graphics-based Schema Manager, Proceedings of the Second International Conference on Data Engineering, p.151-164, February 05-07, 1986
• 12: Brad Campbell , Joseph,M. Goodman, HAM: a general purpose hypertext abstract machine, Communications of the ACM, v.31 n.7, p.856-861, July 1988 [doi>10.1145/48511.48515]
• 13: Tiziana Catarci, On the Expressive Power of Graphical Query Languages, Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II, p.411-421, September 30-October 03, 1991
• 14: S. Christodoulakis , M. Theodoridou , F. Ho , M. Papa , A. Pathria, Multimedia document presentation, information extraction, and document formation in MINOS: a model and a system, ACM Transactions on Information Systems (TOIS), v.4 n.4, p.345-383, Oct. 1986 [doi>10.1145/9760.9764]
• 15: Jeff Conklin, Hypertext: an introduction and survey, Computer, v.20 n.9, p.17-41, Sept. 1987 [doi>10.1109/MC.1987.1663693]
• 16: Mariano Consens , Alberto Mendelzon, Hy+: a Hygraph-based query and visualization system, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.511-516, May 25-28, 1993, Washington, D.C., United States
• 17: M. P. Consens , A. O. Mendelzon, Expressing structural hypertext queries in graphlog, Proceedings of the second annual ACM conference on Hypertext, p.269-292, November 1989, Pittsburgh, Pennsylvania, United States [doi>10.1145/74224.74247]
• 18: Mariano P. Consens , Alberto O. Mendelzon, GraphLog: a visual formalism for real life recursion, Proceedings of the ninth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.404-416, April 02-04, 1990, Nashville, Tennessee, United States [doi>10.1145/298514.298591]
• 19: W. B. Croft , H. Turtle, A retrieval model incorporating hypertext links, Proceedings of the second annual ACM conference on Hypertext, p.213-224, November 1989, Pittsburgh, Pennsylvania, United States [doi>10.1145/74224.74242]
• 20: Bogdan Czejdo , Ramez Elmasri , Marek Rusinkiewicz , David W. Embley, A Graphical Data Manipulation Language for an Extended Entity-Relationship Model, Computer, v.23 n.3, p.26-36, March 1990 [doi>10.1109/2.50270]
• 21: Jay W. Davison , Stanley B. Zdonik, A visual interface for a database with version management, ACM Transactions on Information Systems (TOIS), v.4 n.3, p.226-256, July 1986 [doi>10.1145/214427.214430]
• 22: DELBIMBO,A. ANDLUCARELLA,D. 1991. Afuzzyobject retrieval system forimage understand-ing. In Proceedings of the IEEE Conference on Computers and Communications (Scottsdale, Ariz.).IEEE,NewYork, 835-841.
• 23: EPSTEIN,R. P. 1990. Graphical query languages for object oriented data models. In Proceed-ings of the ZEEE Workshop on Visual Languages (Skokie, 111.),IEEE, New York, 36-41.
• 24: H. P. Frei , D. Stieger, Making use of hypertext links when retrieving information, Proceedings of the ACM conference on Hypertext, p.102-111, November 30-December 04, 1992, Milan, Italy [doi>10.1145/168466.168502]
• 25: Richard Furuta , P. David Stotts, A functional meta-structure for hypertext models and systems, Electronic Publishing—Origination, Dissemination, and Design, v.3 n.4, p.179-205, Nov. 1990
• 26: Pankaj,K. Garg, Abstraction mechanisms in hypertext, Communications of the ACM, v.31 n.7, p.862-870, July 1988 [doi>10.1145/48511.48516]
• 27: Franca Garzotto , Paolo Paolini , Daniel Schwabe, HDM—a model-based approach to hypertext application design, ACM Transactions on Information Systems (TOIS), v.11 n.1, p.1-26, Jan. 1993 [doi>10.1145/151480.151483]
• 28: Kenneth J. Goldman , Sally A. Goldman , Paris C. Kanellakis , Stanley B. Zdonik, ISIS: interface for a semantic information system, Proceedings of the 1985 ACM SIGMOD international conference on Management of data, p.328-342, May 1985, Austin, Texas, United States
• 29: G. Guardalben , D. Lucarella, Information retrieval based on fuzzy reasoning, Data & Knowledge Engineering, v.10 n.1, p.29-44, Feb. 1993 [doi>10.1016/0169-023X(93)90018-K]
• 30: Mingsen Guo , Stanley Y. W. Su , Herman Lam, An Association Algebra For Processing Object-Oriented Databases, Proceedings of the Seventh International Conference on Data Engineering, p.23-32, April 08-12, 1991
• 31: Marc Gyssens , Jan Paredaens , Dirk van Gucht, A graph-oriented object database model, Proceedings of the ninth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.417-424, April 02-04, 1990, Nashville, Tennessee, United States [doi>10.1145/298514.298593]
• 32: Frank,G. Halasz, Reflections on NoteCards: seven issues for the next generation of hypermedia systems, Communications of the ACM, v.31 n.7, p.836-852, July 1988 [doi>10.1145/48511.48514]
• 33: Frank Halasz , Mayer Schwartz, The Dexter hypertext reference model, Communications of the ACM, v.37 n.2, p.30-39, Feb. 1994 [doi>10.1145/175235.175237]
• 34: Kyoji Hirata , Yoshinori Hara , Naoki Shibata , Fusako Hirabayashi, Media-based navigation for hypermedia systems, Proceedings of the fifth ACM conference on Hypertext, p.159-173, November 14-18, 1993, Seattle, Washington, United States [doi>10.1145/168750.168818]
• 35: Richard Hull , Roger King, Semantic database modeling: survey, applications, and research issues, ACM Computing Surveys (CSUR), v.19 n.3, p.201-260, Sept. 1987 [doi>10.1145/45072.45073]
• 36: Roger King , Michael Novak, Designing database interfaces with DBface, ACM Transactions on Information Systems (TOIS), v.11 n.2, p.105-132, April 1993 [doi>10.1145/130226.134481]
• 37: M. Kuntz , R. Melchert, Pasta-3's graphical query language: direct manipulation cooperative queries, full expressive power, Proceedings of the 15th international conference on Very large data bases, p.97-105, July 1989, Amsterdam, The Netherlands
• 38: LANGE,D. 1990. A formal model for hypertext. In Proceedings of the Hypertext Standardiza-tion Workshop (Gaithersburg, Md.). NIST, Washington, D.C., 145-166.
• 39: K. Lieberherr , C. Xiao, Formal Foundations for Object-Oriented Data Modeling, IEEE Transactions on Knowledge and Data Engineering, v.5 n.3, p.462-478, June 1993 [doi>10.1109/69.224198]
• 40: Dario Lucarella, A document retrieval system based on nearest neighbour searching, Journal of Information Science, v.14 n.1, p.25-33, January 1988 [doi>10.1177/016555158801400104]
• 41: Dario Lucarella, A model for hypertext-based information retrieval, Hypertext: concepts, systems and applications, Cambridge University Press, New York, NY, 1992
• 42: D. Lucarella , A. Zanzi, Information retrieval from hypertext: an approach using plausible inference, Information Processing and Management: an International Journal, v.29 n.3, p.299-312, May–June, 1993 [doi>10.1016/0306-4573(93)90057-K]
• 43: Dario Lucarella , Stefano Parisotto , Antonella Zanzi, MORE: Multimedia Object Retrieval Environment, Proceedings of the fifth ACM conference on Hypertext, p.39-50, November 14-18, 1993, Seattle, Washington, United States [doi>10.1145/168750.168766]
• 44: Dario Lucarella , Antonella Zanzi , Mauro Zanzi, A visual environment for multimedia object retrieval, Proceedings of the workshop on Advanced visual interfaces, p.210-212, June 01-04, 1994, Bari, Italy [doi>10.1145/192309.192350]
• 45: Jakob Nielsen, Hypertext and hypermedia, Academic Press Professional, Inc., San Diego, CA, 1990
• 46: Frances Newbery Paulisch, Design of an Extendible Graph Editor, Springer-Verlag New York, Inc., Secaucus, NJ, 1993
• 47: Gerald Salton, Automatic text processing, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1988
• 48: John L. Schnase , John J. Leggett , David L. Hicks , Ron L. Szabo, Semantic data modeling of hypermedia associations, ACM Transactions on Information Systems (TOIS), v.11 n.1, p.27-50, Jan. 1993 [doi>10.1145/151480.151521]
• 49: SCH~ASE, J. L.. LEGGEIT, J. J., HICKS, D. L., NI-XRNBERG,P. J., AND SANcH~z, J. A. 1993b. Design and implementation of the HB1 hyperbase management system. Electron. Puhl. 6, 1, 35-63.
• 50: Helge A. Schütt , Norbert A. Streitz, HyperBase: a hypermedia engine based on a relational database management system, Hypertext: concepts, systems and applications, Cambridge University Press, New York, NY, 1992
• 51: Gail M. Shaw , Stanley B. Zdonik, A Query Algebra for Object-Oriented Databases, Proceedings of the Sixth International Conference on Data Engineering, p.154-162, February 05-09, 1990
• 52: David D. Straube , M. Tamer Özsu, Queries and query processing in object-oriented database systems, ACM Transactions on Information Systems (TOIS), v.8 n.4, p.387-430, Oct. 1990 [doi>10.1145/102675.102678]
• 53: Frank WM. Tompa, A data model for flexible hypertext database systems, ACM Transactions on Information Systems (TOIS), v.7 n.1, p.85-100, Jan. 1989 [doi>10.1145/64789.64993]
• 54: Uffe K. Wiil , John J. Leggett, Hyperform: using extensibility to develop dynamic, open, and distributed hypertext systems, Proceedings of the ACM conference on Hypertext, p.251-261, November 30-December 04, 1992, Milan, Italy [doi>10.1145/168466.171510]
• 55: Harry K. T. Wong , Ivy Kuo, GUIDE: Graphical User Interface for Database Exploration, Proceedings of the 8th International Conference on Very Large Data Bases, p.22-32, September 08-10, 1982

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Hypertext navigation and maps**

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.1 Logical Design
          Subjects: Data models
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation; Selection process
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors, Management

Keywords:
browsing, complex objects, direct object manipulation, graph-oriented models, hypermedia applications, information filtering, visual interface