Measuring the conceptual fitness of an application in a computing ecosystem

ABSTRACT

Developing computing applications that can match a set of evolving requirements requires an understanding of the conceptual fitness of these applications relative to the domains they purport to serve. We present the computing ecosystem framework with its associated concepts, use niches, use potential, and activation potential. We show how the ecosystem framework allows us to characterize the usefulness of an application through the concept of fitness. We propose a method for measuring the fitness of an application using a metric called ontological coverage.

We first use a technique called ontological excavation that identifies the user-visible concepts from applications and models them in an ontology. We then use a set of use cases to develop a use case silhouette on the ontology that allows us to measure the ontological coverage of an application as an initial approximation of fitness to a use niche. We present some examples from case studies showing how use case silhouettes can be used to measure the fitness of an application and conclude with some proposals for future work.

REFERENCES

• 1: Arango, G. and Prieto-Diaz, R. Domain Analysis Concepts and Research directions. in Prieto-Diaz, R. and Arango, G. eds. Domain Analysis and Software Systems Modeling, IEEE Computer Society Press, Los Alamitos, CA, 1991, 9--26.
• 2: Hugh R. Beyer , Karen Holtzblatt, Apprenticing with the customer, Communications of the ACM, v.38 n.5, p.45-52, May 1995 [doi>10.1145/203356.203365]
• 3: Hugh Beyer , Karen Holtzblatt, Contextual design: defining customer-centered systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 4: Grady Booch, Object-oriented analysis and design with applications (2nd ed.), Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, 1993
• 5: Grady Booch , James Rumbaugh , Ivar Jacobson, The Unified Modeling Language user guide, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 1999
• 6: Borgatti, S.P., Everett, M.G. and Freeman, L.C. UCINET 5.0 Version 1.00. Analytic Technologies, 1999.
• 7: Brachman, R.J., McGuinness, D.L., Patel-Schneider, P.F. and Resnick, L.A. Living with CLASSIC: When and How to Use a KL-ONE-Like Language. in Sowa, J. ed. Principles of Semantic Networks, Morgan Kaufmann Publishers, 1990.
• 8: Frederick P. Brooks, Jr., The mythical man-month (anniversary ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 9: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 10: Peter Pin-Shan Chen, The entity-relationship model—toward a unified view of data, ACM Transactions on Database Systems (TODS), v.1 n.1, p.9-36, March 1976 [doi>10.1145/320434.320440]
• 11: Bill Curtis , Herb Krasner , Neil Iscoe, A field study of the software design process for large systems, Communications of the ACM, v.31 n.11, p.1268-1287, Nov. 1988 [doi>10.1145/50087.50089]
• 12: Alan M. Davis, Software requirements: analysis and specification, Prentice Hall Press, Upper Saddle River, NJ, 1990
• 13: Dawkins, R. The Blind Watchmaker. W.W. Norton and Company, New York, 1987.
• 14: Dawkins, R. The Selfish Gene. Oxford University Press, New York, 1989.
• 15: Alan Dix , Janet Finlay , Gregory Abowd , Russell Beale, Human-computer interaction, Prentice-Hall, Inc., Upper Saddle River, NJ, 1997
• 16: Ramez Elmasri , Shamkant B. Navathe, Fundamentals of database systems (2nd ed.), Benjamin-Cummings Publishing Co., Inc., Redwood City, CA, 1994
• 17: Mohammad El-Ramly , Eleni Stroulia , Paul Sorenson, From run-time behavior to usage scenarios: an interaction-pattern mining approach, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775095]
• 18: Mohammad El-Ramly , Eleni Stroulia , Paul Sorenson, Recovering software requirements from system-user interaction traces, Proceedings of the 14th international conference on Software engineering and knowledge engineering, July 15-19, 2002, Ischia, Italy [doi>10.1145/568760.568837]
• 19: Eysenck, M.W. and Keane, M.T. Cognitive Psychology: A Student's Handbook. Lawrence Erlbaum Associates Ltd., East Sussex, UK, 1992.
• 20: Ricardo de Almeida Falbo , Giancarlo Guizzardi , Katia Cristina Duarte, An ontological approach to domain engineering, Proceedings of the 14th international conference on Software engineering and knowledge engineering, July 15-19, 2002, Ischia, Italy [doi>10.1145/568760.568822]
• 21: Flach, J.M. The Ecology of Human-Machine Systems I: Introduction. Ecological Psychology, 2 (3). 191-205.
• 22: Freeman, W.J. The Physiology of Perception. Scientific American, 264 (2). 78--85.
• 23: Greenspan, S.J., Mylopoulos, J. and Borgida, A. Capturing More World Knowledge in the Requirements Specification. in Prieto-Diaz, R. and Arango, G. eds. Domain Analysis and Software Systems Modeling, IEEE Computer Society Press, Los Alamitos, CA, 1991, 530--62.
• 24: Terry Halpin, Conceptual schema and relational database design (2nd ed.), Prentice-Hall, Inc., Upper Saddle River, NJ, 1996
• 25: David M. Hilbert , David F. Redmiles, Extracting usability information from user interface events, ACM Computing Surveys (CSUR), v.32 n.4, p.384-421, Dec. 2000 [doi>10.1145/371578.371593]
• 26: Karen Holtzblatt , Hugh Beyer, Making customer-centered design work for teams, Communications of the ACM, v.36 n.10, p.92-103, Oct. 1993 [doi>10.1145/163430.164050]
• 27: Hsi, I. Analyzing the Conceptual Coherence of Computing Applications Through Ontological Excavation College of Computing, Georgia Institute of Technology, Atlanta, 2004.
• 28: Idris His , Colin Potts, Studying the Evolution and Enhancement of Software Features, Proceedings of the International Conference on Software Maintenance (ICSM'00), p.143, October 11-14, 2000
• 29: Idris Hsi , Colin Potts , Melody Moore, Ontological Excavation: Unearthing the core concepts of the application, Proceedings of the 10th Working Conference on Reverse Engineering, p.345, November 13-17, 2003
• 30: J. Hughes , J. O'Brien , T. Rodden , M. Rouncefield , I. Sommerville, Presenting ethnography in the requirements process, Proceedings of the Second IEEE International Symposium on Requirements Engineering, p.27, March 27-29, 1995
• 31: Ivar Jacobson , Grady Booch , James Rumbaugh, The unified software development process, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 32: Hermann Kaindl, An integration of scenarios with their purposes in task modeling, Proceedings of the conference on Designing interactive systems: processes, practices, methods, & techniques, p.227-235, August 23-25, 1995, Ann Arbor, Michigan, United States [doi>10.1145/225434.225460]
• 33: Kirlik, A. Requirements for Psychological Models to Support Design: Towards Ecological Task Analysis. Lawrence Erlbaum, Hillsdale, NJ, 1995.
• 34: Kohl, H. From Archetype to Zetigeist. Little, Brown and Company, Boston, MA, 1992.
• 35: Brenda Laurel , S. Joy Mountford, The Art of Human-Computer Interface Design, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• 36: M. M. Lehman, Laws of Software Evolution Revisited, Proceedings of the 5th European Workshop on Software Process Technology, p.108-124, October 09-11, 1996
• 37: M. M. Lehman , L. A. Belady, Program evolution: processes of software change, Academic Press Professional, Inc., San Diego, CA, 1985
• 38: Nancy G. Leveson, Intent Specifications: An Approach to Building Human-Centered Specifications, IEEE Transactions on Software Engineering, v.26 n.1, p.15-35, January 2000 [doi>10.1109/32.825764]
• 39: Mackenzie, A., Ball, A.S. and Virdee, S.R. Instant Notes in Ecology. BIOS Scientific Publishers Ltd, Oxford, UK, 1998.
• 40: Atif Memon , Ishan Banerjee , Adithya Nagarajan, GUI Ripping: Reverse Engineering of Graphical User Interfaces for Testing, Proceedings of the 10th Working Conference on Reverse Engineering, p.260, November 13-17, 2003
• 41: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 42: G. M. Nijssen , T. A. Halpin, Conceptual schema and relational database design: a fact oriented approach, Prentice-Hall, Inc., Upper Saddle River, NJ, 1989
• 43: Donald A. Norman, The invisible computer, MIT Press, Cambridge, MA, 1998
• 44: Norman, D.A. The Design of Everyday Things. Doubleday, New York, NY, 1988.
• 45: Bashar Nuseibeh , Steve Easterbrook, Requirements engineering: a roadmap, Proceedings of the Conference on The Future of Software Engineering, p.35-46, June 04-11, 2000, Limerick, Ireland [doi>10.1145/336512.336523]
• 46: Colin Potts, Software-Engineering Research Revisited, IEEE Software, v.10 n.5, p.19-28, September 1993 [doi>10.1109/52.232392]
• 47: Colin Potts, Using schematic scenarios to understand user needs, Proceedings of the conference on Designing interactive systems: processes, practices, methods, & techniques, p.247-256, August 23-25, 1995, Ann Arbor, Michigan, United States [doi>10.1145/225434.225462]
• 48: Colin Potts , Kenji Takahashi , Annie I. Antón, Inquiry-Based Requirements Analysis, IEEE Software, v.11 n.2, p.21-32, March 1994 [doi>10.1109/52.268952]
• 49: Colin Potts , Idris Hsi, Abstraction and context in requirements engineering: Toward a synthesis, Annals of Software Engineering, 3, p.23-61, 1997
• 50: Raichle, M.E. Visualizing the Mind. Scientific American, 270 (4). 58--64.
• 51: James Rumbaugh , Michael Blaha , William Premerlani , Frederick Eddy , William Lorensen, Object-oriented modeling and design, Prentice-Hall, Inc., Upper Saddle River, NJ, 1991
• 52: Sommerville, I., Rodden, T., Sawyer, P., Bentley, R. and Twidale, M., Integrating Ethnography Into The Requirements Engineering Process. in IEEE International Symposium on Requirements Engineering, (San Diego, CA, 1992), IEEE Computer Society Press, 165--181.
• 53: Alistair G. Sutcliffe , Neil A. M. Maiden , Shailey Minocha , Darrel Manuel, Supporting Scenario-Based Requirements Engineering, IEEE Transactions on Software Engineering, v.24 n.12, p.1072-1088, December 1998 [doi>10.1109/32.738340]
• 54: Verheijen, G.M.A. and Van Bekkum, J. NIAM: An Information Analysis Method. in Olle, T.W., Sol, H.G. and Verrijn-Stuart, A.A. eds. Information Systems Design Methodologies, North-Holland Publishing Company, Amsterdam, 1982.
• 55: Vicente, K.J. A Few Implications of an Ecological Approach to Human Factors. Human Factors Society Bulletin, 33 (11). 1-4.
• 56: Vicente, K.J. and Rasmussen, J. The Ecology of Human-Machine Systems II: Mediating "Direct Perception" in Complex Work Domains. Ecological Psychology, 2 (3). 207--249.
• 57: Yair Wand , Veda C. Storey , Ron Weber, An ontological analysis of the relationship construct in conceptual modeling, ACM Transactions on Database Systems (TODS), v.24 n.4, p.494-528, Dec. 1999 [doi>10.1145/331983.331989]
• 58: Wasserman, S. and Faust, K. Social Network Analysis. Cambridge University Press, Cambridge, 1994.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.4 Software/Program Verification
          Subjects: Validation

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.13 Reusable Software
            Subjects: Domain engineering
      D.2.7 Distribution, Maintenance, and Enhancement
          Subjects: Restructuring, reverse engineering, and reengineering
      D.2.8 Metrics
          Subjects: Product metrics

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology; Theory and methods; User-centered design

General Terms:
Design, Human Factors, Measurement, Performance, Theory

Keywords:
activation cost, activation energy, computing ecosystem, conceptual fitness, ontological excavation, software evolution, use niche, use potential, usefulness