Sysadmins and the need for verification information

ABSTRACT

Traditional usability measures may not be sufficient for some specialized users, such as system administrators. Because of their broad range of responsibilities for highly complex and risky business environments, these users also need tools that are powerful, informative, and credible. To do their work, system administrators need the ability to verify the work they have done. That verification comes from accurate and available information that we refer to as information credibility. This exploratory research aims to address the relationship between task complexity, task risk, and verification information seeking in GUI tools used by system administrators. Potential antecedents of information verification are identified and a model is proposed that addresses how aspects of the task and environment affect the need for verification. Findings suggest that task complexity is a significant indicator of the need for verification information. Armed with this knowledge, practitioners can anticipate the needs of system administrators and design GUI tools with information credibility in mind.

REFERENCES

• 1: William J. Doll , Gholamreza Torkzadeh, The measurement of end-user computing satisfaction, MIS Quarterly, v.12 n.2, p.259-274, June 1988 [doi>10.2307/248851]
• 2: Jina Huh , Mark S. Ackerman , Robert Douglas, The use of aesthetics in HCI systems, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1241021]
• 3: Kasper Hornbæk, Current practice in measuring usability: Challenges to usability studies and research, International Journal of Human-Computer Studies, v.64 n.2, p.79-102, February 2006 [doi>10.1016/j.ijhcs.2005.06.002]
• 4: Kandogan, E. and Maglio, P. Year. Why Don't You Trust Me Anymore? Or the Role of Trust in Troubleshooting Activities of System Administrators. In Proceedings of the ACM Conference on Human Factors in Computing (CHI '03) (Ft Lauderdale, FL, USA, Jan 1, Year).
• 5: Leila Takayama , Eser Kandogan, Trust as an underlying factor of system administrator interface choice, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125708]
• 6: Rob Barrett , Eser Kandogan , Paul P. Maglio , Eben M. Haber , Leila A. Takayama , Madhu Prabaker, Field studies of computer system administrators: analysis of system management tools and practices, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031672]
• 7: IBM. Autonomic computing: IBM's perspective on the state of information technology. http://www.ibm.com/industries/government/doc/content/resource/thought/278606109.html Accessed Jan 2006.
• 8: Jeffrey O. Kephart , David M. Chess, The Vision of Autonomic Computing, Computer, v.36 n.1, p.41-50, January 2003 [doi>10.1109/MC.2003.1160055]
• 9: Patterson, D., Brown, A., Broadwell, P., Candea, G., Chen, M., Cutler, J., Enriquez, P., Fox, A., Kiciman, E., Merzbacker, M., Oppenheimer, D., Sastry, N., Tetzlaff, W., Traupman, J. and Treuhalf, N. 2002. Recovery-oriented computing (ROC): Motivation, definition, techniques, and case studies. University of California, Berkeley, Berkeley, CA, 2002.
• 10: SunMicrosystems. N1 Grid System. http://wwws.sun.com/software/solutions/n1. Accessed Jan 2006.
• 11: HP. Adaptive Infrastructure. http://h71028.www7.hp.com/enterprise/cache/5003-0-0-0-121.aspx. Accessed Jan 2006.
• 12: Lewis, J. 2001. Current issues in usability evaluation. International Journal of Human-Computer Interaction, 13, 4 2001), 343--349.
• 13: John D. Gould , Clayton Lewis, Designing for usability: key principles and what designers think, Communications of the ACM, v.28 n.3, p.300-311, March 1985 [doi>10.1145/3166.3170]
• 14: Gillan, D. and Bias, R. 2001. Usability Science. I: Foundations. International Journal of Human-Computer Interaction, 13, 4 2001), 351--372.
• 15: IEEE MultiMedia, Evaluating Web Page Color and Layout Adaptations, IEEE MultiMedia, v.9 n.1, p.86-89, January 2002 [doi>10.1109/93.978356]
• 16: Xavier Ferré , Natalia Juristo , Helmut Windl , Larry Constantine, Usability Basics for Software Developers, IEEE Software, v.18 n.1, p.22-29, January 2001 [doi>10.1109/52.903160]
• 17: John D. Gould , Stephen J. Boies , Clayton Lewis, Making usable, useful, productivity-enhancing computer applications, Communications of the ACM, v.34 n.1, p.74-85, Jan. 1991 [doi>10.1145/99977.99993]
• 18: Davis, F. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. Management Information Systems Quarterly, 13, 3 (Sep 1 1989), 319--340.
• 19: Viswanath Venkatesh, Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model, Information Systems Research, v.11 n.4, p.342-365, December 2000 [doi>10.1287/isre.11.4.342.11872]
• 20: DeLone, W. and McLean, E. 1992. Information systems success: The quest for the dependent variable. Information Systems Research, 3, 1 (Mar 1 1992), 60--95.
• 21: Al-Gahtani, S. and King, M. 1999. Attitudes, satisfaction, and usage: Factors contributing to each in the acceptance of information technology. Behaviour & Information Technology, 18, 4 1999), 277--297.
• 22: William H. Delone , Ephraim R. McLean, The DeLone and McLean Model of Information Systems Success: A Ten-Year Update, Journal of Management Information Systems, v.19 n.4, p.9-30, Number 4/Spring 2003
• 23: William H. Delone , Ephraim R. Mclean, Measuring e-Commerce Success: Applying the DeLone & McLean Information Systems Success Model, International Journal of Electronic Commerce, v.9 n.1, p.31-47, Number 1/Fall 2004
• 24: Dale L. Goodhue , Ronald L. Thompson, Task-technology fit and individual performance, MIS Quarterly, v.19 n.2, p.213-236, June 1995 [doi>10.2307/249689]
• 25: Campbell, D. 1988. Task complexity: A review and analysis. Academy of Management Review, 13, 1 (Jan 1 1988), 40--52.
• 26: D'Ambra, J. and Wilson, C. 2004. Explaining perceived performance of the World Wide Web: Uncertainty and the task-technology fit model. Internet Research - Electronic Networking Applications and Policy, 14, 4 2004), 294--310.
• 27: Dishaw, M. and Strong, D. 1999. Extending the technology acceptance model with task-technology fit constructs. Information and Management, 36, 1 (Jul 1 1999), 9--21.
• 28: Goodhue, D. 1998. Development and measurement validity of a task-technology fit instrument for user evaluations of information systems. Decision Sciences, 29, 1 1998), 105--138.
• 29: Kieran Mathieson , Mark Keil, Beyond the interface: ease of use and task/technology fit, Information and Management, v.34 n.4, p.221-230, Nov. 2, 1998 [doi>10.1016/S0378-7206(98)00058-5]
• 30: Rob Barrett , Yen-Yang Michael Chen , Paul P. Maglio, System administrators are users, too: designing workspaces for managing internet-scale systems, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766152]
• 31: Jim Gray, Evolution of Data Management, Computer, v.29 n.10, p.38-46, October 1996 [doi>10.1109/2.539719]
• 32: IEEE Concurrency staff, Data Replication Gaining Popularity, IEEE Concurrency, v.7 n.2, p.85-86, April 1999 [doi>10.1109/MCC.1999.766976]
• 33: R. J. T. Morris , B. J. Truskowski, The evolution of storage systems, IBM Systems Journal, v.42 n.2, p.205-217, April 2003
• 34: J. P. Gelb, System-managed storage, IBM Systems Journal, v.28 n.1, p.77-103, 1989
• 35: ITCentrix. 2001. Storage on Tap: Understanding the Business Value of Storage Service Providers. 2001.
• 36: Eric Arnold Anderson , Dave Patterson, Researching system administration, University of California, Berkeley, 2002
• 37: Dennis G. Hrebec , Michael Stiber, A survey of system administrator mental models and situation awareness, Proceedings of the 2001 ACM SIGCPR conference on Computer personnel research, p.166-172, April 2001, San Diego, California, United States [doi>10.1145/371209.371231]
• 38: Paul P. Maglio , Eser Kandogan, Error messages: what's the problem?, Queue, v.2 n.8, November 2004 [doi>10.1145/1036474.1036499]
• 39: B. J. Fogg , Hsiang Tseng, The elements of computer credibility, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.80-87, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303001]
• 40: Shawn Tseng , B. J. Fogg, Credibility and computing technology, Communications of the ACM, v.42 n.5, p.39-44, May 1999 [doi>10.1145/301353.301402]
• 41: Vakkari, P. Task Complexity, Information Types, Search Strategies and Relevance: Integrating Studies on Information Seeking and Retrieval. Taylor Graham Publishing, City, 1999.
• 42: Katriina Byström , Kalervo Järvelin, Task complexity affects information seeking and use, Information Processing and Management: an International Journal, v.31 n.2, p.191-213, March/April 1995 [doi>10.1016/0306-4573(94)00041-Z]
• 43: Mick, C. K. 1980. Toward Usable User Studies. Journal of the American Society for Information Science, 31, 5 (Sept 1980), 347--356.
• 44: Murray, K. B. 1991. A Test of Services Marketing Theory: Consumer Information Acquisition Activities. Journal of Marketing, 55, 1 (Jan 1 1991), 10--25.
• 45: Murray, K. B. and Schlacter, J. L. 1990. The Impact of Services Versus Goods on Consumers' Assessment of Perceived Risk and Variability. Journal of the Academy of Marketing Science, 18, 1 (Jan 1 1990), 51--65.
• 46: Aldag, R. and Brief, A. 1979. Task Design and Employee Motivation. Scott, Foresman, Glenview, IL.
• 47: Shaw, M. E. 1963. Scaling Group Tasks: A Method for Dimensional Analysis. University of Florida, Gainesville, FL, 1963.
• 48: Kluger, A. N. and DeNisi, A. 1996. The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 1991996), 254--284.
• 49: Wood, R. 1986. Task complexity: Definition of the construct. Organizational Behavior and Human Decision Processes, 371986), 60--82.
• 50: Stajkovic, A. and Luthans, F. 1998. Self-efficacy and work-related performance: A meta-analysis. Psychologica. Bulletin, 1241998), 240--261.
• 51: Jacoby, J. and Kaplan, L. Year. The Components of Perceived Risk. In Proceedings of the Convention of the Association of Consumer Research (Iowa City, IA, Year). 382--393.
• 52: Roselius, T. 1971. Consumer Rankings of Risk Reduction Methods. Journal of Marketing, 35, 1 1971), 56--61.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Screen design (e.g., text, graphics, color)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.4 System Management

General Terms:
Design, Human Factors, Verification

Keywords:
information seeking, system administrator, usability, verification