Work practices of system administrators: implications for tool design

ABSTRACT

System administrators are specialized workers and computer users. As skilled workers in complex and high-risk environments, intuition tells us this unique user group may have requirements of the systems and software they use that differ from the requirements of regular computer users. An examination of system administrator work practices sheds light on the system attributes and characteristics they need to do their jobs. Through shadowing, interviews, and a review of previous system administrator studies, we present information and system quality attributes that appear to be important to system administrators. Following a discussion of these attributes, we present a model of user satisfaction that provides actionable guidance and an integration of the attributes. We close with a discussion of the research findings and a call for future research in this area.

REFERENCES

• 1: Susanne Bødker, A human activity approach to user interfaces, Human-Computer Interaction, v.4 n.3, p.171-195, September 1989 [doi>10.1207/s15327051hci0403_1]
• 2: Rob Barrett , Eser Kandogan , Paul P. Maglio , Eben M. Haber , Leila A. Takayama , Madhu Prabaker, Field studies of computer system administrators: analysis of system management tools and practices, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031672]
• 3: Bailey, J., Etgen, M. and Freeman, K. 2003. Situation Awareness and System Administration (Workshop). In Proceedings of the Conference on Human Factors in Computing Systems (CHI' 03) (Ft Lauderdale, FL, USA, Apr 2003, 2003).
• 4: IBM. Autonomic computing: IBM's perspective on the state of information technology. http://www.ibm.com/industries/government/doc/content/resource/ thought/278606109.html Accessed Jan 2006.
• 5: Jeffrey O. Kephart , David M. Chess, The Vision of Autonomic Computing, Computer, v.36 n.1, p.41-50, January 2003 [doi>10.1109/MC.2003.1160055]
• 6: David Patterson , Aaron Brown , Pete Broadwell , George Candea , Mike Chen , James Cutler , Patricia Enriquez , Armando Fox , Emre Kiciman , Matthew Merzbacher , David Oppenheimer , Naveen Sastry , William Tetzlaff , Jonathan Traupman , Noah Treuhaft, Recovery Oriented Computing (ROC): Motivation, Definition, Techniques,, University of California at Berkeley, Berkeley, CA, 2002
• 7: HP. Adaptive Infrastructure. http://h71028.www7.hp.com/enterprise/cache/5003-0-0-0-121.aspx. Accessed Jan 2006.
• 8: SunMicrosystems. N1 Grid System. http://wwws.sun.com/software/solutions/n1. Accessed Jan 2006.
• 9: Rob Barrett , Yen-Yang Michael Chen , Paul P. Maglio, System administrators are users, too: designing workspaces for managing internet-scale systems, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766152]
• 10: SAGE. 2006. SAGE Annual Salary Survey 2005-2006. 2006.
• 11: Lucy Suchman, Making work visible, Communications of the ACM, v.38 n.9, p.56-ff., Sept. 1995 [doi>10.1145/223248.223263]
• 12: Dalcher, D. Year. Trust, Systems and Accidents: Designing Complex Systems. In Proceedings of the International Conference and Workshop on the Engineering of Computer-Based Systems (ECBS '03) (Huntsville, AL, USA, Apr 7--10, Year).
• 13: Haber, E. and Kandogan, E. 2007. Security Administrators in the Wild: Ethnographic Studies of Security Administrators. SIG CHI 2007 Workshop on Security User Studies: Methodologies and Best Practices2007).
• 14: David Botta , Rodrigo Werlinger , André Gagné , Konstantin Beznosov , Lee Iverson , Sidney Fels , Brian Fisher, Towards understanding IT security professionals and their tools, Proceedings of the 3rd symposium on Usable privacy and security, July 18-20, 2007, Pittsburgh, Pennsylvania [doi>10.1145/1280680.1280693]
• 15: Eben M. Haber , John Bailey, Design guidelines for system administration tools developed through ethnographic field studies, Proceedings of the 2007 symposium on Computer human interaction for the management of information technology, March 30-31, 2007, Cambridge, Massachusetts [doi>10.1145/1234772.1234774]
• 16: J. A. Verdoes, In search of a complete and scalable systems administration suite, Proceedings of the 1997 Workshop on Large Scale System Administration of Windows NT, p.2-2, August 14-16, 1997, Seattle, Washington
• 17: Dennis G. Hrebec , Michael Stiber, A survey of system administrator mental models and situation awareness, Proceedings of the 2001 ACM SIGCPR conference on Computer personnel research, p.166-172, April 2001, San Diego, California, United States [doi>10.1145/371209.371231]
• 18: Katriina Byström , Kalervo Järvelin, Task complexity affects information seeking and use, Information Processing and Management: an International Journal, v.31 n.2, p.191-213, March/April 1995 [doi>10.1016/0306-4573(94)00041-Z]
• 19: Murray, K. B. and Schlacter, J. L. 1990. The Impact of Services Versus Goods on Consumers' Assessment of Perceived Risk and Variability. Journal of the Academy of Marketing Science, 18, 1 (Jan 1 1990), 51--65.
• 20: Leila Takayama , Eser Kandogan, Trust as an underlying factor of system administrator interface choice, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125708]
• 21: Graham Button , Richard Harper, The relevance of “work-practice” for design, Computer Supported Cooperative Work, v.4 n.4, p.263-280, 1995/1996 [doi>10.1007/BF00749172]
• 22: Barbara H. Wixom , Peter A. Todd, A Theoretical Integration of User Satisfaction and Technology Acceptance, Information Systems Research, v.16 n.1, p.85-102, March 2005 [doi>10.1287/isre.1050.0042]
• 23: DeLone, W. and McLean, E. 1992. Information Systems Success: The Quest for the Dependent Variable. Information Systems Research, 3, 1 (Mar 1992 1992), 60--95.
• 24: Davis, F. D. 1989. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. Management Information Systems Quarterly, 13, 3 (Sep 1983 1989), 319--340.
• 25: Viswanath Venkatesh, Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model, Information Systems Research, v.11 n.4, p.342-365, December 2000 [doi>10.1287/isre.11.4.342.11872]
• 26: Bailey, J. and Pearson, S. W. 1983. Development of a Tool for Measuring and Analyzing Computer User Satisfaction. Management Science, 29, 5 (May 1983), 530--545.
• 27: Ben Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1997
• 28: Jack J. Baroudi , Wanda J. Orlikowski, A short-form measure of user information satisfaction: a psychometric evaluation and notes on use, Journal of Management Information Systems, v.4 n.4, p.44-59, April 1988
• 29: William J. Doll , Gholamreza Torkzadeh, The measurement of end-user computing satisfaction, MIS Quarterly, v.12 n.2, p.259-274, June 1988 [doi>10.2307/248851]
• 30: Blake Ives , Margrethe H. Olson , Jack J. Baroudi, The measurement of user information satisfaction, Communications of the ACM, v.26 n.10, p.785-793, Oct. 1983 [doi>10.1145/358413.358430]
• 31: Galletta, D. and Lederer, A. L. 1989. Some cautions on the measuremnet of user information satisfaction. Decision Sciences, 20, 3 1989), 419--439.
• 32: Pattie Maes, Agents that reduce work and information overload, Communications of the ACM, v.37 n.7, p.30-40, July 1994 [doi>10.1145/176789.176792]
• 33: Churchill, G. A. 1979. A Paradigm for Developing Better Measures of Marketing Constructs. Journal of Marketing Research, 16, 1 (Feb 1979 1979), 64--73.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Evaluation/methodology

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.4 System Management

General Terms:
Design, Human Factors

Keywords:
design, system administrator, user satisfaction, work practice