Rapid prototyping and evaluation of in-vehicle interfaces

ABSTRACT

As driver distraction from in-vehicle devices becomes an increasingly critical issue, researchers have aimed to establish better scientific understanding of distraction along with better engineering tools to build less distracting devices. This article presents a new system, Distract-R, that allows designers to rapidly prototype and evaluate new in-vehicle interfaces. The core engine of the system relies on a rigorous cognitive model of driver behavior which, when integrated with models of task behavior on the prototyped interfaces, generate predictions of driver performance and distraction. Distract-R allows a designer to prototype basic interfaces, demonstrate possible tasks on these interfaces, specify relevant driver characteristics and driving scenarios, and finally simulate, visualize, and analyze the resulting behavior as generated by the cognitive model. The article includes three modeling studies that demonstrate the system's ability to account for various aspects of driver performance for several types of in-vehicle interfaces. More generally, Distract-R illustrates how cognitive models can be used as internal simulation engines for design tools intended for nonmodelers, with the ultimate goal of helping to understand and predict user behavior in multitasking environments.

REFERENCES

• 1: Alm, H. and Nilsson, L. 1994. Changes in driver behaviour as a function of hands-free mobile phones—A simulator study. Accid. Anal. Preven. 26, 441--451.
• 2: Altmann, E. M. and Gray, W. D. 2008. An integrated model of cognitive control in task switching. Psych. Rev. 115, 602--639.
• 3: Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. 2004. An integrated theory of the mind. Psych. Rev. 111, 1036--1060.
• 4: Anderson, J. R., Bothell, D., Lebiere, C., and Matessa, M. 1998. An integrated theory of list memory. J. Mem. Lang. 38, 341--380.
• 5: Anderson, J. R. and Matessa, M. 1997. A production system theory of serial memory. Psych. Rev. 104, 728--748.
• 6: Anderson, J. R., Taatgen, N. A., and Byrne, M. D. 2005. Learning to achieve perfect time sharing: Architectural implications of Hazeltine, Teague, & Ivry 2002. J. Exp. Psych.: Hum. Percept. Perform. 31, 749--761.
• 7: Best, B. J., and Lebiere, C. 2003. Spatial plans, communication, and teamwork in synthetic MOUT agents. In Proceedings of the 12th Conference on Behavior Representation In Modeling and Simulation.
• 8: Brookhuis, K. A., De Vries, G., and De Waard, D. 1991. The effects of mobile telephoning on driver performance. Accid. Anal. Preven. 23, 309--316.
• 9: Duncan P. Brumby , Andrew Howes , Dario D. Salvucci, A cognitive constraint model of dual-task trade-offs in a highly dynamic driving task, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240664]
• 10: Byrne, M. D., and Anderson, J. R. 2001. Serial modules in parallel: The psychological refractory period and perfect time-sharing. Psych. Revi. 108, 847--869.
• 11: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, L. Erlbaum Associates Inc., Hillsdale, NJ, 1983
• 12: Arindam Das , Wolfgang Stuerzlinger, A cognitive simulation model for novice text entry on cell phone keypads, Proceedings of the 14th European conference on Cognitive ergonomics: invent! explore!, August 28-31, 2007, London, United Kingdom [doi>10.1145/1362550.1362579]
• 13: Fitts, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psych. 47, 381--391.
• 14: Fuchs, A. F. 1971. The saccadic system. In The Control of Eye Movements, Bach-Y-Rita, P., Collins, C. C., and Hyde, J. E., Eds., Academic Press, New York, 343--362.
• 15: Gray, W. D. and Schoelles, M. J. 2003. The nature and timing of interruptions in a complex cognitive task: Empirical data and computational cognitive models. In Proceedings of the 25th Annual Meeting of the Cognitive Science Society.
• 16: Green, P. 1999. The 15-second rule for driver information systems. In Proceeding of the 9th Annual Meeting of ITS America. Intelligent Transportation Society of America, Washington, D.C.
• 17: Greenberg, J. A., Tijerina, L., Curry, R., Artz, B. A., Cathey, L., Kochhar, D., Kozak, K., Blommer, M., and Grant, P. 2003. Driver distraction: Evaluation with event detection paradigm. Transport Resear. Rec. 1843, 1--9.
• 18: Gunzelmann, G., Gross, J. B., Gluck, K. A., and Dinges, D. F. (in press). Sleep deprivation and sustained attention performance: Integrating mathematical and cognitive modeling. Cognit. Sci.
• 19: Hancock, P. A., Lesch, M., and Simmons, L. 2003. The distraction effects of phone use during a crucial driving maneuver. Accid. Anal. Preven. 35, 501--514.
• 20: Hankey, J. M., Dingus, T., A., Hanowski, R. J., Wierwille, W. W., and Andrews, C. 2000. In-vehicle information systems behavioral model and design support: Final report. Tech. Rep. No. FHWA-RD-00-135, Federal Highway Administration, U.S. Department of Transportation.
• 21: Hendricks, D. L., Freedman, M., Zador, P. L., and Fell, J. C. 2001. The relative frequency of unsafe driving acts in serious traffic crashes. Report for Contract No. DTNH22-94-C-05020, National Highway Traffic Safety Administration, U.S. Department of Transportation.
• 22: Horrey, W. J. and Wickens, C. D. 2004. Driving and side task performance: The effects of display clutter, separation, and modality. Human Factors, 46, 611--624.
• 23: Howes, A., Vera, A., and Lewis, R. L. 2007. Bounding rational analysis: Constraints on asymptotic performance. In Integrated Models of Cognitive Systems (403--413) W. D. Gray (Ed.) Oxford University Press.
• 24: Hudson, S. E., John, B. E., Knudsen, K., and Byrne, M. D. 1999. A tool for creating predictive performance models from user interface demonstrations. CHI Letters 1, 1, 93--102.
• 25: Bonnie E. John , David E. Kieras, The GOMS family of user interface analysis techniques: comparison and contrast, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.4, p.320-351, Dec. 1996 [doi>10.1145/235833.236054]
• 26: Bonnie E. John , Konstantine Prevas , Dario D. Salvucci , Ken Koedinger, Predictive human performance modeling made easy, Proceedings of the SIGCHI conference on Human factors in computing systems, p.455-462, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985750]
• 27: John, B. E., Salvucci, D. D., Centgraf, P., and Prevas, K. 2004b. Integrating models and tools in the context of driving and in-vehicle devices. In Proceedings of the 6th International Conference on Cognitive Modeling. Lawrence Erlbaum Associates. Mahwah, NJ, 130--135.
• 28: Bonnie E. John , Dario D. Salvucci, Multipurpose Prototypes for Assessing User Interfaces in Pervasive Computing Systems, IEEE Pervasive Computing, v.4 n.4, p.27-34, October 2005 [doi>10.1109/MPRV.2005.80]
• 29: David E. Kieras , Scott D. Wood , Kasem Abotel , Anthony Hornof, GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs, Proceedings of the 8th annual ACM symposium on User interface and software technology, p.91-100, November 15-17, 1995, Pittsburgh, Pennsylvania, United States [doi>10.1145/215585.215700]
• 30: James A. Landay , Brad A. Myers, Interactive sketching for the early stages of user interface design, Proceedings of the SIGCHI conference on Human factors in computing systems, p.43-50, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223910]
• 31: Lee, J. D., Caven, B., Haake, S., and Brown, T. L. 2001. Speech-based interaction with in-vehicle computers: The effect of speech-based e-mail on drivers' attention to the roadway. Human Factors, 43, 631--640.
• 32: Yili Liu , Robert Feyen , Omer Tsimhoni, Queueing Network-Model Human Processor (QN-MHP): A computational architecture for multitask performance in human-machine systems, ACM Transactions on Computer-Human Interaction (TOCHI), v.13 n.1, p.37-70, March 2006 [doi>10.1145/1143518.1143520]
• 33: Maynard, H. B., Stegemerten, G. J., and Schwab, J. L. 1948. Methods-Time Measurement. McGraw-Hill, New York.
• 34: Mclane, R. C. and Wierwille, W. W. 1975. The influence of motion and audio cues on driver performance in an automobile simulator. Hum. Fact. 17, 488--501.
• 35: Mcknight, A. J. and Mcknight, A. S. 1993. The effect of cellular phone use upon driver attention. Accid. Anal. Preven. 25, 259--265.
• 36: Meyer, D. E., Glass, J. M., Mueller, S. T., Seymour, T. L., and Kieras, D. E. 2001. Executive-process interactive control: A unified computational theory for answering twenty questions (and more) about cognitive ageing. Euro. J. Cogn. Psych. 13, 123--164.
• 37: Brad A. Myers , Richard McDaniel , David Wolber, Programming by example: intelligence in demonstrational interfaces, Communications of the ACM, v.43 n.3, p.82-89, March 2000 [doi>10.1145/330534.330545]
• 38: Paganelli, L. and Paternò, F. 2003. A tool for creating design models from web site code. Int. J. Softw. Engin. Knowl. Engin. 13, 169--189.
• 39: Reed, M. P. and Green, P. A. 1999. Comparison of driving performance on-road and in a low-cost driving simulator using a concurrent telephone dialing task. Ergonomics 42, 1015--1037.
• 40: Ritter, F. E., Reifers, A. L., Klein, A. C., and Schoelles, M. J. 2007. Lessons from defining theories of stress. In Integrated Models of Cognitive Systems. In W. Gray Ed. Oxford University Press. New York, NY.
• 41: Ritter, F. E., Van Rooy, D., St. Amant, R., and Simpson, K. 2006. Providing user models with direct access to computer interfaces: An exploratory study of a simple human-robot interface. IEEE Trans. Syst. Man, and Cybern. 36, 592--601.
• 42: Salvucci, D. D. 2001. Predicting the effects of in-car interface use on driver performance: An integrated model approach. Int. J. Hum.-Comput. Stud. 55, 85--107.
• 43: Salvucci, D. D. 2005. A multitasking general executive for compound continuous tasks. Cognit. Sci. 29, 457--492.
• 44: Salvucci, D. D. 2006. Modeling driver behavior in a cognitive architecture. Hum. Fact. 48, 362--380.
• 45: Salvucci, D. D., Chavez, A. K., and Lee, F. J. 2004. Modeling effects of age in complex tasks: A case study in driving. To appear in Proceedings of the 26th Annual Conference of the Cognitive Science Society.
• 46: Salvucci, D. D., John, B. E., Prevas, K., and Centgraf, P. 2005. Rapid development of keystroke-level models for on- and off-the-desktop interfaces. Manuscript in preparation.
• 47: Dario D. Salvucci , Frank J. Lee, Simple cognitive modeling in a complex cognitive architecture, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642658]
• 48: Salvucci, D. D. and Macuga, K. L. 2002. Predicting the effects of cellular-phone dialing on driver performance. Cognit. Syst. Resear. 3, 95--102.
• 49: Salvucci, D. D. and Taatgen, N. A. 2008. Threaded cognition: An integrated theory of concurrent multitasking. Psych. Rev. 115, 101--130.
• 50: Dario D. Salvucci , Mark Zuber , Ekaterina Beregovaia , Daniel Markley, Distract-R: rapid prototyping and evaluation of in-vehicle interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055052]
• 51: Robert St. Amant , Thomas E. Horton , Frank E. Ritter, Model-based evaluation of expert cell phone menu interaction, ACM Transactions on Computer-Human Interaction (TOCHI), v.14 n.1, p.1-es, May 2007 [doi>10.1145/1229855.1229856]
• 52: Robert St. Amant , Henry Lieberman , Richard Potter , Luke Zettlemoyer, Programming by example: visual generalization in programming by example, Communications of the ACM, v.43 n.3, p.107-114, March 2000 [doi>10.1145/330534.330549]
• 53: St. Amant, R. and Ritter, F. E. 2005. Specifying ACT-R models of user interaction with a GOMS language. Cognit. Syst. Resear. 6, 71--88.
• 54: Strayer, D. L. and Drews, F. A. 2004. Profiles in driver distraction: Effects of cell phone conversations on younger and older drivers. Hum. Fact. 46, 640--649.
• 55: Strayer, D. L. and Johnston, W. A. 2001. Driven to distraction: Dual-task studies of simulated driving and conversing on a cellular telephone. Psych. Sci. 12, 462--466.
• 56: Taatgen, N. A. and Lee, F. J. 2003. Production compilation: A simple mechanism to model complex skill acquisition. Hum. Fact. 45, 61--76.
• 57: Tijerina, L., Johnston, S., Parmer, E., Winterbottom, M. D., and Goodman, M. 2000. Driver distraction with route guidance systems. Tech. Rep. DOT HS 809 069, East Liberty, OH: National Highway Traffic Safety Administration.
• 58: Irene Tollinger , Richard L. Lewis , Michael McCurdy , Preston Tollinger , Alonso Vera , Andrew Howes , Laura Pelton, Supporting efficient development of cognitive models at multiple skill levels: exploring recent advances in constraint-based modeling, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055029]
• 59: Wickens, C. D., Goh, J., Helleberg, J., Horrey, W. J., and Talleur, D. A. 2003. Attentional models of multitask pilot performance using advanced display technology. Hum. Fact. 45, 360--380.
• 60: Wu, C. and Liu, Y. 2007. Queueing network modeling of driver workload and performance. IEEE Trans. Intell. Transport. Syst. 8, 528--537.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods; Evaluation/methodology; Prototyping

  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.1 Public Policy Issues
          Subjects: Human safety

General Terms:
Design, Human Factors

Keywords:
Driving, cognitive modeling, driver distraction