Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Because functional near-infrared spectroscopy (fNIRS) eases many of the restrictions of other brain sensors, it has potential to open up new possibilities for HCI research. From our experience using fNIRS technology for HCI, we identify several considerations and provide guidelines for using fNIRS in realistic HCI laboratory settings. We empirically examine whether typical human behavior (e.g. head and facial movement) or computer interaction (e.g. keyboard and mouse usage) interfere with brain measurement using fNIRS. Based on the results of our study, we establish which physical behaviors inherent in computer usage interfere with accurate fNIRS sensing of cognitive state information, which can be corrected in data analysis, and which are acceptable. With these findings, we hope to facilitate further adoption of fNIRS brain sensing technology in HCI research.

REFERENCES

• 1: Bunce, S.C., Izzetoglu, M., Izzetoglu, K., Onaral, B. and Pourrezaei, K. Functional Near Infrared Spectroscopy: An Emerging Neuroimaging Modality. IEEE Engineering in Medicine and Biology Magazine, Special issue on Clinical Neuroengineering, 25 (4). 2006, 54--62.
• 2: Chen, D., Hart, J. and Vertegaal, R. Towards a Physiological Model of User Interruptability. in INTERACT'07, 2008, 439--451.
• 3: Chenier, F. and Sawan, M., A New Brain Imaging Device Based on fNIRS. in BIOCAS 2007, (2007), 1--4.
• 4: Coyle, S., Ward, T. and Markham, C., Physiological Noise in Near-infrared Spectroscopy: Implications for Optical Brain Computer Interfacing. in Proc. EMBS, (2004).
• 5: Devaraj, A., Izzetoglu, M., Izzetoglu, K. and Onaral, B. Motion Artifact Removal for fNIR Spectroscopy for Real World Application Areas. Proc. SPIE, 5588. 2004, 224--229.
• 6: Ehlis, A.-C., Bähne, C.G., Jacob, C.P., Herrmann, M.J. and Fallgatter, A.J. Reduced lateral prefrontal activation in adult patients with attention-deficit/hyperactivity disorder (ADHD) during a working memory task: A functional near-infrared spectroscopy (fNIRS) study. Journal of Psychiatric Research, 42 (13). 2008, 1060--1067.
• 7: Fink, A., Benedek, M., Grabner, R.H., Staudt, B. and Neubauer, A.C. Creativity meets neuroscience: Experimental tasks for the neuroscientific study of creative thinking. Methods, 42 (1). 2007, 68--76.
• 8: Folley, B.S. and Park, S. Verbal creativity and schizotypal personality in relation to prefrontal hemispheric laterality: A behavioral and near-infrared optical imaging study. Schizophrenia Research, 80 (2--3). 2005, 271--282.
• 9: Audrey Girouard , Erin Treacy Solovey , Leanne M. Hirshfield , Krysta Chauncey , Angelo Sassaroli , Sergio Fantini , Robert J. Jacob, Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements, Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I, August 24-28, 2009, Uppsala, Sweden [doi>10.1007/978-3-642-03655-2_50]
• 10: David Grimes , Desney S. Tan , Scott E. Hudson , Pradeep Shenoy , Rajesh P.N. Rao, Feasibility and pragmatics of classifying working memory load with an electroencephalograph, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357187]
• 11: Herrmann, M.J., Huter, T., Plichta, M.M., Ehlis, A.-C., Alpers, G.W., Mühlberger, A. and Fallgatter, A.J. Enhancement of activity of the primary visual cortex during processing of emotional stimuli as measured with event-related functional near-infrared spectroscopy and event-related potentials. Human Brain Mapping, 29 (1). 2008, 28--35.
• 12: Hirshfield, L., Chauncey, K., Gulotta, R., Girouard, A., Solovey, E.T., Jacob, R., Sassaroli, A. and Fantini, S., Combining Electroencephalograph and Near Infrared Spectroscopy to Explore Users' Mental Workload. in HCI International 2009 (2009).
• 13: Leanne M. Hirshfield , Erin Treacy Solovey , Audrey Girouard , James Kebinger , Robert J.K. Jacob , Angelo Sassaroli , Sergio Fantini, Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy, Proceedings of the 27th international conference on Human factors in computing systems, April 04-09, 2009, Boston, MA, USA [doi>10.1145/1518701.1519035]
• 14: Hoshi, Y. Near-Infrared Spectroscopy for Studying Higher Cognition. in Neural Correlates of Thinking, 2009, 83--93.
• 15: Huppert, T. and Boas, D.A. (2005). Hemodynamic Evoked Response NIRS data analysis GUI Program User's Guide, 2009, from http://www.nmr.mgh.harvard.edu/PMI/resources/homer/HomER_UsersGuide_05-07-28.pdf
• 16: Izzetoglu, K., Bunce, S., Onaral, B., Pourrezaei, K. and Chance, B. Functional Optical Brain Imaging Using Near-Infrared During Cognitive Tasks. IJHCI, 17 (2). 2004, 211--231.
• 17: Izzetoglu, M., Devaraj, A., Bunce, S. and Onaral, B. Motion Artifact Cancellation in NIR spectroscopy Using Wiener Filtering. IEEE Transactions on Biomedical Engineering, 52 (5). 2005, 934--938.
• 18: Johnny Chung Lee , Desney S. Tan, Using a low-cost electroencephalograph for task classification in HCI research, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166268]
• 19: Rudolph L. Mappus, IV , Girish R. Venkatesh , Chetna Shastry , Amichai Israeli , Melody M. Jackson, An fNIR based BMI for letter construction using continuous control, Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, April 04-09, 2009, Boston, MA, USA [doi>10.1145/1520340.1520536]
• 20: Matthews, F., Pearlmutter, B.A., Ward, T.E., Soraghan, C. and Markham, C. Hemodynamics for Brain-Computer Interfaces. Signal Processing Magazine, IEEE, 25 (1). 2008, 87--94.
• 21: José del R. Millán , Frédéric Renkens , Josep Mouriño , Wulfram Gerstner, Brain-actuated interaction, Artificial Intelligence, v.159 n.1-2, p.241-259, November 2004 [doi>10.1016/j.artint.2004.05.008]
• 22: Morioka, S., Yamada, M. and Komori, T. Frontal Lobe Activity during the Performance of Spatial Tasks: fNIRS Study. J Phys Ther Sci, 20. 2008, 135--139.
• 23: Ramnani, N. and Owen, A.M. Anterior prefrontal cortex: insights into function from anatomy and neuroimaging. Nat Rev Neurosci, 5 (3). 2004, 184.
• 24: Sitaram, R., Zhang, H., Guan, C., Thulasidas, M., Hoshi, Y., Ishikawa, A., Shimizu, K. and Birbaumer, N. Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. NEUROIMAGE, 34 (4). 2007, 1416--1427.
• 25: Villringer, A. and Chance, B. Non-Invasive Optical Spectroscopy and Imaging of Human Brain Function. Trends in Neuroscience, 20. 1997, 435--442.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Human Factors

Keywords:
BCI, brain-computer interface, fNIRS, functional near-infrared spectroscopy, human cognition