Observing effects of attention on presence with fMRI

ABSTRACT

Presence is one of the goals of many virtual reality systems. Historically, in the context of virtual reality, the concept of presence has been associated much with spatial perception (bottom up process) as its informal definition of "feeling of being there" suggests. However, recent studies in presence have challenged this view and attempted to widen the concept to include psychological immersion, thus linking more high level elements (processed in a top down fashion) to presence such as story and plots, flow, attention and focus, identification with the characters, emotion, etc. In this paper, we experimentally studied the relationship between two content elements, each representing the two axis of the presence dichotomy, perceptual cues for spatial presence and sustained attention for (psychological) immersion. Our belief was that spatial perception or presence and a top down processed concept such as voluntary attention have only a very weak relationship, thus our experimental hypothesis was that sustained attention would positively affect spatial presence in a virtual environment with impoverished perceptual cues, but have no effect in an environment rich in them. In order to confirm the existence of the sustained attention in the experiment, fMRI of the subjects were taken and analyzed as well. The experimental results showed that that attention had no effect on spatial presence, even in the environment with impoverished spatial cues.

REFERENCES

• 1: P. A. Bandettini, E. C. Wong, R. S. Hinks, R. S. Tikofsky, and J. S. Hyde. Time course epi of human brain function during task activation. Magn. Reson. Med, 25(2):390--397, 6 1992.
• 2: Steve Baumann , Chris Neff , Scott Fetzick , Gregg Stangl , Lee Basler , Ray Vereneck , Walter Schneider, A Virtual Reality System for Neurobehavioral and fMRI Studies, Proceedings of the IEEE Virtual Reality 2003, p.312, March 22-26, 2003
• 3: K. E. Bystrom, W. Barfield, and C. Hendrix. A conceptual model of the sense of presence in virtual environments. Presence: Teleoperators and Virtual Environments, 8(2):241--244, 4 1999.
• 4: B. J. Casey, J. D. Cohen, P. Jezzard, R. Turner, D. C. Noll, R. J. Trainor, J. Giedd, D. Kaysen, L. Hertz-Pannier, and J. L. Rapoport. Activation of prefrontal cortex in children during a nonspatial working memory task with functional mri. NeuroImage, 2(3):221--229, 9 1995.
• 5: Dongsik Cho , Jihye Park , Gerard Jounghyun Kim , Sangwoo Hong , Sungho Han , Seungyong Lee, The Dichotomy of Presence Elements: The Where and What, Proceedings of the IEEE Virtual Reality 2003, p.273, March 22-26, 2003
• 6: K. J. Friston, C. D. Fristh, P. F. Liddle, and R. S. Frackowiak. Comparing functional (pet) images: The assessment of significant change. J. Cereb. Blood Flow Metab., 11:690--699, 1991.
• 7: C. Hendrix and W. Barfield. Presence within virtual environments as a function of visual display parameters. Presence: Teleoperators and Virtual Environments, 5(3):274--289, 1996.
• 8: David Zeltzer, Autonomy, interaction, and presence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.127-132, Winter 1992
• 9: G. Riva, F. Davide and W. A IJsselsteijn (Eds.) Being There: Concepts, effects and measurement of user presence in synthetic environments. Ios Press, 2003, Amsterdam, The Netherlands
• 10: H. G. Hoffman, T. Richards, B. Coda, A. Richards, and S. R. Sharar. The illusion of presence in immersive virtual reality during an fmri brain scan. Cyberpsychology and Behavior, 6(2):127--131, 2003.
• 11: W. A. Ijsselsteijn, H. de Ridder, J. Freeman, S. E. Avons, and D. Bouwhuis. Effects of stereoscopic presentation, image motion, and screen size on subjective and objective corroborative measures of presence. Presence: Teleoperators and Virtual Environments, 10(3):298--311, 6 2001.
• 12: F. Macar, H. Lejeune, M. Bonnet, A. Ferrara., V. Pouthas, F. Vidal, and P. Maquet. Activation of the supplementary motor area and of attentional networks during temporal processing. Exp. Brain Res., 142(4):475--485, 1 2002.
• 13: M. M. Mesulam. Attention, Confusional States and Neglect. Davis, Philadelphia, 1985.
• 14: R. Mraz, J. Hong, G. Quintin, K. Zakzanis, and S. Graham. A platform for combining virtual reality and fmri through multidisciplinary experiments involving basic neuroscience, engineering, and neuropsychology. In 10th Annual Scientific Meeting of International Society of Magnetic Resonance in Medicine. ISMRM, May 2002.
• 15: D. Nunez. A connectionist explanation of presence in virtual environments. MPhil Thesis, 2003.
• 16: F. Ortunõ, N. Ojeda, J. Arbizu, P. López, J. M. Marti-Climent, I. Pen~uelas, and S. Cervera. Sustained attention in a counting task: Normal performance and functional neuroanatomy. NeuroImage, 17(1):411--420, 1 2002.
• 17: J. V. Pardo, P. T. Fox, and M. E. Raichle. Localization of a human system for sustained attention by positron emission tomography. Nature, 349:61--62, 1 1991.
• 18: M. I. Posner and S. E. Petersen. The attention system of the human brain. Annu. Rev. Neurosci, 13:25--42, 1990.
• 19: Holger Regenbrecht , Thomas Schubert, Real and illusory interactions enhance presence in virtual environments, Presence: Teleoperators and Virtual Environments, v.11 n.4, p.425-434, August 2002 [doi>10.1162/105474602760204318]
• 20: L. Rueckert, N. Lange, A. Patriot, I. Appollonio, I. Litvan, D. L. Bihan, and J. Grafman. Visualizing cortical activation during mental calculation with functional mri. Neurolmage, 3(2):97--103, 4 1996.
• 21: Corina Sas , Gregory M. P. O'Hare, Presence equation: an investigation into cognitive factors underlying presence, Presence: Teleoperators and Virtual Environments, v.12 n.5, p.523-537, October 2003 [doi>10.1162/105474603322761315]
• 22: Jane Hwang , Gerard J. Kim , Albert Skip Rizzo, Space extension: the perceptual presence perspective, Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry, June 16-18, 2004, Singapore [doi>10.1145/1044588.1044651]
• 23: Wooyoung Shim , Gerard Jounghyun Kim, Designing for presence and performance: the case of the virtual fish tank, Presence: Teleoperators and Virtual Environments, v.12 n.4, p.374-386, August 2003 [doi>10.1162/105474603322391613]
• 24: Mel Slater, Do Avatars Dream of Digital Sheep? Virtual People and the Sense of Presence, Proceedings of the IEEE Virtual Reality Conference 2002, p.3, March 24-28, 2002
• 25: J. Talairach and P. Tournoux. Co-Planar Stereotaxic Atlas of the Human Brain. Thieme, Stuttgart, 1988.
• 26: J. A. Waterworth , E. L. Waterworth, Being and time: judged presence and duration as a function of media form, Presence: Teleoperators and Virtual Environments, v.12 n.5, p.495-511, October 2003 [doi>10.1162/105474603322761298]
• 27: J. A. Waterworth and E. L. Waterworth. Focus, locus and sensus: the 3 dimensions of virtual experience. Cyberpsychology and Behavior, 4(2):203--214, 2001.
• 28: B. G. Witmer and M. J. Singer. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3):225--240, 6 1998.
• 29: Randy Pausch , Dennis Proffitt , George Williams, Quantifying immersion in virtual reality, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.13-18, August 1997 [doi>10.1145/258734.258744]
• 30: Thomas B. Sheridan, Musings on telepresence and virtual presence, Presence: Teleoperators and Virtual Environments, v.1 n.1, p.120-126, Winter 1992
• 31: Carrie Heeter, Being there: the subjective experience of presence, Presence: Teleoperators and Virtual Environments, v.1 n.2, p.262-271, Spring 1992
• 32: R. S. Kalawsky , S. T. Bee , S. P. Nee, Human Factors Evaluation Techniques to Aid Understanding of Virtual Interfaces, BT Technology Journal, v.17 n.1, p.128-141, January 1999 [doi>10.1023/A:1009687227736]
• 33: Michael W. McGreevy, The presence of field geologists in Mars-like terrain, Presence: Teleoperators and Virtual Environments, v.1 n.4, p.375-403, Fall 1992
• 34: M. Slater, M. Usoh, V. Linakis, and R. Kooper. Immersion, presence and performance in virtual environments: An experiment with tri-dimensional chess. Proceedings of 1996 ACM VRST, 163--172, 1996
• 35: R. B. Welch, T. T. Blackman, A. Liu, B. A. Mellers, and W. Stark. The effects of pictorial realism, delay of visual feedback, and observer interactivity on the subjective sense of presence. Presence: Teleoperators and Virtual Environments, 5, 263--273, 1996
• 36: M. J. Wells. Virtual reality: Technology, experience, assumptions. Human Factors Society Bulletin, 35(1), 1--3, 1992

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Human Factors

Keywords:
attention, fMRI, presence, virtual reality