Conference state estimation by biosignal processing: observation of heart rate resonance

ABSTRACT

This paper discusses a conference state estimation method that uses only biosignal processing; linguistic understanding is avoided. In conventional dialogue communication research, the physiological characteristic of "entrainment" between the participants has been already reported. We extend "entrainment" to introduce the concept of "resonance" to grasp the relationship between attendees. We then propose a method which estimates the conference state from "resonance". First, using a multimedia conference system, we record conference data including time-series records of the participants' heart rates. By observing and analyzing the conference data, we assess the "resonance" phenomenon among the talkers. Using the "resonance correlation matrix", a newly proposed index based on the correlation of the heart rate data, conference participative state can be successfully estimated.

REFERENCES

• 1: Miyata, A., Fukui, K., Honda, K., Shigeno, H. and Okada, K. A New Way for Analyzing Meeting Using Brain Wave Informations. IPSJ SIG Tech. Rep., 2003-DPS-113 (12), 63--68. (in Japanese)
• 2: Nakayama, A., Hosoda, M., Indo, T., Kobayashi, M. and Iwaki, S. Video Conference Grasper Based on a Video Conference Corpus and its Multimedia Data Mining. IPSJ SIG Tech. Rep., 2003-GN-49 (20), 115--120. (in Japanese)
• 3: Sayers, B. M. Analysis of Heart Rate Variability. Ergonomics, 16, 1 (1973), 17--32.
• 4: Watanabe, T., Okubo, M. and Kuroda, T. Analysis of Entrainment in Face-to-Face Interaction Using Heart Rate Variability. Proc. IEEE RO-MAN'96, 141--145.
• 5: Watanabe, T. and Okubo, M. SAKURA: Voice-Driven Embodied Group-Entrained Communication System. Proc. HCI International 2003, 2, 558--562.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

General Terms:
Human Factors, Measurement, Theory

Keywords:
biosignal, conference state, heart rate, resonance correlation matrix