Visualizing the pulse of a classroom

ABSTRACT

Effective classroom teaching often requires an instructor to be acutely aware of every student. The instructor must rapidly look from student to student to catch fleeting gestures or facial expressions. To facilitate the tracking of communicative actions in a remote classroom, we built a multiparty videoconferencing system that automatically determine whether students are speaking, making gestures, or moving in their seats. These activity indicators are displayed over the video such that the instructor can see into the recent past. The activity indicators are also grouped into a visualization of the classroom interaction dynamics, thereby providing a measure of the pulse of the classroom.We conducted a user study where teachers used our system in a simulated class. The teachers found that the activity indicators to be a useful teaching aid during class; however, the indicators are most useful as a record of the class. In a student survey, we found that if audio, video, or activity indicators must be recorded, students overwhelmingly prefer activity indicators since the indicators mask the content of the communication and thus are less intrusive to the students' privacy.

REFERENCES

• 1: Mark S. Ackerman , Brian Starr, Social activity indicators: interface components for CSCW systems, Proceedings of the 8th annual ACM symposium on User interface and software technology, p.159-168, November 15-17, 1995, Pittsburgh, Pennsylvania, United States [doi>10.1145/215585.215969]
• 2: G. Bohrnstedt and B. Stecher. Class Size Reduction in California: The 1998-99 Evaluation Findings. A publication of RAND Corporation, RP-903, 2000.
• 3: Milton Chen, Achieving effective floor control with a low-bandwidth gesture-sensitive videoconferencing system, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641109]
• 4: Milton Chen, Design of a virtual auditorium, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500147]
• 5: C. Darwin. The Expression of the Emotions in Man and Animals, John Murray, 1872, reprinted by University of Chicago Press, 1965.
• 6: Judith Donath , Karrie Karahalios , Fernanda B. Viégas, Visualizing Conversation, Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences-Volume 2, p.2023, January 05-08, 1999
• 7: Thomas Erickson , Mark R. Laff, The design of the 'Babble' timeline: a social proxy for visualizing group activity over time, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634262]
• 8: Thomas Erickson , David N. Smith , Wendy A. Kellogg , Mark Laff , John T. Richards , Erin Bradner, Socially translucent systems: social proxies, persistent conversation, and the design of “babble”, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.72-79, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302997]
• 9: Jeremy M. Heiner , Scott E. Hudson , Kenichiro Tanaka, The information percolator: ambient information display in a decorative object, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.141-148, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322595]
• 10: William C. Hill , James D. Hollan , Dave Wroblewski , Tim McCandless, Edit wear and read wear, Proceedings of the SIGCHI conference on Human factors in computing systems, p.3-9, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142751]
• 11: Jim Hollan , Scott Stornetta, Beyond being there, Proceedings of the SIGCHI conference on Human factors in computing systems, p.119-125, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142769]
• 12: Hiroshi Ishii , Craig Wisneski , Scott Brave , Andrew Dahley , Matt Gorbet , Brygg Ullmer , Paul Yarin, ambientROOM: integrating ambient media with architectural space, CHI 98 conference summary on Human factors in computing systems, p.173-174, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286652]
• 13: Elizabeth D. Mynatt , Maribeth Back , Roy Want , Michael Baer , Jason B. Ellis, Designing audio aura, Proceedings of the SIGCHI conference on Human factors in computing systems, p.566-573, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274720]
• 14: Elin Rønby Pedersen , Tomas Sokoler, AROMA: abstract representation of presence supporting mutual awareness, Proceedings of the SIGCHI conference on Human factors in computing systems, p.51-58, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258584]
• 15: Roy Rodenstein , Judith S. Donath, Talking in circles: designing a spatially-grounded audioconferencing environment, Proceedings of the SIGCHI conference on Human factors in computing systems, p.81-88, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332410]
• 16: M. Rowe. Wait-Time And Rewards As Instructional Variables, Their Influence In Language, Logic, And Fate Control. Paper presented at the National Association for Research in Science Teaching, Chicago, IL, 1972.
• 17: Warren Sack, Discourse Diagrams: Interface Design for Very Large-Scale Conversations, Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 3, p.3034, January 04-07, 2000
• 18: J. Short, E. Williams, and B. Christie. The Social Psychology of Telecommunications. London, U.K. Wiley, 1976.
• 19: Marc A. Smith , Andrew T. Fiore, Visualization components for persistent conversations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.136-143, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365073]
• 20: Fernanda B. Viégas , Judith S. Donath, Chat circles, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.9-16, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302981]
• 21: B. Wandell. Foundations of Vision, Sunderland, MA: Sinauer Associates, 1995.
• 22: Alan Wexelblat , Pattie Maes, Footprints: history-rich tools for information foraging, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.270-277, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303060]
• 23: Rebecca Xiong , Judith Donath, PeopleGarden: creating data portraits for users, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.37-44, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322581]
• 24: Intel Image Processing Library http://developer.intel.com/software/products/perflib/ipl

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Computer conferencing, teleconferencing, and videoconferencing

General Terms:
Human Factors

Keywords:
activity history, visualization of communication pattern