Viewing meeting captured by an omni-directional camera

ABSTRACT

One vision of future technology is the ability to easily and inexpensively capture any group meeting that occurs, store it, and make it available for people to view anytime and anywhere on the network. One barrier to achieving this vision has been the design of low-cost camera systems that can capture important aspects of the meeting without needing a human camera operator. A promising solution that has emerged recently is omni-directional cameras that can capture a 360-degree video of the entire meeting.The panoramic capability provided by these cameras raises both new opportunities and new issues for the interfaces provided for post-meeting viewers — for example, do we show all meeting participants all the time or do we just show the person who is speaking, how much control do we provide to the end-user in selecting the view, and will providing this control distract them from their task. These are not just user interface issues, they also raise tradeoffs for the client-server systems used to deliver such content. They impact how much data needs to be stored on the disk, what computation can be done on the server vs. the client, and how much bandwidth is needed. We report on a rototype system built using an omni-directional camera and results from user studies of interface preferences expressed by viewers.

REFERENCES

• 1: BeHere, http://www.behere.com/
• 2: Scott Brave , Hiroshi Ishii , Andrew Dahley, Tangible interfaces for remote collaboration and communication, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.169-178, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289491]
• 3: Buxton, W., Sellen, A., & Sheasby, M., Interfaces for multiparty videoconferences, Video-mediated communication (edited by Finn, K., Sellen, A., & Wilbur, S.), Lawrence Erlbaum Associates, Publishers, 1997
• 4: A. Colmenarez , T. Huang, Face Detection With Information-Based Maximum Discrimination, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.782, June 17-19, 1997
• 5: Daniilidis, K., Preface, Proc. of IEEE Workshop on Omnidirectional Vision, June, 12, 2000.
• 6: Scott Elrod , Richard Bruce , Rich Gold , David Goldberg , Frank Halasz , William Janssen , David Lee , Kim McCall , Elin Pedersen , Ken Pier , John Tang , Brent Welch, Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems, p.599-607, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143052]
• 7: Li-wei He , Michael F. Cohen , David H. Salesin, The virtual cinematographer: a paradigm for automatic real-time camera control and directing, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.217-224, August 1996 [doi>10.1145/237170.237259]
• 8: Liwei He , Jonathan Grudin , Anoop Gupta, Designing presentations for on-demand viewing, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.127-134, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358983]
• 9: Liwei He , Elizabeth Sanocki , Anoop Gupta , Jonathan Grudin, Comparing presentation summaries: slides vs. reading vs. listening, Proceedings of the SIGCHI conference on Human factors in computing systems, p.177-184, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332427]
• 10: Huang, Q., Cui, Y., and Samarasekera S., Content based active video data acquisition via automated cameramen, Proc. IEEE ICIP'98, 808- 811.
• 11: Kang, S.-B., Catadioptric self-calibration, Proc. of IEEE CVPR, June 12, 2000, I:201-208.
• 12: Liu, Z., Zhang, Z., Jacobs, C., and Cohen, M., Rapid Modeling of Animated Faces From Video. Technical Report, Microsoft Research 99- 21, April 1999.
• 13: Steven McCanne , Van Jacobson, vic: a flexible framework for packet video, Proceedings of the third ACM international conference on Multimedia, p.511-522, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215315]
• 14: Thomas P. Moran , Leysia Palen , Steve Harrison , Patrick Chiu , Don Kimber , Scott Minneman , William van Melle , Polle Zellweger, “I'll get that off the audio”: a case study of salvaging multimedia meeting records, Proceedings of the SIGCHI conference on Human factors in computing systems, p.202-209, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258704]
• 15: Mircea Nicolescu , Gerard Medioni , Mi-Suen Lee, Segmentation, Tracking and Interpretation Using Panoramic Video, Proceedings of the IEEE Workshop on Omnidirectional Vision, p.169, June 16-16, 2000
• 16: Nishimura, T., Yabe, H., and Oka, R., Indexing of human motion at meeting room by analyzing time-varying images of omni-directional camera, Proc. IEEE ACCV'00, 1-4.
• 17: Nosa Omoigui , Liwei He , Anoop Gupta , Jonathan Grudin , Elizabeth Sanocki, Time-compression: systems concerns, usage, and benefits, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.136-143, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303017]
• 18: PictureTel, http://www.picturetel.com/
• 19: PictureTel, Enhanced continuous presence, http://www.picturetel.com
• 20: Sellen, A., Remote conversations: the effects of mediating talk with technology, Human-Computer Interaction, 10(4), 401-444.
• 21: Stanford Online, http://stanford-onlines.stanford.edu/
• 22: Rainer Stiefelhagen , Jie Yang , Alex Waibel, Modeling focus of attention for meeting indexing, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.3-10, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319464]
• 23: John C. Tang , Monica Rua, Montage: providing teleproximity for distributed groups, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.37-43, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191688]
• 24: USC Integrated Media Systems Center, http://imsc.usc.edu/ education/education.htm
• 25: Wong, T., Hand and ear: enhancing awareness of others in MASH videoconferencing tools, Project report, University of California, Berkeley, http://www.cs.berkeley.edu/~twong/classes/cscw/report. html
• 26: Zhigang Zhu , K. Deepak Rajasekar , Edward M. Riseman , Allen R. Hanson, Panoramic Virtual Stereo Vision of Cooperative Mobile Robots for Localizing 3D Moving Objects, Proceedings of the IEEE Workshop on Omnidirectional Vision, p.29, June 16-16, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Computer conferencing, teleconferencing, and videoconferencing

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design, Human Factors, Management, Measurement, Performance, Theory

Keywords:
omni-directional camera systems, on-demand meeting watching