Virtual assistant: an artificial agent for enhancing content acquisition: how ambient media elicit information from humans

ABSTRACT

In this paper, we propose a novel framework "Virtual Assistant" for enhancing content potentially procured by ambient media. The Virtual Assistant is an artificial agent simulating a human assistant shown in TV programs and prompts users to provide feedback by asking questions or back-channeling. This framework ensures that sufficient information is provided in the captured content while users interact in a natural and enjoyable way with the agent. We developed a prototype agent based on a chatbot-like approach and applied it to a daily cooking scene. The experimental results demonstrate a good potential of the Virtual Assistant framework, allowing a person to provide feedback easily with few interruptions, lifting the face towards the camera, and eliciting a variety of useful information.

REFERENCES

• 1: Gregory D. Abowd , Christopher G. Atkeson , Aaron F. Bobick , Irfan A. Essa , Blair MacIntyre , Elizabeth D. Mynatt , Thad E. Starner, Living laboratories: the future computing environments group at the Georgia Institute of Technology, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633416]
• 2: Pei-yu Chi , Jen-hao Chen , Hao-hua Chu , Bing-Yu Chen, Enabling nutrition-aware cooking in a smart kitchen, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1241003]
• 3: Marc Davis, Active capture: automatic direction for automatic movies, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957141]
• 4: R. Hamada, K. Miura, I. Ide, S. Satoh, S. Sakai, and H. Tanaka, Multimedia integration for cooking video indexing, Proc. of Pacific-Rim Conference on Multimedia, II:657--664, 2004.
• 5: A. Hashimoto, N. Mori, T. Funatomi, Y. Yamakata, K. Kakusho, and M. Minoh, Smart kitchen: A user centric cooking support system, In Proc. of Information Processing and Management of Uncertainty in Knowledge-Based System, pages 848--854, 2008.
• 6: Hiroshi Ishii , Craig Wisneski , Scott Brave , Andrew Dahley , Matt Gorbet , Brygg Ullmer , Paul Yarin, ambientROOM: integrating ambient media with architectural space, CHI 98 conference summary on Human factors in computing systems, p.173-174, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286652]
• 7: Wendy Ju , Rebecca Hurwitz , Tilke Judd , Bonny Lee, CounterActive: an interactive cookbook for the kitchen counter, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634227]
• 8: A. Lugmayr, Ambient, ambient, ambient - what are ambient media?, TICSP Adjunct Proc. of EuroITV 2007, pages 89--93, 2007.
• 9: Y. Nakauchi, T. Fukuda, K. Noguchi, and T. Matsubara, Intelligent kitchen: Cooking support by lcd and mobile robot with ic-labeled objects, Proc. of Int'l Conf. on Intelligent Robots and Systems, 2005.
• 10: M. Ozeki, Y. Nakamura, and Y. Ohta, Automated camerawork for capturing desktop presentations, IEE Proc. on Vision, Image & Signal Processing, 152(4):437--447, 2005.
• 11: C. Pinhanez and A. Bobick, Intelligent studios: Modeling space and action to control tv cameras, Proc. of Applications of Artificial Intelligence, 11(4):285--306, 1997.
• 12: M. Rougvie and P. Olivier, Dynamic editing methods for interactively adapting cinematographic style, TICSP Adjunct Proc. of EuroITV 2007, pages 304--308, 2007.
• 13: Itiro Siio , Noyuri Mima , Ian Frank , Tetsuo Ono , Hillel Weintraub, Making recipes in the kitchen of the future, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986130]
• 14: E. M. Tapia, S. S. Intille, and K. Larson, Activity recognition in the home setting using simple and ubiquitous sensors, Proc. of Pervasive 2004, LNCS 3001:158--175, 2004.
• 15: Q. T. Tran, G. Calcaterra, and E. D. Mynatt, Cook's collage: Deja vu display for a home kitchen, Proc. of Home-Oriented Informatics and Telematics 2005, pages 15--32, 2005.
• 16: Tatsuya Yamazaki, Ubiquitous Home: Real-Life Testbed for Home Context-Aware Service, Proceedings of the First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities, p.54-59, February 23-25, 2005 [doi>10.1109/TRIDNT.2005.37]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications

General Terms:
Design, Experimentation

Keywords:
ambient media, artificial agent, content acquisition