Fragment, tag, enrich, and send: Enhancing social sharing of video

ABSTRACT

The migration of media consumption to personal computers retains distributed social viewing, but only via nonsocial, strictly personal interfaces. This article presents an architecture, and implementation for media sharing that allows for enhanced social interactions among users. Using a mixed-device model, our work allows targeted, personalized enrichment of content. All recipients see common content, while differentiated content is delivered to individuals via their personal secondary screens. We describe the goals, architecture, and implementation of our system in this article. In order to validate our results, we also present results from two user studies involving disjoint sets of test participants.

REFERENCES

• 1: Gregory D. Abowd , Matthias Gauger , Andreas Lachenmann, The Family Video Archive: an annotation and browsing environment for home movies, Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, November 07-07, 2003, Berkeley, California [doi>10.1145/973264.973266]
• 2: Brett Adams , Svetha Venkatesh , Ramesh Jain, IMCE: Integrated media creation environment, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.1 n.3, p.211-247, August 2005 [doi>10.1145/1083314.1083315]
• 3: Dick C. A. Bulterman , Lynda Hardman, Structured multimedia authoring, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.1 n.1, p.89-109, February 2005 [doi>10.1145/1047936.1047943]
• 4: Dick C.A. Bulterman , Lloyd W. Rutledge, SMIL 3.0: Flexible Multimedia for Web, Mobile Devices and Daisy Talking Books, Springer Publishing Company, Incorporated, 2008
• 5: Renan G. Cattelan , Cesar Teixeira , Rudinei Goularte , Maria Da Graça C. Pimentel, Watch-and-comment as a paradigm toward ubiquitous interactive video editing, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.4 n.4, p.1-24, October 2008 [doi>10.1145/1412196.1412201]
• 6: Pablo Cesar , Dick C.A. Bulterman , David Geerts , Jack Jansen , Hendrik Knoche , William Seager, Enhancing social sharing of videos: fragment, annotate, enrich, and share, Proceeding of the 16th ACM international conference on Multimedia, October 26-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1459359.1459362]
• 7: Meeyoung Cha , Haewoon Kwak , Pablo Rodriguez , Yong-Yeol Ahn , Sue Moon, I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system, Proceedings of the 7th ACM SIGCOMM conference on Internet measurement, October 24-26, 2007, San Diego, California, USA [doi>10.1145/1298306.1298309]
• 8: CHORIANOPOULOS, K. 2007. Content-enriched communication supporting the social uses of TV. J. Commun. Net. 6, 1, 23-30.
• 9: Romualdo Monteiro de Resende Costa , Márcio Ferreira Moreno , Rogério Ferreira Rodrigues , Luiz Fernando Gomes Soares, Live editing of hypermedia documents, Proceedings of the 2006 ACM symposium on Document engineering, October 10-13, 2006, Amsterdam, The Netherlands [doi>10.1145/1166160.1166202]
• 10: David Dearman , Jeffery S. Pierce, It's on my other computer!: computing with multiple devices, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357177]
• 11: Phillipa Gill , Martin Arlitt , Zongpeng Li , Anirban Mahanti, Youtube traffic characterization: a view from the edge, Proceedings of the 7th ACM SIGCOMM conference on Internet measurement, October 24-26, 2007, San Diego, California, USA [doi>10.1145/1298306.1298310]
• 12: Rudinei Goularte , Edson dos Santos Moreira , Maria da Graça C. Pimentel, Structuring interactive TV documents, Proceedings of the 2003 ACM symposium on Document engineering, November 20-22, 2003, Grenoble, France [doi>10.1145/958220.958229]
• 13: Martin J. Halvey , Mark T. Keane, Exploring social dynamics in online media sharing, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242804]
• 14: Cristian Hesselman , Pablo Cesar , Ishan Vaishnavi , Mathieu Boussard , Ralf Kernchen , Stefan Meissner , Antonietta Spedalieri , Albert Sinfreu , Christian Räck, Delivering interactive multimedia services in dynamic pervasive computing environments, Proceedings of the 1st international conference on Ambient media and systems, p.1-8, February 11-14, 2008, Quebec, Canada
• 15: Xian-Sheng Hua , Shipeng Li, Interactive video authoring and sharing based on two-layer templates, Proceedings of the 1st ACM international workshop on Human-centered multimedia, October 27-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178745.1178758]
• 16: Elaine M. Huang , Gunnar Harboe , Joe Tullio , Ashley Novak , Noel Massey , Crysta J. Metcalf , Guy Romano, Of social television comes home: a field study of communication choices and practices in tv-based text and voice chat, Proceedings of the 27th international conference on Human factors in computing systems, April 04-09, 2009, Boston, MA, USA [doi>10.1145/1518701.1518792]
• 17: Tero Jokela , Jaakko T. Lehikoinen , Hannu Korhonen, Mobile multimedia presentation editor: enabling creation of audio-visual stories on mobile devices, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357066]
• 18: Tim Kindberg , Mirjana Spasojevic , Rowanne Fleck , Abigail Sellen, I saw this and thought of you: some social uses of camera phones, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056962]
• 19: David Kirk , Abigail Sellen , Richard Harper , Ken Wood, Understanding videowork, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240634]
• 20: Harald Kosch , Laszlo Boszormenyi , Mario Doller , Mulugeta Libsie , Peter Schojer , Andrea Kofler, The Life Cycle of Multimedia Metadata, IEEE MultiMedia, v.12 n.1, p.80-86, January 2005 [doi>10.1109/MMUL.2005.13]
• 21: Jingjing Liu , Yalou Huang , Dong Li , Fanghao Wu , Bin Li, A web-based aggregated platform for user-contributed interactive media broadcasting, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291366]
• 22: Cameron Marlow , Mor Naaman , Danah Boyd , Marc Davis, HT06, tagging paper, taxonomy, Flickr, academic article, to read, Proceedings of the seventeenth conference on Hypertext and hypermedia, August 22-25, 2006, Odense, Denmark [doi>10.1145/1149941.1149949]
• 23: METCALF, C., HARBOE, G., TULLIO, J., MASSEY, N., ROMANO, G., HUANG, E. M., AND BENTLEY, F. 2008. Examining presence and lightweight messaging in a social television experience. ACM Trans. Multimedia Comput. Commun. Appl. 5, 2, article 27.
• 24: Mukesh Nathan , Chris Harrison , Svetlana Yarosh , Loren Terveen , Larry Stead , Brian Amento, CollaboraTV: making television viewing social again, Proceeding of the 1st international conference on Designing interactive user experiences for TV and video, October 22-24, 2008, Silicon Valley, California, USA [doi>10.1145/1453805.1453824]
• 25: Kenton O'Hara , April Slayden Mitchell , Alex Vorbau, Consuming video on mobile devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240754]
• 26: Roy Pea , Michael Mills , Joseph Rosen , Kenneth Dauber , Wolfgang Effelsberg , Eric Hoffert, The Diver Project: Interactive Digital Video Repurposing, IEEE MultiMedia, v.11 n.1, p.54-61, January 2004 [doi>10.1109/MMUL.2004.1261108]
• 27: Silvia Pfeiffer , Conrad Parker , Claudia Schremmer, Annodex: a simple architecture to enable hyperlinking, search & retrieval of time--continuous data on the Web, Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, November 07-07, 2003, Berkeley, California [doi>10.1145/973264.973279]
• 28: RUTLEDGE, L. AND SCHMITZ, P. 2001. Improving media fragment integration in emerging Web formats. In Proceedings of the ACM Multimedia Modeling Conference, 147-166.
• 29: Nikitas M. Sgouros , Alexandros Margaritis, Towards open source authoring and presentation of multimedia content, Proceedings of the international workshop on Human-centered multimedia, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290128.1290136]
• 30: David A. Shamma , Ryan Shaw , Peter L. Shafton , Yiming Liu, Watch what I watch: using community activity to understand content, Proceedings of the international workshop on Workshop on multimedia information retrieval, September 24-29, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290082.1290120]
• 31: Ryan Shaw , Patrick Schmitz, Community annotation and remix: a research platform and pilot deployment, Proceedings of the 1st ACM international workshop on Human-centered multimedia, October 27-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178745.1178761]
• 32: Frank Shipman , Andreas Girgensohn , Lynn Wilcox, Authoring, viewing, and generating hypervideo: An overview of Hyper-Hitchcock, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.5 n.2, p.1-19, November 2008 [doi>10.1145/1413862.1413868]
• 33: Giorgos Stamou , Jacco van Ossenbruggen , Jeff Z. Pan , Guus Schreiber, Multimedia Annotations on the Semantic Web, IEEE MultiMedia, v.13 n.1, p.86-90, January 2006 [doi>10.1109/MMUL.2006.15]
• 34: Alex S. Taylor , Richard Harper, Age-old practices in the 'new world': a study of gift-giving between teenage mobile phone users, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503455]
• 35: Nancy Van House , Marc Davis , Morgan Ames , Megan Finn , Vijay Viswanathan, The uses of personal networked digital imaging: an empirical study of cameraphone photos and sharing, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057039]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Information browsers

Additional Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Languages and systems; Hypertext/hypermedia; Multi/mixed media; Format and notation

General Terms:
Design, Documentation, Experimentation, Languages

Keywords:
Asynchronous media sharing, differentiated content enrichment, secondary screens