Multimedia enriched digital books

ABSTRACT

This paper proposes new extensions of the digital book concept together with the required approaches to support their automatic generation. Most best-sellers have often inspired other related products, sometimes in different media. Some of these can be merged into suitable forms to provide consumers with a better view and understanding of the original masterpiece: other texts about the original book, images, audio recordings or even films. Several standards and technologies, such as hypermedia, speech and language processing, and widely accessible PDAs, are nowadays available to make these experiences effective. A prototype of a Multimedia Enriched Digital Book (MEDB) is presented for reading, listening and viewing as well as for a text querying scenario. Within the scope of already available technologies, these are tangible visions for the very next years.

REFERENCES

• 1: Harith Alani , Sanghee Kim , David E. Millard , Mark J. Weal , Wendy Hall , Paul H. Lewis , Nigel R. Shadbolt, Automatic Ontology-Based Knowledge Extraction from Web Documents, IEEE Intelligent Systems, v.18 n.1, p.14-21, January 2003 [doi>10.1109/MIS.2003.1179189]
• 2: Black, A. and Arthur Toth, A. 2003. Flexible voice synthesis through articulatory voice transformation http://festvox.org/transform/transform.html
• 3: Burkhardt, F. 2005. Emofilt: the Simulation of Emotional Speech by Prosody-Transformation, In: Proceedings of Interspeech'2005 (Lisbon, Portugal, Set 4-8, 2005), 509--512.
• 4: Ed H. Chi , Lichan Hong , Michelle Gumbrecht , Stuart K. Card, ScentHighlights: highlighting conceptually-related sentences during reading, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040895]
• 5: Daisy Consortium, DAISY/NISO Standard - Specifications for the Digital Talking Book (approved in 2005). Available at http://www.daisy.org/z3986/
• 6: Riad Hammoud , Roger Mohr, Interactive tools for constructing and browsing structures for movie films, Proceedings of the eighth ACM international conference on Multimedia, p.497-498, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.376418]
• 7: Hong, L., Card, S. K. and Chen, J. D. 2006. Turning pages of 3D electronic books. In IEEE Symposium on 3D User Interfaces, (Alexandria, VA, March 25-262006). 159--165.
• 8: Li, Y, Lee, S.-H., Yeh, C.H. and Kuo, C.-C. 2006. Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques, IEEE Signal Processing Magazine, 23, 2, 79--89.
• 9: Rainer Lienhart , Silvia Pfeiffer , Wolfgang Effelsberg, Video abstracting, Communications of the ACM, v.40 n.12, p.54-62, Dec. 1997 [doi>10.1145/265563.265572]
• 10: Mamede, N. and Chaleira, P. 2004. Character identification in children stories. In: EsTAL 2004 - Advances in Natural Language Processing, LNCS, vol. 3230, Springer, Berlin Heidelberg, 82--90.
• 11: Catherine C. Marshall , A. J. Bernheim Brush, Exploring the relationship between personal and public annotations, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996432]
• 12: Martone, A., Taskiran, C. and Delp, E.. 2005. Multimodal approach for speaker identification in news programs. In: SPIE International Conference On Storage and Retrieval Methods and Applications for Multimedia, 5682.
• 13: Bill N. Schilit , Morgan N. Price , Gene Golovchinsky , Kei Tanaka , Catherine C. Marshall, As We May Read: The Reading Appliance Revolution, Computer, v.32 n.1, p.65-73, January 1999 [doi>10.1109/2.738306]
• 14: Teixeira, C. and Respício, A. 2007. See, Hear or Read the Film. In Ma L., Rauterberg M. and Nakatsu R. (eds.): Entertainment Computing - ICEC2007, Proceedings of the 6th International Conference on Entertainment Computing, Lecture Notes in Computer Science, 4740, Springer, 271--281.
• 15: Tsvetomira Tsoneva , Mauro Barbieri , Hans Weda, Automated summarization of narrative video on a semantic level, Proceedings of the International Conference on Semantic Computing, p.169-176, September 17-19, 2007 [doi>10.1109/ICSC.2007.16]
• 16: Turesky, R. and Dimitrova, N. 2004. Screenplay Alignment for Closed-System Speaker Identification and Analysis of Feature Films. In IEEE Proc. of Int. Conf. on Multimedia and Expo, IEEE Press, New York, 1659--1662.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Linguistic processing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods
      H.3.3 Information Search and Retrieval
          Subjects: Search process; Query formulation; Information filtering

General Terms:
Algorithms, Design, Documentation

Keywords:
digital books, multimedia contents integration, multimedia information retrieval, speech and language technologies