ACM Home Page
Please provide us with feedback. Feedback
Manipulating lossless video in the compressed domain
Full text PdfPdf (961 KB)
Source
International Multimedia Conference archive
Proceedings of the seventeen ACM international conference on Multimedia table of contents
Beijing, China
SESSION: Applications track A3: information summarization table of contents
Pages 331-340  
Year of Publication: 2009
ISBN:978-1-60558-608-3
Authors
William Thies  Microsoft Research India, Bangalore, India
Steven Hall  Massachusetts Institute of Technology, Cambridge, MA, USA
Saman Amarasinghe  Massachusetts Institute of Technology, Cambridge, MA, USA
Sponsor
SIGMULTIMEDIA: ACM Special Interest Group on Multimedia
Publisher
ACM  New York, NY, USA
Bibliometrics
Downloads (6 Weeks): 29,   Downloads (12 Months): 29,   Citation Count: 0
Additional Information:

abstract   references   index terms  

Tools and Actions: Request Permissions Request Permissions    Review this Article  
DOI Bookmark: Use this link to bookmark this Article: http://doi.acm.org/10.1145/1631272.1631319
What is a DOI?

ABSTRACT

A compressed-domain transformation is one that operates directly on the compressed format, rather than requiring conversion to an uncompressed format prior to processing. Performing operations in the compressed domain offers large speedups, as it reduces the volume of data processed and avoids the overhead of re-compression.

While previous researchers have focused on compressed-domain techniques for lossy data formats, there are few techniques that apply to lossless formats. In this paper, we present a general technique for transforming lossless data as compressed with the sliding-window Lempel Ziv algorithm (LZ77). We focus on applications in video editing, where our technique supports color adjustment, video compositing, and other operations directly on the Apple Animation format (a variant of LZ77).

We implemented a subset of our technique as an automatic program transformation. Using the StreamIt language, users write a program to operate on uncompressed data, and our compiler transforms the program to operate on compressed data. Experiments show that the technique offers speedups roughly proportional to the compression factor. For our benchmark suite of 12 videos in Apple Animation format, speedups range from 1.1x to 471x, with a median of 15x.


REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

 
1
S. Acharya and B. Smith. Compressed domain transcoding of MPEG. Int. Conf. on Multimedia Computing and Systems, 1998.
 
2
About digital video editing. Adobe online education materials, 2006. http://www.adobe.com/education/pdf/cib/pre65_cib/pre65_cib02.pdf.
 
3
G. Bilsen, M. Engels, R. Lauwereins, and J. Peperstraete. Cyclo-static data flow. In ICASSP, 1995.
 
4
S. Chang. Compressed-domain techniques for image/video indexing and manipulation. Conference on Image Processing, 1995.
 
5
C. Dorai, N. Ratha, and R. Bolle. Detecting dynamic behavior in compressed fingerprint videos: distortion. CVPR, 2, 2000.
 
6
R. Dugad and N. Ahuja. A fast scheme for image size change in the compressed domain. IEEE Trans. on Circuits and Systems for Video Technology, 11(4), 2001.
 
7
M. Farach and M. Thorup. String matching in lempel-ziv compressed strings. Algorithmica, 20, 1998.
 
8
G. Feng and J. Jiang. Image segmentation in compressed domain. Journal of Electronic Imaging, 12(3), 2003.
 
9
R. Harrington, R. Max, and M. Geduld. After Effects on the Spot: Time-Saving Tips and Shortcuts from the Pros. Focal Press, 2004.
 
10
E. A. Lee and D. G. Messerschmitt. Static scheduling of synchronous data flow programs for digital signal processing. IEEE Trans. on Computers, 1987.
 
11
B. Long and S. Schenk. Digital Filmmaking Handbook. Charles River Media, 2002.
 
12
M. Mandal, F. Idris, and S. Panchanathan. A critical evaluation of image and video indexing techniques in the compressed domain. Image and Vision Computing, 17(7), 1999.
 
13
V. Misra, J. Arias, and A. Chhabra. A memory efficient method for fast transposing run-length encoded images. Int. Conf. on Document Analysis and Recognition, 1999.
 
14
J. Mukherjee and S. Mitra. Image resizing in the compressed domain using subband DCT. IEEE Trans. on Circuits and Systems for Video Technology, 12(7), 2002.
 
15
J. Nang, O. Kwon, and S. Hong. Caption processing for MPEG video in MC-DCT compressed domain. ACM Multimedia, 2000.
 
16
G. Navarro. Regular expression searching on compressed text. Journal of Discrete Algorithms, 1, 2003.
 
17
G. Navarro and J. Tarhio. LZgrep: a Boyer-Moore string matching tool for Ziv-Lempel compressed text. Soft. Pract. Exper., 35, 2005.
 
18
D. Pogue. IMovie 3 & IDVD: The Missing Manual. O'Reilly, 2003.
 
19
B. Shen and I. Sethi. Convolution--based edge detection for image/video in block DCT domain. Journal of Visual Communication and Image Representation, 7(4), 1996.
 
20
B. Shen and I. Sethi. Block-based manipulations on transform-compressed images and videos. Multim. Sys., 6(2), 1998.
 
21
K. Shoji. An algorithm for affine transformation of binary images stored in pxy tables by run format. Systems and computers in Japan, 26(7), 1995.
 
22
B. Smith. A survey of compressed domain processing techniques. Cornell University, 1995.
 
23
B. Smith and L. Rowe. Compressed domain processing of JPEG-encoded images. Real-Time Imaging, 2(2), 1996.
 
24
W. Thies. Language and Compiler Support for Stream Programs. PhD thesis, Massachusetts Institute of Technology, 2009.
 
25
W. Thies, S. Hall, and S. Amarasinghe. Mapping stream programs into the compressed domain. Technical Report MIT-CSAIL-TR-2007-055, MIT, 2007. http://hdl.handle.net/1721.1/39651.
 
26
W. Thies, M. Karczmarek, and S. Amarasinghe. StreamIt: A language for streaming applications. In Int. Conf. on Compiler Construction, 2002.
 
27
B. Vasudev. Compressed-domain reverse play of MPEG video streams. SPIE Conf. on Multimedia Systems and Applications, 1998.
 
28
S. Wee, B. Shen, and J. Apostolopoulos. Compressed-domain video processing. HP Labs Technical Report, HPL-2002, 282, 2002.
 
29
A. Wyner and J. Ziv. The sliding-window Lempel-Ziv algorithm is asymptotically optimal. Proceedings of the IEEE, 82(6), 1994.
 
30
N. Ziviani, E. Silva de Moura, G. Navarro, and R. Baeza-Yates. Compression: a key for next-generation text retrieval systems. Computer, 33(11), 2000.