ACM Home Page
Please provide us with feedback. Feedback
SaVE: sensor-assisted motion estimation for efficient h.264/AVC video encoding
Full text PdfPdf (2.28 MB)
Source
International Multimedia Conference archive
Proceedings of the seventeen ACM international conference on Multimedia table of contents
Beijing, China
SESSION: System track S1: mobile devices and hardware/sensor support table of contents
Pages 381-390  
Year of Publication: 2009
ISBN:978-1-60558-608-3
Authors
Xiaoming Chen  School of Computing, National University of Singapore, Singapore
Zhendong Zhao  School of Computing, National University of Singapore, Singapore
Ahmad Rahmati  Department of Electrical & Computer Engineering, Rice University, Houston, TX, USA
Ye Wang  School of Computing, National University of Singapore, Singapore
Lin Zhong  Department of Electrical & Computer Engineering, Rice University, Houston, TX, USA
Sponsor
SIGMULTIMEDIA: ACM Special Interest Group on Multimedia
Publisher
ACM  New York, NY, USA
Bibliometrics
Downloads (6 Weeks): 14,   Downloads (12 Months): 14,   Citation Count: 0
Additional Information:

abstract   references   index terms  

Tools and Actions: Request Permissions Request Permissions    Review this Article  
DOI Bookmark: Use this link to bookmark this Article: http://doi.acm.org/10.1145/1631272.1631325
What is a DOI?

ABSTRACT

Motion estimation is a key component of modern video encoding and is very compute-intensive. We present a novel Sensor-assisted Video Encoding (SaVE) method to reduce the computational complexity of motion estimation in H.264/AVC encoders, leveraging accelerometers and digital compasses that are increasingly available on mobile devices. Using these sensors, SaVE calculates the rotational movement of a camera and then infers the global motion in the camera image sensor; it subsequently employs the estimated global motion to simplify the state-of-the-art motion estimation algorithms, UMHS and EPZS used in H.264/AVC encoders. We have constructed a prototype of SaVE and report extensive evaluation of it. Our experimental results show that SaVE can reduce the computations of UMHS and EPZS algorithms by up to 27% and 18%, respectively, while achieving the same or better video quality.


REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

 
1
M. Tourapis, "Fast ME in the JM reference software," JVT Document JVT-P026, 16th Meeting, pp. 24--29, 2005.
 
2
G. Hong, Y. Wang, A. Rahmati et al., "SenseCoding: Accelerometer-Assisted Motion Estimation for Efficient Video Encoding," Proc. ACM Multimedia Conference, Oct. 26-31, 2008.
 
3
Z. Chen, J. Xu, Y. He et al., "Fast integer-pel and fractional-pel motion estimation for H.264/AVC," Journal of Visual Communication and Image Representation, vol. 17, no. 2, pp. 264--290, 2006.
 
4
Z. Chen, P. Zhou, and Y. He, "Fast Motion Estimation for JVT," JVT Document JVT-G016, pp. 7--14, 2003.
 
5
A. M. Tourapis, "Enhanced Predictive Zonal Search for Single and Multiple Frame Motion Estimation," Proc. SPIE Conf. Visual Communications and Image Processing, vol. 4671, pp. 1069--1079, Jan., 2002.
 
6
T. Koga, K. Iinuma, A. Hirano et al., "Motion compensated interframe coding for video conferencing," Proc. IEEE National Telecommunication Conference, pp. G5.3.1-5.3.5, Nov. 29 - Dec. 3, 1981.
 
7
R. Li, B. Zeng, and M. L. Liou, "A new three-step search algorithm for block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 4, no. 4, pp. 438--442, 1994.
 
8
L. M. Po, and W. C. Ma, "A novel four-step search algorithm for fast block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 6, no. 3, pp. 313--317, 1996.
 
9
Z. Shan, and M. Kai-Kuang, "A new diamond search algorithm for fast block-matching motion estimation," IEEE Trans. on Image Processing, vol. 9, no. 2, pp. 287--290, 2000.
 
10
C. H. Cheung, and L. M. Po, "A novel cross-diamond search algorithm for fast block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 12, no. 12, pp. 1168--1177, 2002.
 
11
C. W. Lam, L. M. Po, and C. H. Cheung, "A novel kite-cross-diamond search algorithm for fast block matching motion estimation," Proc. Int. Symp. Circuits and Systems (ISCAS), vol. 3, pp. 729--32, 2004.
 
12
S. Eckart, and C. Fogg, "ISO/IEC MPEG-2 software video codec," Proc. SPIE Conf. Visual Communications and Image Processing, vol. 2419, pp. 100--118, 1995.
 
13
B. Liu, and A. Zaccarin, "New fast algorithms for the estimation of block motion vectors," IEEE Trans. on Circuits and Systems for Video Technology, vol. 3, no. 2, pp. 148--157, 1993.
 
14
C. K. Cheung, and L. M. Po, "Normalized partial distortion search algorithm for block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, no. 3, pp. 417--422, 2000.
 
15
C. H. Cheung, and L. M. Po, "Adjustable partial distortion search algorithm for fast block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, no. 1, pp. 100--110, 2003.
 
16
L. W. Lee, J. F. Wang, J. Y. Lee et al., "Dynamic search-window adjustment and interlaced search for block-matching algorithm," IEEE Trans. on Circuits and Systems for Video Technology, vol. 3, no. 1, pp. 85--87, 1993.
 
17
K. K. Ma, and P. I. Hosur, "Performance Report of Motion Vector Field Adaptive Search Technique (MVFAST)," ISO/IEC JTC1/SC29/WG11 MPEG99/m5851, March, 2000.
 
18
A. M. Tourapis, O. C. Au, and M. L. Liou, "Predictive motion vector field adaptive search technique (PMVFAST) enhancing block-based motion estimation," Proc. SPIE Conf. Visual Communication and Image Processing, pp. 883--892, Jan., 2001.
 
19
K.-y. Yoo, and J.-k. Kim, "A new fast local motion estimation algorithm using global motion," Signal Processing, vol. 68, no. 2, pp. 219--224, 1998.
 
20
H. Jozawa, K. Kamikura, A. Sagata et al., "Two-stage motion compensation using adaptive global MC and local affine MC," IEEE Trans. on Circuits and Systems for Video Technology, vol. 7, no. 1, pp. 75--85, 1997.
 
21
D. Adolph, and R. Buschmann, "1.15 Mbit/s coding of video signals including global motion compensation," Signal Processing: Image Communication, vol. 3, no. 2-3, pp. 259--274, 1991.
 
22
M. Ulrich, and S. Martin, "Sensor Assited Video Compression", European Patent Application EP1921867.
 
23
Texas Instruments DM6446 H.264 media processor, http://focus.ti.com.cn/cn/lit/an/spraad6a/spraad6a.pdf.
 
24
J. Heikkila, and O. Silven, "A four-step camera calibration procedure with implicit image correction," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1106--1112, 1997.
 
25
Z. Zhang, "Flexible camera calibration by viewing a plane from unknown orientations," Proc. IEEE Int. Conf. Computer Vision, vol. 1, pp. 666--673, 1999.
 
26
Camera Calibration Toolbox for Matlab, http://www.vision.caltech.edu/bouguetj/calib_doc/.
 
27
OS5000-S and OS5000 -US digital compass, product of OceanServer Technology, Inc., http://www.ocean-server.com/download/OS5000_Compass_Manual.pdf.
 
28
AN013: Position determination using Accelerometers, http://www.kionix.com/sensors/application-notes.html.