|
ABSTRACT
Motion estimation is a key component of modern video encoding and is very compute-intensive. We present a novel Sensor-assisted Video Encoding (SaVE) method to reduce the computational complexity of motion estimation in H.264/AVC encoders, leveraging accelerometers and digital compasses that are increasingly available on mobile devices. Using these sensors, SaVE calculates the rotational movement of a camera and then infers the global motion in the camera image sensor; it subsequently employs the estimated global motion to simplify the state-of-the-art motion estimation algorithms, UMHS and EPZS used in H.264/AVC encoders. We have constructed a prototype of SaVE and report extensive evaluation of it. Our experimental results show that SaVE can reduce the computations of UMHS and EPZS algorithms by up to 27% and 18%, respectively, while achieving the same or better video quality.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
M. Tourapis, "Fast ME in the JM reference software," JVT Document JVT-P026, 16th Meeting, pp. 24--29, 2005.
|
| |
2
|
G. Hong, Y. Wang, A. Rahmati et al., "SenseCoding: Accelerometer-Assisted Motion Estimation for Efficient Video Encoding," Proc. ACM Multimedia Conference, Oct. 26-31, 2008.
|
| |
3
|
Z. Chen, J. Xu, Y. He et al., "Fast integer-pel and fractional-pel motion estimation for H.264/AVC," Journal of Visual Communication and Image Representation, vol. 17, no. 2, pp. 264--290, 2006.
|
| |
4
|
Z. Chen, P. Zhou, and Y. He, "Fast Motion Estimation for JVT," JVT Document JVT-G016, pp. 7--14, 2003.
|
| |
5
|
A. M. Tourapis, "Enhanced Predictive Zonal Search for Single and Multiple Frame Motion Estimation," Proc. SPIE Conf. Visual Communications and Image Processing, vol. 4671, pp. 1069--1079, Jan., 2002.
|
| |
6
|
T. Koga, K. Iinuma, A. Hirano et al., "Motion compensated interframe coding for video conferencing," Proc. IEEE National Telecommunication Conference, pp. G5.3.1-5.3.5, Nov. 29 - Dec. 3, 1981.
|
| |
7
|
R. Li, B. Zeng, and M. L. Liou, "A new three-step search algorithm for block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 4, no. 4, pp. 438--442, 1994.
|
| |
8
|
L. M. Po, and W. C. Ma, "A novel four-step search algorithm for fast block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 6, no. 3, pp. 313--317, 1996.
|
| |
9
|
Z. Shan, and M. Kai-Kuang, "A new diamond search algorithm for fast block-matching motion estimation," IEEE Trans. on Image Processing, vol. 9, no. 2, pp. 287--290, 2000.
|
| |
10
|
C. H. Cheung, and L. M. Po, "A novel cross-diamond search algorithm for fast block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 12, no. 12, pp. 1168--1177, 2002.
|
| |
11
|
C. W. Lam, L. M. Po, and C. H. Cheung, "A novel kite-cross-diamond search algorithm for fast block matching motion estimation," Proc. Int. Symp. Circuits and Systems (ISCAS), vol. 3, pp. 729--32, 2004.
|
| |
12
|
S. Eckart, and C. Fogg, "ISO/IEC MPEG-2 software video codec," Proc. SPIE Conf. Visual Communications and Image Processing, vol. 2419, pp. 100--118, 1995.
|
| |
13
|
B. Liu, and A. Zaccarin, "New fast algorithms for the estimation of block motion vectors," IEEE Trans. on Circuits and Systems for Video Technology, vol. 3, no. 2, pp. 148--157, 1993.
|
| |
14
|
C. K. Cheung, and L. M. Po, "Normalized partial distortion search algorithm for block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, no. 3, pp. 417--422, 2000.
|
| |
15
|
C. H. Cheung, and L. M. Po, "Adjustable partial distortion search algorithm for fast block motion estimation," IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, no. 1, pp. 100--110, 2003.
|
| |
16
|
L. W. Lee, J. F. Wang, J. Y. Lee et al., "Dynamic search-window adjustment and interlaced search for block-matching algorithm," IEEE Trans. on Circuits and Systems for Video Technology, vol. 3, no. 1, pp. 85--87, 1993.
|
| |
17
|
K. K. Ma, and P. I. Hosur, "Performance Report of Motion Vector Field Adaptive Search Technique (MVFAST)," ISO/IEC JTC1/SC29/WG11 MPEG99/m5851, March, 2000.
|
| |
18
|
A. M. Tourapis, O. C. Au, and M. L. Liou, "Predictive motion vector field adaptive search technique (PMVFAST) enhancing block-based motion estimation," Proc. SPIE Conf. Visual Communication and Image Processing, pp. 883--892, Jan., 2001.
|
| |
19
|
K.-y. Yoo, and J.-k. Kim, "A new fast local motion estimation algorithm using global motion," Signal Processing, vol. 68, no. 2, pp. 219--224, 1998.
|
| |
20
|
H. Jozawa, K. Kamikura, A. Sagata et al., "Two-stage motion compensation using adaptive global MC and local affine MC," IEEE Trans. on Circuits and Systems for Video Technology, vol. 7, no. 1, pp. 75--85, 1997.
|
| |
21
|
D. Adolph, and R. Buschmann, "1.15 Mbit/s coding of video signals including global motion compensation," Signal Processing: Image Communication, vol. 3, no. 2-3, pp. 259--274, 1991.
|
| |
22
|
M. Ulrich, and S. Martin, "Sensor Assited Video Compression", European Patent Application EP1921867.
|
| |
23
|
Texas Instruments DM6446 H.264 media processor, http://focus.ti.com.cn/cn/lit/an/spraad6a/spraad6a.pdf.
|
| |
24
|
J. Heikkila, and O. Silven, "A four-step camera calibration procedure with implicit image correction," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1106--1112, 1997.
|
| |
25
|
Z. Zhang, "Flexible camera calibration by viewing a plane from unknown orientations," Proc. IEEE Int. Conf. Computer Vision, vol. 1, pp. 666--673, 1999.
|
| |
26
|
Camera Calibration Toolbox for Matlab, http://www.vision.caltech.edu/bouguetj/calib_doc/.
|
| |
27
|
OS5000-S and OS5000 -US digital compass, product of OceanServer Technology, Inc., http://www.ocean-server.com/download/OS5000_Compass_Manual.pdf.
|
| |
28
|
AN013: Position determination using Accelerometers, http://www.kionix.com/sensors/application-notes.html.
|
INDEX TERMS
Primary Classification:
H.
Information Systems
H.5
INFORMATION INTERFACES AND PRESENTATION (I.7)
H.5.1
Multimedia Information Systems
Subjects:
Video (e.g., tape, disk, DVI)
General Terms:
Algorithms,
Design,
Performance
Keywords:
H.264/AVC,
MPEG,
accelerometer,
digital compass,
motion estimation,
sensor,
video encoding
|