Using offline bitstream analysis for power-aware video decoding in portable devices

ABSTRACT

Dynamic voltage/frequency scheduling algorithms for multimedia applications have recently been a subject of intensive research. Many of these algorithms use control-theoretic feedback techniques to predict the future execution demand of an application based on the demand in the recent past. Such techniques suffer from two major disadvantages: (i) they are computationally expensive, and (ii) it is difficult to give performance or quality-of-service guarantees based on these techniques (since the predictions can occasionally turn out to be incorrect). To address these shortcomings, in this paper we propose a completely new approach for dynamic voltage and frequency scaling. Our technique is based on an offline bitstream analysis of multimedia files. Based on this analysis, we insert metadata information describing the computational demand that will be generated when decoding the file. Such bitstream analysis and metadata insertion can be done when the multimedia file is being downloaded into a portable device from a desktop computer. In this paper we illustrate this technique using the MPEG-2 decoder application. We show that the amount of metadata that needs to be inserted is a very small fraction of the total size of the video clip and it can lead to significant energy savings. The metadata inserted will typically consist of the frequency value at which the processor needs to be run at different points in time during the decoding process. Lastly, in contrast to runtime prediction-based techniques, our scheme can be used to provide performance and quality-of-service guarantees and at the same time avoids any runtime computation overhead.

REFERENCES

• 1: A. Acquaviva , L. Benini , B. Riccó, An adaptive algorithm for low-power streaming multimedia processing, Proceedings of the conference on Design, automation and test in Europe, p.273-279, March 2001, Munich, Germany
• 2: Todd Austin , Eric Larson , Dan Ernst, SimpleScalar: An Infrastructure for Computer System Modeling, Computer, v.35 n.2, p.59-67, February 2002 [doi>10.1109/2.982917]
• 3: Marcio Buss , Tony Givargis , Nikil Dutt, Exploring Efficient Operating Points for Voltage Scaled Embedded Processor Cores, Proceedings of the 24th IEEE International Real-Time Systems Symposium, p.275, December 03-05, 2003
• 4: Kihwan Choi , Karthik Dantu , Wei-Chung Cheng , Massoud Pedram, Frame-based dynamic voltage and frequency scaling for a MPEG decoder, Proceedings of the 2002 IEEE/ACM international conference on Computer-aided design, p.732-737, November 10-14, 2002, San Jose, California [doi>10.1145/774572.774680]
• 5: Hans Van Antwerpen , Nikil Dutt , Rajesh Gupta , Shivajit Mohapatra , Cristiano Pereira , Nalini Venkatasubramanian , Ralph von Vignau, Energy-Aware System Design for Wireless Multimedia, Proceedings of the conference on Design, automation and test in Europe, p.21124, February 16-20, 2004
• 6: Shivajit Mohapatra , Radu Cornea , Nikil Dutt , Alex Nicolau , Nalini Venkatasubramanian, Integrated power management for video streaming to mobile handheld devices, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957134]
• 7: Christopher J. Hughes , Jayanth Srinivasan , Sarita V. Adve, Saving energy with architectural and frequency adaptations for multimedia applications, Proceedings of the 34th annual ACM/IEEE international symposium on Microarchitecture, December 01-05, 2001, Austin, Texas
• 8: http://www.tns.lcs.mit.edu/manuals/mpeg2/.
• 9: Christian Poellabauer , Leo Singleton , Karsten Schwan, Feedback-Based Dynamic Voltage and Frequency Scaling for Memory-Bound Real-Time Applications, Proceedings of the 11th IEEE Real Time on Embedded Technology and Applications Symposium, p.234-243, March 07-10, 2005 [doi>10.1109/RTAS.2005.23]
• 10: Peter Soderquist , Miriam Leeser, Optimizing the data cache performance of a software MPEG-2 video decoder, Proceedings of the fifth ACM international conference on Multimedia, p.291-301, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266380]
• 11: Wanghong Yuan , Klara Nahrstedt, Energy-efficient soft real-time CPU scheduling for mobile multimedia systems, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
• 12: Wanghong Yuan , Klara Nahrstedt, Practical voltage scaling for mobile multimedia devices, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027737]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.3 SPECIAL-PURPOSE AND APPLICATION-BASED SYSTEMS
      Subjects: Real-time and embedded systems

General Terms:
Algorithms, Design, Performance

Keywords:
DVS, bitstream analysis, metadata, video decoding