A camera-based mobile data channel: capacity and analysis

ABSTRACT

In this paper we propose a novel application, color Video Code (V-Code) and analyze its data transmission capacity through camera-based mobile data channels. Users can use the camera on a mobile device (PDA or camera phone) as a passive and pervasive data channel to download data encoded as a sequence of color visual patterns. The color V-Code is animated on a display, acquired by the camera and decoded by the pre-embedded software in the mobile device. One interesting question is what is the data transmission capacity it can achieve, theoretically and practically. To answer this question we build a camera channel model to measure color degradation using information theory and show that the capacity of the camera channel can be improved with the optimized color selection through color calibration. After initialization color models are learned automatically as downloading proceeds. We address the problem of precise registration, and implemented a fast perspective correction method to accelerate the decoder in real-time on a resource constrained device. With the optimized color set and efficient implementation we achieve a transmission bit rate of 15.4kbps on a common iMate Jamin phone (200MHz CPU). This speed is faster than the average GPRS bit rate (12kbps).

REFERENCES

• 1: Rafael Ballagas , Jan Borchers , Michael Rohs , Jennifer G. Sheridan, The Smart Phone: A Ubiquitous Input Device, IEEE Pervasive Computing, v.5 n.1, p.70, January 2006 [doi>10.1109/MPRV.2006.18]
• 2: Rafael Ballagas , Michael Rohs , Jennifer G. Sheridan, Sweep and point and shoot: phonecam-based interactions for large public displays, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056876]
• 3: M. Barni, F. Bartolini, A. De Rosa, and A. Piva. Capacity of the watermark channel: How many bits can be hidden within a digital image? Proc. SPIE, 3657:437--448, 1999.
• 4: Y. Chang and J. Reid. RGB calibration for color image analysis in machine vision. IEEE Transactions on Image Processing, 5(10):1414--1422, 1996.
• 5: C. Cheong, D. Kim, and T. Han. Usability Evaluation of Designed Image Code Interface for Mobile Computing Environment. Lecture Notes In Computer Science, 4551:241, 2007.
• 6: A. Criminisi, I. Reid, and A. Zisserman. A plane measuring device. Image and Vision Computing, 17(8):625--634, 1999.
• 7: P. Fellgett and E. Linfoot. On the Assessment of Optical Images. Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences, 247(931):369--407, 1955.
• 8: G. Fowler. QR codes: In Japan, Billboards Take Code-Crazy Ads to New Heights. Wall Street Journal, 10:2005, 2005.
• 9: T. Han, C. Cheong, N. Lee, and E. Shin. Machine Machine readable code and method and device of encoding and decoding the same, Mar. 5 2003. EP Patent 1,287,483.
• 10: Robert M. Haralick, Determining camera parameters from the perspective projection of a rectangle, Pattern Recognition, v.22 n.3, p.225-230 [doi>10.1016/0031-3203(89)90071-X]
• 11: E. Haritaoglu, I. Haritaoglu, and P. Inc. Document Recognition and Translation with Handheld Mobile Devices. Proceedings 2005 Symposium on Document Image Understanding Technology, 2005.
• 12: M. E. W. J. H. Tappan and F. E. Sistler. Error sources in a digital image analysis system. Computers and Electronics in Agriculture, 2:109--118, 1987.
• 13: C. Jarque and A. Bera. A Test for Normality of Observations and Regression Residuals. International Statistical Review/Revue Internationale de Statistique, 55(2):163--172, 1987.
• 14: Menglei Jia , Xin Fan , Xing Xie , Mingjing Li , Wei-Ying Ma, Photo-to-Search: Using Camera Phones to Inquire of the Surrounding World, Proceedings of the 7th International Conference on Mobile Data Management, p.46, May 10-12, 2006 [doi>10.1109/MDM.2006.122]
• 15: R. Karp. Reducibility among combinatorial problems. Complexity of Computer Computations, 43:85--103, 1972.
• 16: 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, Proceedings of the Acoustics, Speech, and Signal Processing, 200. on IEEE International Conference, p.i-xci, May 07-11, 2001 [doi>10.1109/ICASSP.2001.941004]
• 17: X. Liu, D. Doermann, and H. Li. Vcode - pervasive data transfer using video barcode. Multimedia, IEEE Transactions on, 10(3):361--371, April 2008.
• 18: T. Nakamura, S. Yamamoto, R. Kitahara, A. Katayama, T. Yasuno, and N. Sonehara. A Fast, Robust Watermark Detection Scheme for Videos Captured on Camera Phones. Multimedia and Expo, 2007 IEEE International Conference on, pages 316--319, 2007.
• 19: M. Rohs. Real-World Interaction with Camera Phones. Ubiquitous Computing Systems: Second International Symposium, UCS 2004, Tokyo, Japan, November 8-9, 2004: Revised Selected Papers, 2005.
• 20: Michael Rohs, Visual Code Widgets for Marker-Based Interaction, Proceedings of the Fifth International Workshop on Smart Appliances and Wearable Computing (IWSAWC) (ICDCSW'05), p.506-513, June 06-10, 2005 [doi>10.1109/ICDCSW.2005.140]
• 21: David Scott , Richard Sharp , Anil Madhavapeddy , Eben Upton, Using visual tags to bypass Bluetooth device discovery, ACM SIGMOBILE Mobile Computing and Communications Review, v.9 n.1, January 2005 [doi>10.1145/1055959.1055965]
• 22: H. Sheikh and A. Bovik. Image information and visual quality. Image Processing, IEEE Transactions on, 15(2):430--444, 2006.
• 23: Eleanor Toye , Richard Sharp , Anil Madhavapeddy , David Scott , Eben Upton , Alan Blackwell, Interacting with mobile services: an evaluation of camera-phones and visual tags, Personal and Ubiquitous Computing, v.11 n.2, p.97-106, January 2007 [doi>10.1007/s00779-006-0064-9]
• 24: Panu Vartiainen , Suresh Chande , Kimmo Rämö, Mobile visual interaction: enhancing local communication and collaboration with visual interactions, Proceedings of the 5th international conference on Mobile and ubiquitous multimedia, p.4-es, December 04-06, 2006, Stanford, California [doi>10.1145/1186655.1186659]
• 25: Stephen B. Wicker , Vijay K. Bhargava, Reed-Solomon Codes and Their Applications, John Wiley & Sons, Inc., New York, NY, 1999
• 26: A PDA-Based Sign Translator, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.217, October 14-16, 2002 [doi>10.1109/ICMI.2002.1166996]

INDEX TERMS

Primary Classification:
  E. Data
  E.4 CODING AND INFORMATION THEORY

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Color

General Terms:
Performance

Keywords:
camera phone, image processing, information theory