Automatic browsing of large pictures on mobile devices

ABSTRACT

Pictures have become increasingly common and popular in mobile communications. However, due to the limitation of mobile devices, there is a need to develop new technologies to facilitate the browsing of large pictures on the small screen. In this paper, we propose a novel approach which is able to automate the scrolling and navigation of a large picture with a minimal amount of user interaction on mobile devices. An image attention model is employed to illustrate the information structure within an image. An optimal image browsing path is then calculated based on the image attention model to simulate the human browsing behaviors. Experimental evaluations of the proposed mechanism indicate that our approach is an effective way for viewing large images on small displays.

REFERENCES

• 1: Oscar de Bruijn , Robert Spence, Rapid serial visual presentation: a space-time trade-off in information presentation, Proceedings of the working conference on Advanced visual interfaces, p.189-192, May 2000, Palermo, Italy [doi>10.1145/345513.345309]
• 2: E.C. Chang, S. Mallat, and C. Yap, Wavelet foveation, Journal of Applied and Computational Harmonic Analysis, Vol. 9, No. 3, pp312--335, Oct. 2000.
• 3: L.Q. Chen, X. Xie, X. Fan, W.Y. Ma, H.J. Zhang, and H.Q. Zhou, A visual attention model for adapting images on small displays, ACM Multimedia Systems Journal, to appear.
• 4: Xiangrong Chen , HongJiang Zhang, Text Area Detection from Video Frames, Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing, p.222-228, October 24-26, 2001
• 5: D.A. Chernyak and L.W. Stark, Top-down guided eye movement, IEEE Trans. on Systems, Man and Cybernetics, Vol. 31, pp514--522, Aug. 2001.
• 6: Ed H. Chi , Peter Pirolli , Kim Chen , James Pitkow, Using information scent to model user information needs and actions and the Web, Proceedings of the SIGCHI conference on Human factors in computing systems, p.490-497, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365325]
• 7: C. Christopoulos, A. Skodras, and T. Ebrahimi, The JPEG2000 still image coding system: an overview, IEEE Trans. on Consumer Electronics, Vol. 46, No. 4, pp1103--1127, 2000.
• 8: X. Fan, X. Xie, W.Y. Ma, H.J. Zhang, and H.Q. Zhou, Visual attention based image browsing on mobile devices, Proc. of ICME 2003, Vol. I, pp53--56, Baltimore, USA, Jul. 2003.
• 9: Xin Fan , Xing Xie , He-Qin Zhou , Wei-Ying Ma, Looking into video frames on small displays, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957063]
• 10: L. Itti and C. Koch, A comparison of feature combination strategies for saliency-based visual attention system, Proc. of SPIE: Human Vision and Electronic Imaging IV, Vol. 3644, pp473--482, 1999.
• 11: L. Itti and C. Koch, Computational modeling of visual attention, Nature Reviews Neuroscience, Vol. 2, No. 3, pp194--203, Mar. 2001.
• 12: Laurent Itti , Christof Koch , Ernst Niebur, A Model of Saliency-Based Visual Attention for Rapid Scene Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.11, p.1254-1259, November 1998 [doi>10.1109/34.730558]
• 13: Stan Z. Li , Long Zhu , ZhenQiu Zhang , Andrew Blake , HongJiang Zhang , Harry Shum, Statistical Learning of Multi-view Face Detection, Proceedings of the 7th European Conference on Computer Vision-Part IV, p.67-81, May 28-31, 2002
• 14: J. Luo, A. Singhal, G. Braun, R.T.Gray, O. Seignol, and N. Touchard, Displaying images on mobile devices: capabilities, issues, and solutions, Proc. of International Conference on Image Processing 2002, Vol. 1, pp13--16, Rochester, New York, 2002.
• 15: W.Y. Ma, I. Bedner, G. Chang, A. Kuchinsky, and H.J. Zhang, A framework for adaptive content delivery in heterogeneous network environments, Proc. of Multimedia Computing and Networking 2000, SPIE Vol. 3969, pp86--100, San Jose, USA, 2000.
• 16: Yu-Fei Ma , Hong-Jiang Zhang, Contrast-based image attention analysis by using fuzzy growing, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957094]
• 17: R. Milanese, S. Gil, and T. Pun, Attentive mechanisms for dynamic and static scene analysis, Optical Engineering, Vol. 34, No. 8, pp2428--2434, 1995.
• 18: R. Mohan, J.R. Smith, and C.S. Li, Adapting multimedia Internet content for Universal Access, IEEE Trans. on Multimedia, Vol. 1, No. 1, pp.104--114, 1999.
• 19: P. Pirolli and S.K. Card, Information foraging, Psychological Review, Vol. 106, No. 4, pp643--675, 1999.
• 20: J.R. Smith, R. Mohan, and C.S. Li, Content-based transcoding of images in the Internet, Proc. of Int. Conf. on Image Processing 1998, Vol. 3, pp7--11, Chicago, USA, Oct. 1998.
• 21: F.C. Sun and L.Y. Chen, Identification of fixations in reading eye movements by a multi-layer neural network, Proc. of IEEE International Conference on Neural Networks 1995, Vol. 5, pp2309--2313, Perth, Australia, Nov. 1995.
• 22: F. Vitu, G.W. McConkie , P. Kerr, and J. K. O'Regan, Fixation location effects on fixation durations during reading: an inverted optimal viewing position effect, Vision Research, Vol. 41, No. 25-26, pp3513--3533, 2001.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

General Terms:
Algorithms, Human Factors

Keywords:
adaptive content delivery, attention model, browsing path, form factor, image adaptation, information foraging