Enhancement of aligning accuracy on zooming camera for augmented reality

ABSTRACT

This paper addresses the problem of the zooming effect of camera on focal length estimation for augmented reality applications. Our proposed method allows us to merge virtual objects properly into a real scene captured with varying focal length. Virtual objects appearing in the augmented scene need to be merged into the real scene taken with different camera pose (related to rotation and translation parameters) and camera zoom (related to focal length parameter). The system will then calculate appropriate transformation using a template of the marker that is already built in the database. Several tests have been done in comparison between current AR toolkit and our system. The simulation results show that our system is able to achieve more accurate alignment without degenerate motion problem.

REFERENCES

• 1: Sturm, P. F. and Maybank, S. J. On plane-based camera calibration. In Proc. Computer Vision and Pattern Recognition, (Colorado, USA, June 1999), 432--437.
• 2: Zhengyou Zhang, A Flexible New Technique for Camera Calibration, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.11, p.1330-1334, November 2000 [doi>10.1109/34.888718]
• 3: Richard Hartley , Andrew Zisserman, Multiple view geometry in computer visiond, Cambridge University Press, New York, NY, 2001
• 4: Ronald Azuma , Yohan Baillot , Reinhold Behringer , Steven Feiner , Simon Julier , Blair MacIntyre, Recent Advances in Augmented Reality, IEEE Computer Graphics and Applications, v.21 n.6, p.34-47, November 2001 [doi>10.1109/38.963459]
• 5: Matsunaga, C. and Kanatani, K. Calibration of a moving camera using a planar pattern. Electronics & Communication in Japan part 3, Electronics Science, 84, 7, (2001), 12--21.
• 6: Simon, G., Fitzgibbon, A. W. and Zisserman, A. Markerless tracking using planar structures in the scene. Proc. Int. Symposium on Augmented Reality, (Oct. 2000), 120--128.
• 7: Q.-T. Luong , O. D. Faugeras, Self-Calibration of a Moving Camera from PointCorrespondences and Fundamental Matrices, International Journal of Computer Vision, v.22 n.3, p.261-289, March/April 1997 [doi>10.1023/A:1007982716991]
• 8: Tsai, R. Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robotics and Automation, RA-3, 4, (Aug. 1987), 323--344.
• 9: http://mixedreality.nus.edu.sg/software-ARToolkitforMatlabInstruction.htm
• 10: http://www.hitl.washington.edu/research/shared_space
• 11: Bouguet, J. Y. Camera Calibration Toolbox for Matlab. Microprocessor Research Labs and Intel Corp., (Feb. 2003). http://www.vision.caltech.edu/bouguetj/calib_doc/
• 12: Bill Triggs, Autocalibration from Planar Scenes, Proceedings of the 5th European Conference on Computer Vision-Volume I, p.89-105, June 02-06, 1998
• 13: Marc Pollefeys , Luc Van Gool, A Stratified Approach to Metric Self-Calibration, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.407, June 17-19, 1997
• 14: Daniel F. Dementhon , Larry S. Davis, Model-based object pose in 25 lines of code, International Journal of Computer Vision, v.15 n.1-2, p.123-141, June 1995 [doi>10.1007/BF01450852]
• 15: Ali Azarbayejani , Alex P. Pentland, Recursive Estimation of Motion, Structure, and Focal Length, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.6, p.562-575, June 1995 [doi>10.1109/34.387503]
• 16: Gene H. Golub , Charles F. Van Loan, Matrix computations (3rd ed.), Johns Hopkins University Press, Baltimore, MD, 1996
• 17: Kenichi Kanatani, Geometric computation for machine vision, Oxford University Press, Inc., New York, NY, 1993

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Camera calibration

General Terms:
Algorithms, Experimentation, Measurement, Performance, Theory

Keywords:
augmented reality, focal length estimation, zooming camera