ARForce: a marker-based augmented reality system for force distribution input

ABSTRACT

In recent years, the use of augmented reality (AR) systems has become quite common. Many marker-based AR systems can input the positions of physical markers and realize a combination of real-world and computer-generated graphics. However, few systems can recognize other information such as fingertip motions. The objective of our study is to create AR environments in which users can manipulate virtual objects by using natural finger motions. Toward this end, we propose a novel marker-based AR system called "ARForce." ARForce enables users to measure the 3D position of markers as well as also the distribution of force vectors that are applied by a user. Using this system, users can manipulate virtual objects using various finger motions.

Our proposed system comprises a camera and an input device. The input device is an elastic body and it comprises two types of markers. One is a square-shaped marker that enables a user to detect the position of the device. The other markers are small circular-shaped ones that are placed within the elastic body. The positions of the circular markers are moved when a user applies a force to the device. This enables force detection.

REFERENCES

• 1: Yuji Ayatsuka , Jun Rekimoto, Active CyberCode: a directly controllable 2D code, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125558]
• 2: Patrick Baudisch , Mike Sinclair , Andrew Wilson, Soap: a pointing device that works in mid-air, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166261]
• 3: CyberGlove. http://www.immersion.com/3d/products/cyber_glove.php.
• 4: Yasuaki Kakehi , Kensei Jo , Katsunori Sato , Kouta Minamizawa , Hideaki Nii , Naoki Kawakami , Takeshi Naemura , Susumu Tachi, ForceTile: tabletop tangible interface with vision-based force distribution sensing, ACM SIGGRAPH 2008 new tech demos, p.1-1, August 11-15, 2008, Los Angeles, California [doi>10.1145/1401615.1401632]
• 5: Y. Kakehi, T. Naemura, and M. Matsushita. Tablescape Plus: Interactive Small-sized Displays Upstanding on Tabletop Display. In 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (Tabletop 2007), pages 155--162, 2007.
• 6: Kazuto Kamiyama , Kevin Vlack , Terukazu Mizota , Hiroyuki Kajimoto , Naoki Kawakami , Susumu Tachi, Vision-Based Sensor for Real-Time Measuring of Surface Traction Fields, IEEE Computer Graphics and Applications, v.25 n.1, p.68-75, January 2005 [doi>10.1109/MCG.2005.27]
• 7: Hirokazu Kato , Mark Billinghurst, Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System, Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, p.85, October 20-21, 1999
• 8: Luv Kohli , Mary Whitton, The haptic hand: providing user interface feedback with the non-dominant hand in virtual environments, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia
• 9: Hideki Koike , Yoichi Sato , Yoshinori Kobayashi , Hiroaki Tobita , Motoki Kobayashi, Interactive textbook and interactive Venn diagram: natural and intuitive interfaces on augmented desk system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.121-128, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332415]
• 10: Jun Rekimoto, Tilting operations for small screen interfaces, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.167-168, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237115]
• 11: Katsunari Sato , Kouta Minamizawa , Naoki Kawakami , Susumu Tachi, Haptic telexistence, ACM SIGGRAPH 2007 emerging technologies, August 05-09, 2007, San Diego, California [doi>10.1145/1278280.1278291]
• 12: Eric Woods , Paul Mason , Mark Billinghurst, MagicMouse: an inexpensive 6-degree-of-freedom mouse, Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia, February 11-14, 2003, Melbourne, Australia [doi>10.1145/604471.604539]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Haptic I/O

General Terms:
Algorithms, Design, Measurement

Keywords:
augmented reality, computer human interface