User-centric viewpoint computation for haptic exploration and manipulation

ABSTRACT

We present several techniques for user-centric viewing of the virtual objects or datasets under haptic exploration and manipulation. Depending on the type of tasks performed by the user, our algorithms compute automatic placement of the user viewpoint to navigate through the scene, to display the near-optimal views, and to reposition the viewpoint for haptic visualization. This is accomplished by conjecturing the user's intent based on the user's actions, the object geometry, and intra- and inter-object occlusion relationships. These algorithms have been implemented and interfaced with both a 3-DOF and a 6-DOF PHANToM arms. We demonstrate their application on haptic exploration and visualization of a complex structure, as well as multiresolution modeling and 3D painting with a haptic interface.

REFERENCES

• 1: Maneesh Agrawala , Andrew C. Beers , Ian McDowall , Bernd Fröhlich , Mark Bolas , Pat Hanrahan, The two-user Responsive Workbench: support for collaboration through individual views of a shared space, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.327-332, August 1997 [doi>10.1145/258734.258875]
• 2: Ricardo S. Avila , Lisa M. Sobierajski, A haptic interaction method for volume visualization, Proceedings of the 7th conference on Visualization '96, p.197-ff., October 28-29, 1996, San Francisco, California, United States
• 3: Grigore C. Burdea, Force and touch feedback for virtual reality, John Wiley & Sons, Inc., New York, NY, 1996
• 4: Lawrence D. Cutler , Bernd Fröhlich , Pat Hanrahan, Two-handed direct manipulation on the responsive workbench, Proceedings of the 1997 symposium on Interactive 3D graphics, p.107-114, April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253315]
• 5: {Che99} E. Chen. Six degree-of-freedom haptic system for desktop virtual prototyping applications. In Proceedings of the First International Workshop on Virtual Reality and Prototyping, pages 97-106, 1999.
• 6: Brian Curless , Marc Levoy, A volumetric method for building complex models from range images, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.303-312, August 1996 [doi>10.1145/237170.237269]
• 7: Michael Chen , S. Joy Mountford , Abigail Sellen, A study in interactive 3-D rotation using 2-D control devices, ACM SIGGRAPH Computer Graphics, v.22 n.4, p.121-129, Aug. 1988
• 8: {DMW+98} L. Durbeck, N. Macias, D. Weinstein, C. Johnson, and J. Hollerbach. Scirun haptic display for scientific visualization. Phantom Users Group Meetings, 1998.
• 9: Arthur D. Gregory , Stephen A. Ehmann , Ming C. Lin, inTouch: Interactive Multiresolution Modeling and 3D Painting with a Haptic Interface, Proceedings of the IEEE Virtual Reality 2000 Conference, p.45, March 18-22, 2000
• 10: {Gib95} S. Gibson. Beyond volume rendering: Visualization, haptic exploration, and physical modeling of element-based objects. In Proc. Eurographics workshop on Visualization in Scientific Computing, pages 10-24, 1995.
• 11: Arthur Gregory , Ajith Mascarenhas , Stephen Ehmann , Ming Lin , Dinesh Manocha, Six degree-of-freedom haptic display of polygonal models, Proceedings of the conference on Visualization '00, p.139-146, October 2000, Salt Lake City, Utah, United States
• 12: Michael Gleicher , Andrew Witkin, Through-the-lens camera control, ACM SIGGRAPH Computer Graphics, v.26 n.2, p.331-340, July 1992
• 13: {IN93} H. Iwata and N. Noma. Volume haptization. Proc. of IEEE VRAIS, pp. 16-23, 1993.
• 14: Kiriakos N. Kutulakos , Charles R. Dyer, Global surface reconstruction by purposive control of observer motion, Artificial Intelligence, v.78 n.1-2, p.147-177, Oct. 1995 [doi>10.1016/0004-3702(95)00027-5]
• 15: Dale A. Lawrence , Christopher D. Lee , Lucy Y. Pao , Roman Y. Novoselov, Shock and vortex visualization using a combined visual/Haptic interface, Proceedings of the conference on Visualization '00, p.131-137, October 2000, Salt Lake City, Utah, United States
• 16: Leonard McMillan , Gary Bishop, Plenoptic modeling: an image-based rendering system, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.39-46, September 1995 [doi>10.1145/218380.218398]
• 17: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 18: Jock D. Mackinlay , Stuart K. Card , George G. Robertson, Rapid controlled movement through a virtual 3D workspace, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.171-176, Aug. 1990
• 19: William A. McNeely , Kevin D. Puterbaugh , James J. Troy, Six degree-of-freedom haptic rendering using voxel sampling, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.401-408, July 1999 [doi>10.1145/311535.311600]
• 20: Joseph O'Rourke, Art gallery theorems and algorithms, Oxford University Press, Inc., New York, NY, 1987
• 21: Randy Pausch , Tommy Burnette , Dan Brockway , Michael E. Weiblen, Navigation and locomotion in virtual worlds via flight into hand-held miniatures, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.399-400, September 1995 [doi>10.1145/218380.218495]
• 22: Cary B. Phillips , Norman I. Badler , John Granieri, Automatic viewing control for 3D direct manipulation, Proceedings of the 1992 symposium on Interactive 3D graphics, p.71-74, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147167]
• 23: Jeffrey S. Pierce , Andrew S. Forsberg , Matthew J. Conway , Seung Hong , Robert C. Zeleznik , Mark R. Mine, Image plane interaction techniques in 3D immersive environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.39-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253303]
• 24: Jeffrey S. Pierce , Andrew S. Forsberg , Matthew J. Conway , Seung Hong , Robert C. Zeleznik , Mark R. Mine, Image plane interaction techniques in 3D immersive environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.39-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253303]
• 25: Richard Pito, A Solution to the Next Best View Problem for Automated Surface Acquisition, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.21 n.10, p.1016-1030, October 1999 [doi>10.1109/34.799908]
• 26: Warren Robinett , Richard Holloway, Implementation of flying, scaling and grabbing in virtual worlds, Proceedings of the 1992 symposium on Interactive 3D graphics, p.189-192, June 1992, Cambridge, Massachusetts, United States [doi>10.1145/147156.147201]
• 27: {Sho87} Ken Shoemake. Quaternion calculus and fast animation, computer animation: 3-D motion specification and control. SIGGRAPH 1987 Tutorial, pp. 101-121, 1987.
• 28: {Tar91} Konstantinos Tarabanis. Sensor Planning and Modeling for Machine Vision Tasks. PhD thesis, Columbia University, 1991. Department of Computer Science.
• 29: {TAT95} K. A. Tarabanis, P. K. Allen, and R. Y. Tsai. A survey of sensor planning in computer vision. IEEE Trans. Robotics and Automation, 11:86-104, 1995.
• 30: {Wer94} Josie Wernecke. The Inventor Mentor. Addison-Wesley, 1994.
• 31: Colin Ware , Steven Osborne, Exploration and virtual camera control in virtual three dimensional environments, Proceedings of the 1990 symposium on Interactive 3D graphics, p.175-183, February 1990, Snowbird, Utah, United States
• 32: Robert Zeleznik , Andrew Forsberg, UniCam—2D gestural camera controls for 3D environments, Proceedings of the 1999 symposium on Interactive 3D graphics, p.169-173, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300546]
• 33: Hansong Zhang , Dinesh Manocha , Tom Hudson , Kenneth E. Hoff, III, Visibility culling using hierarchical occlusion maps, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.77-88, August 1997 [doi>10.1145/258734.258781]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques