Grasping reality through illusion—interactive graphics serving science

ABSTRACT

I treat three related subjects: virtual-worlds research—the construction of real-time 3-D illusions by computer graphics; some observations about interfaces to virtual worlds; and the coming application of virtual-worlds techniques to the enhancement of scientific computing. We need to design generalized interfaces for visualizing, exploring, and steering scientific computations. Our interfaces must be direct-manipulation, not command-string; interactive, not batch; 3-D, not 2-D; multisensory, not just visual. We need generalized research results for 3-D interactive interfaces. More is known than gets reported, because of a reluctance to share “unproven” results. I propose a shells-of-certainty model for such knowledge.

REFERENCES

• 1: Larry Bergman , Henry Fuchs , Eric Grant , Susan Spach, Image rendering by adaptive refinement, Proceedings of the 13th annual conference on Computer graphics and interactive techniques, p.29-37, August 1986
• 2: Edward Glen Britton, A methodology for the ergonomic design of interactive computer graphic systems, and its application to crystallography., 1977
• 3: Britton, E., Lipscomb, J.S., Pique, M., Wright, W.V., and Brooks, Jr., F.P. {1981} The GRIP-75 man-machine interface. Videotape presented at SIGGRAPH Conference.
• 4: Brooks, Jr., F.P. {1977} The computer "scientist" as toolsmith: studies in interactive computer graphics. In Information Processing 77 (Toronto). North-Holland, Amsterdam, pp. 625-634.
• 5: Frederick P. Brooks, Jr., Walkthrough—a dynamic graphics system for simulating virtual buildings, Proceedings of the 1986 workshop on Interactive 3D graphics, p.9-21, January 1987, Chapel Hill, North Carolina, United States [doi>10.1145/319120.319122]
• 6: Fuchs, H., Duran, J., and Johnson, B. {1977} A system for automatic acquisition of three-dimensional data. In National Computer Conference, 49-53.
• 7: Fuchs, H., Pizer, S.M., Heinz, E.R., Tsai, L.C., and Bloomberg, S.H. {1982} Adding a true 3D display to a raster graphics system. In IEEE Computer Graphics and Applications 2, 7 (September), 73-78.
• 8: Fuchs, H. and Abram, G.D. {1985} Specialized computer organization fo;r raster-graphics display. In Algorithmically-specialized Parallel Computers, edited by L. Snyder, L.H. Jal~ieson, D.B. Gannon, and H.J. Siegel. New York: Academic Press.
• 9: Henry Fuchs , Jack Goldfeather , Jeff P. Hultquist , Susan Spach , John D. Austin , Frederick P. Brooks, Jr. , John G. Eyles , John Poulton, Fast spheres, shadows, textures, transparencies, and imgage enhancements in pixel-planes, ACM SIGGRAPH Computer Graphics, v.19 n.3, p.111-120, Jul. 1985
• 10: Goldfeather, J.~ Molnar, S., Turk, G., and Fuchs, H. {1988} Near real-time CSG rendering using tre Normalization and geometric pruning. UNC Technical Report.
• 11: Richard W Hamming, Numerical methods for scientists and engineers (2nd ed.), Dover Publications, Inc., New York, NY, 1986
• 12: Harris, M.R. {1988} An introduction to reciprocal space modeling and rspace. UNC Technical Report.
• 13: William Sands Holloway Hobgood, Jr., A three-dimensional computer graphics display using a varifocal mirror., 1970
• 14: Holloway, R.L. {1987} Head-mounted display technical report. UNC Technical Report.
• 15: Holmes, David H. {1985} Three-dimensional depth perception enhancement by dynamic lighting. M.S. thesis, UNC.
• 16: Paul Jerome Kilpatrick, The use of a kinesthetic supplement in an interactive graphics system., 1976
• 17: James Sargent Lipscomb, Three-dimensional cues for a molecular computer graphics system, 1981
• 18: Lipscomb, J.S. and Brooks, Jr., F.P. {1981} The GRIP- 75 man-machine interface (videotape). I{nACM SIGGRAPH Video Review, 4 (August).
• 19: McCormick, B.H., DeFanti, T.A., and Brown, M.D., eds. {1987} Visualization in Scientific Computing. Report of the NSF Advisory Panel on Graphics, image Processing and Workstations.
• 20: Ming, O.Y., Pique, M., Hughes, J., Brooks, Jr., F.P. {1988} Using a :manipulator for force display in molecular docking. IEEE Robotics and Automation Conference.
• 21: Palmer, T.C. {1987} Docktool: a dynamically interactive raster graphics visualization for the molecular docking problem. M.S. thesis, UNC.
• 22: Pique, M., Richardson, J.S., and Brooks, Jr., F.P. {1982} What does a protein look like? Videotape presented at SIGGRAPH Conference.
• 23: Pique, M. {1982-83} Fast 3-D display of space-filling molecular models (videotape). In SIGGRAPH Video Review 6 (October, 1982), 10 (October, 1983).
• 24: Pique, M. and Brooks, Jr., F.P. {1985} Computer graphics for molecular modeling. In Molecular Dynamics in Protein Structure Edited by J, Hermans.
• 25: Pizer, S.M., Fuchs, H., Mosher, C., Lifshitz, L., Abram, G.D.,Ramanathan, S., Whitney, B.T., Rosenman, J.G., Stabb, E.V., Chaney, E.L., and Sherouse, G. {1986} 3D shaded graphics in radiotherapy and diagnostic imaging. In Computer Graphics Proceedings, 107-113
• 26: Richardson, D.C. {1977} Three-dimensional Structure of Cu, Zn, Superoxide Dismutase. Superoxide and Superoxide Dismutases. Edited by A.M. Michelson,
• 27: J.M. McCord, and I. Fridovich. New York: Academic Press, 1977
• 28: Sutherland, I.E. {1965} The ultimate display. Proceedings oflFIP 65, vol. 2, pp. 506-508, 582-583.
• 29: Toet, A., Koenderink, J.J., Pizer, S.M., Helmink, L. {1986} A multiresolution image segmentation algorith based on a topological description of image structure. First Quinquennial Review, Utrecht.
• 30: Tsernoglou, D. and Petsko, G.A. {1977} Threedimensional-structure of neurotoxin a from venom of the Philippines sea snake. In Proc. National Academy of Sciences USA 74, 3 (March), 971-974.
• 31: Tsernoglou, D., Petsko, G.A., McQueen, Jr., J.E., and Hermans, J. {1977} Molecular graphics: application to the structure determination of a snake venom neurotoxin. Science 197, 4311 (30 September), 1378-1381.
• 32: Thomas Victor Williams, A man-machine interface for interpreting electron density maps, 1982

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Modeling packages
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture
  I.6 SIMULATION AND MODELING

General Terms:
Design, Human Factors