Tangible interaction + graphical interpretation: a new approach to 3D modeling

ABSTRACT

Construction toys are a superb medium for geometric models. We argue that such toys, suitably instrumented or sensed, could be the inspiration for a new generation of easy-to-use, tangible modeling systems—especially if the tangible modeling is combined with graphical-interpretation techniques for enhancing nascent models automatically. The three key technologies needed to realize this idea are embedded computation, vision-based acquisition, and graphical interpretation. We sample these technologies in the context of two novel modeling systems: physical building blocks that self-describe, interpret, and decorate the structures into which they are assembled; and a system for scanning, interpreting, and animating clay figures.

REFERENCES

• 1: R. Aish. 3D input for CAAD systems. Computer-Aided Design, 11(2):66-70, Mar. 1979.
• 2: R. Aish and P. Noakes. Architecture without numbers - CAAD based on a 3D modelling system. Computer-Aided Design, 16(6):321-328, Nov. 1984.
• 3: G. Anagnostou, D. Dewey, and A. Patera. Geometry-defining processors for engineering design and analysis. The Visual Computer, 5:304-315, 1989.
• 4: B. G. Baumgart. Geometric modeling for computer vision. Technical Report AIM-249, AI Laboratory, Stanford Univ., Oct. 1974.
• 5: R. Brooks. Model-based 3D interpretations of 2D images. IEEE Trans. on Pattern Analysis and Machine Intelligence, 5(2):140-150, 1983.
• 6: G. Cybenko, A. Bhasin, and K. D. Cohen. Pattern recognition of 3D CAD objects: Towards an electronic Yellow Pages of mechanical parts. Smart Engineering Systems Design, 1:1- 13, 1997.
• 7: D. Dewey , A. T. Patera, Geometry-defining processors for partial differential equations, Special purpose computers, Academic Press Ltd., London, UK, 1988
• 8: Sven J. Dickinson , Alex P. Pentland , Azriel Rosenfeld, From volumes to views: an approach to 3-D object recognition, CVGIP: Image Understanding, v.55 n.2, p.130-154, March 1992 [doi>10.1016/1049-9660(92)90013-S]
• 9: Sven J. Dickinson , Dimitri Metaxas, Integrating qualitative and quantitative shape recovery, International Journal of Computer Vision, v.13 n.3, p.311-330, Dec. 1994 [doi>10.1007/BF02028351]
• 10: Chris Esposito , W. Bradford Paley , JueyChong Ong, Of mice and monkeys: a specialized input device for virtual body animation, Proceedings of the 1995 symposium on Interactive 3D graphics, p.109-ff., April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199424]
• 11: Andrew W. Fitzgibbon , Geoff Cross , Andrew Zisserman, Automatic 3D Model Construction for Turn-Table Sequences, Proceedings of the European Workshop on 3D Structure from Multiple Images of Large-Scale Environments, p.155-170, June 06-07, 1998
• 12: J. Frazer. Use of simplified three-dimensional computer input devices to encourage public participation in design. In Proc. of Computer Aided Design 82, pages 143-151. Butterworth Scientific, 1982.
• 13: J. Frazer. An Evolutionary Architecture. Architectural Association, London, 1994. Describes several tangible modelers developed by Frazer's group from 1979 onwards.
• 14: J. Frazer, P. Coates, and J. Frazer. Software and hardware approaches to improving the man-machine interface. In Proc. of the First International IFIP Conf. on Computer Applications in Production and Engineering, pages 1083-94, Amsterdam, Holland, 1983. North Holland.
• 15: J. Frazer, J. Frazer, and P. Frazer. Intelligent physical threedimensional modelling system. In Proc. of Computer Graphics 80, pages 359-370. Online Publications, 1980.
• 16: J. Frazer, J. Frazer, and P. Frazer. New developments in intelligent modelling. In Proc. of Computer Graphics 81, pages 139-154. Online Publications, 1981.
• 17: Nikhil Gagvani , D. Kenchammana-Hosekote , D. Silver, Volume animation using the skeleton tree, Proceedings of the 1998 IEEE symposium on Volume visualization, p.47-53, October 19-20, 1998, Research Triangle Park, North Carolina, United States [doi>10.1145/288126.288152]
• 18: Matthew G. Gorbet , Maggie Orth, Triangles: design of a physical/digital construction kit, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, p.125-128, August 18-20, 1997, Amsterdam, The Netherlands [doi>10.1145/263552.263592]
• 19: Matthew G. Gorbet , Maggie Orth , Hiroshi Ishii, Triangles: tangible interface for manipulation and exploration of digital information topography, Proceedings of the SIGCHI conference on Human factors in computing systems, p.49-56, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274652]
• 20: Jessica K. Hodgins , Nancy S. Pollard, Adapting simulated behaviors for new characters, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.153-162, August 1997 [doi>10.1145/258734.258822]
• 21: Takeo Igarashi , Satoshi Matsuoka , Hidehiko Tanaka, Teddy: a sketching interface for 3D freeform design, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.409-416, July 1999 [doi>10.1145/311535.311602]
• 22: S. B. Kang. Quasi-euclidean recovery from unknown but complete orbital motion. Technical Report TR 97-10, Compaq CRL, 1997.
• 23: F. Martin and R. Borovoy. The active LEGO baseplate project, http : / / fredm, www. media .mit. - edu/people/fredm/projects/ab/, 1994.
• 24: Ovid. Metamorphoses:X. Rome, 1 AD.
• 25: Randy Pausch , Tommy Burnette , Dan Brockway , Michael E. Weiblen, Navigation and locomotion in virtual worlds via flight into hand-held miniatures, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.399-400, September 1995 [doi>10.1145/218380.218495]
• 26: W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling. Numerical Recipes in C. Cambridge University Press, 1988.
• 27: Marc H. Raibert, Legged robots that balance, Massachusetts Institute of Technology, Cambridge, MA, 1986
• 28: John C. Russ, The image processing handbook (3rd ed.), CRC Press, Inc., Boca Raton, FL, 1998
• 29: Steven M. Seitz , Charles R. Dyer, Photorealistic Scene Reconstruction by Voxel Coloring, International Journal of Computer Vision, v.35 n.2, p.151-173, Nov.-Dec. 1999 [doi>10.1023/A:1008176507526]
• 30: F. Solina , R. Bajcsy, Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.2, p.131-147, February 1990 [doi>10.1109/34.44401]
• 31: H. Suzuki and H. Kato. AlgoBlock: A tangible programming language -- a tool for collaborative learning. In Proc. of the 4th European Logo Conference, pages 297-303, 1993.
• 32: D. Terzopoulos and K. Fleischer. Deformable models. The Visual Computer, 4(6):306-331, December 1988.
• 33: P. H. Winston. Learning structural descriptions from examples. In P. H. Winston, editor, The Psychology of Computer Vision. McGraw-Hill, New York, 1975.
• 34: Robert C. Zeleznik , Kenneth P. Herndon , John F. Hughes, SKETCH: an interface for sketching 3D scenes, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.163-170, August 1996 [doi>10.1145/237170.237238]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

General Terms:
Design, Human Factors, Performance, Theory

Keywords:
HCI (Human-Computer Interface), applications, embedded computation, geometric modeling, graphics systems, perceptual user interfaces, shape recognition, tangible user interfaces, transmedia, user interface hardware