A reconfigurable ferromagnetic input device

ABSTRACT

We present a novel hardware device based on ferromagnetic sensing, capable of detecting the presence, position and deformation of any ferrous object placed on or near its surface. These objects can include ball bearings, magnets, iron filings, and soft malleable bladders filled with ferrofluid. Our technology can be used to build reconfigurable input devices -- where the physical form of the input device can be assembled using combinations of such ferrous objects. This allows users to rapidly construct new forms of input device, such as a trackball-style device based on a single large ball bearing, tangible mixers based on a collection of sliders and buttons with ferrous components, and multi-touch malleable surfaces using a ferrofluid bladder. We discuss the implementation of our technology, its strengths and limitations, and potential application scenarios.

REFERENCES

• 1: Bennett, P., and O'Modhrain, S. The BeatBearing: a tangible rhythm sequencer. In Proc. of NordiCHI 2008.
• 2: Buxton, B., Working document on input devices. http://www.billbuxton.com/InputSources.html.
• 3: Freed, A. Application of new fiber and malleable materials for agile development of augmented instruments and controllers. In Proc. of NIME 2008.
• 4: Frey, M. 2005 Snoil. http://www.freymartin.de/en/projects/snoil.
• 5: Han, J. Y. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. of UIST 2005, ACM, pp. 115--118.
• 6: Harrison, C., and Hudson, S.E. Providing Dynamically Changeable Physical Buttons on a Visual Display. In Proc. of SIGCHI 2009, ACM, pp. 299--308.
• 7: Hemmert, F., et al. Dynamic knobs: shape change as a means of interaction on a mobile phone. In Proc. of SIGCHI 2008, ACM, pp. 2309--2314.
• 8: Hilliges, O., Kim, D., and Izadi, S. Creating malleable interactive surfaces using liquid displacement sensing. In Proc. of TABLETOP 2008, IEEE, pp. 157--160.
• 9: Lee, S.K., Buxton, W., and Smith, K.C. A multi-touch three dimensional touch-sensitive tablet. In Proc. of SIGCHI 1985, ACM, pp. 21--25.
• 10: Lemur multi-touch controller, JazzMutant. http://www.jazzmutant.com/lemur_overview.php.
• 11: Microsoft Surface, http://www.surface.com.
• 12: Milczynski et al. A malleable device with applications to sonification-based data exploration. In Proc. of ICAD 2006, University of London, pp. 69--76.
• 13: N-trig capacitive touch sensor. http://www.n-trig.com.
• 14: Pangaro, G., Maynes-Aminzade, D., and Ishii, H. The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. ACM Trans. Graph. 22, 3 (Jul. 2003), pp. 699--708.
• 15: Patten, J., Ishii, H., Hines, J., and Pangaro, G. Sense-table: a wireless object tracking platform for tangible user interfaces. In Proc. of SIGCHI 2001, ACM, pp. 253--260.
• 16: Patten, J., Recht, B., and Ishii, H. Audiopad: a tag-based interface for musical performance. In Proc. of NIME 2002, pp. 1--6.
• 17: Piper, B., Ratti, C., and Ishii, H. Illuminating clay: a 3-D tangible interface for landscape analysis. In Proc. of SIGCHI 2002, ACM, pp. 355--362.
• 18: Plesniak, W., and Pappu, R. Coincident display using haptics and holographic video. In Proc. of SIGCHI 1998, ACM, pp. 304--311.
• 19: Polhemus, http://www.polhemus.com.
• 20: Poupyrev, I., Nashida, T., and Okabe, M. Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays. In Proc. of TEI 2007, ACM, pp. 205--212.
• 21: Rekimoto, J. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proc. of SIGCHI 2002, ACM, pp. 113--120.
• 22: Rosenberg, I.D., Grau, A., Hendee, C., Awad, N., and Perlin, K. IMPAD: an inexpensive multi-touch pressure acquisition device. In Proc. of SIGCHI 2009 Extended Abstracts, ACM, pp. 3217--3222.
• 23: Shwe, H. Smarter play for smart toys: The benefits of technology-enhanced play. Zowie Intertainment White Paper 3208, 1999.
• 24: Sixense controller, http://www.sixense.com.
• 25: Smith, D., Graham, N., Holman, D., and Borchers, J. Low-cost malleable surfaces with multi-touch pressure sensitivity, In Proc. of TABLETOP 2007, IEEE, pp. 205--208.
• 26: Smith, R.T., Thomas, B.H., and Piekarski, W. Digital foam interaction techniques for 3D modeling. In Proc. of VRST2008, ACM, pp. 61--68.
• 27: Steurer, P., and Srivastava, M.B. System design of smart table, In Proc. of PerCom 2003, IEEE, pp.473--480.
• 28: Villar, N., A Malleable Control Structure for Softwired User Interfaces, PhD thesis 2007.
• 29: Vlack, K. et al. GelForce: A vision-based traction field computer interface. In Proc. of SIGCHI 2005 Extended Abstracts, ACM, pp. 1154--1155.
• 30: Wacom pen tablets. http://www.wacom.com.
• 31: White, T. Introducing liquid haptics in high bandwidth human computer interfaces. MS Thesis, MIT May 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Human Factors

Keywords:
ferromagnetic sensing, malleable surface, multi-touch, reconfigurable input device, tangibles