Lightweight material detection for placement-aware mobile computing

ABSTRACT

Numerous methods have been proposed that allow mobile devices to determine where they are located (e.g., home or office) and in some cases, predict what activity the user is currently engaged in (e.g., walking, sitting, or driving). While useful, this sensing currently only tells part of a much richer story. To allow devices to act most appropriately to the situation they are in, it would also be very helpful to know about their placement - for example whether they are sitting on a desk, hidden in a drawer, placed in a pocket, or held in one's hand - as different device behaviors may be called for in each of these situations. In this paper, we describe a simple, small, and inexpensive multispectral optical sensor for identifying materials in proximity to a device. This information can be used in concert with e.g., location information, to estimate, for example, that the device is "sitting on the desk at home", or "in the pocket at work". This paper discusses several potential uses of this technology, as well as results from a two-part study, which indicates that this technique can detect placement at 94.4% accuracy with real-world placement sets.

REFERENCES

• 1: Gaetano Borriello , Matthew Chalmers , Anthony LaMarca , Paddy Nixon, Delivering real-world ubiquitous location systems, Communications of the ACM, v.48 n.3, March 2005 [doi>10.1145/1047671.1047701]
• 2: Jeffrey Hightower , Gaetano Borriello, Location Systems for Ubiquitous Computing, Computer, v.34 n.8, p.57-66, August 2001 [doi>10.1109/2.940014]
• 3: Ken Hinckley , Eric Horvitz, Toward more sensitive mobile phones, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502382]
• 4: Joyce Ho , Stephen S. Intille, Using context-aware computing to reduce the perceived burden of interruptions from mobile devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055100]
• 5: Fahim Kawsar , Kaori Fujinami , Tatsuo Nakajima, A lightweight indoor location model for sentient artefacts using sentient artefacts, Proceedings of the 2007 ACM symposium on Applied computing, March 11-15, 2007, Seoul, Korea [doi>10.1145/1244002.1244347]
• 6: Uwe Maurer , Asim Smailagic , Daniel P. Siewiorek , Michael Deisher, Activity Recognition and Monitoring Using Multiple Sensors on Different Body Positions, Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks, p.113-116, April 03-05, 2006 [doi>10.1109/BSN.2006.6]
• 7: Lionel M. Ni , Yunhao Liu , Yiu Cho Lau , Abhishek P. Patil, LANDMARC: Indoor Location Sensing Using Active RFID, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, p.407, March 23-26, 2003
• 8: Otsason, V. Varshavsky, A., LaMarca, A., Lara, E. Accurate GSM Indoor Localization, In Proceedings of UbiComp '05, pp. 141--158.
• 9: Julian Randall , Oliver Amft , Jürgen Bohn , Martin Burri, LuxTrace: indoor positioning using building illumination, Personal and Ubiquitous Computing, v.11 n.6, p.417-428, August 2007 [doi>10.1007/s00779-006-0097-0]
• 10: Schmidt, A., Beigl, M., and Hans-W, H. There is more to context than location. Computers and Graphics, 23, 6 (1999), 893--901.
• 11: Wang, Y., Jia, X., and Lee, H. K. An indoors wireless positioning system based on wireless local area network infrastructure. In Proceedings of SatNav'03, July 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  C. Computer Systems Organization
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.3 Microcomputers
          Subjects: Portable devices (e.g., laptops, personal digital assistants)

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Human Factors

Keywords:
cell phones, context-aware, laptops, location, material detection, mobile devices, pdas, placement detection, sensors, situationally appropriate interaction