Expressive typing: a new way to sense typing pressure and its applications

ABSTRACT

In this paper, we propose a new way for measuring key typing pressure when using off-the-shelf laptop computers. Accelerometers embedded in laptop computers to protect hard discs from sudden motion are becoming very common. This paper explores the concept of utilizing this accelerometer for sensing non-verbal aspects of key typing, such as key typing pressure. This possibility enables a wide variety of pressure-sensitive user interfaces through the use of software without requiring any additional hardware/sensors. Such software can be distributed easily to a substantial number of potential users. To confirm the feasibility of this idea, we compared typing finger velocities (obtained by high-speed camera images) with sensor data from an accelerometer embedded in a laptop computer. We then confirmed that there is a clear correlation between these two sets of data. We also investigated differences in typing pressure patterns among different users. By combining keystroke speeds and typing pressure, we found it is possible to distinguish among users. This feature can be used for security purposes such as preventing a laptop computer from being used by non-owners. We also present possible application ideas such as rich text expression, new types of user interface elements, and authentication.

REFERENCES

• 1: Daniel Griscom, Suitable Systems-- SeisMac http://www.suitable.com/
• 2: Rick Joyce , Gopal Gupta, Identity authentication based on keystroke latencies, Communications of the ACM, v.33 n.2, p.168-176, Feb. 1990 [doi>10.1145/75577.75582]
• 3: Loy, C.C., Lai, W.K. and Lim, C.P. Development of a Pressure-based Typing Biometrics User Authentication System. ASEAN Virtual Instrumentation Applications Contest Submission, National Instruments (2005).
• 4: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 5: President-Elect Barack Obama's Election Night speech http://elections.nytimes.com/2008/results/president/speeches/obama-victory-speech.html
• 6: TypeTrace.jp http://typetrace.jp/
• 7: Vargas, M.F. Louder Than Words: An Introduction to Nonverbal Communication. Iowa State Press, 1986.
• 8: Hua Wang , Helmut Prendinger , Takeo Igarashi, Communicating emotions in online chat using physiological sensors and animated text, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986016]
• 9: Yamada, Y., Hirano, T. and Nishimoto, K. TangibleChat: Communication of conversation situation awareness using a sense of touch in a keyboard chat system. Tech. Report SIG-GW-43-18 Information Processing Society of Japan, 2002, 103--108

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design

Keywords:
non-verbal communication, physiological sensing, user interface