Who dotted that 'i'?: context free user differentiation through pressure and tilt pen data

ABSTRACT

With the proliferation of tablet PCs and multi-touch computers, collaborative input on a single sketched surface is becoming more and more prevalent. The ability to identify which user draws a specific stroke on a shared surface is widely useful in a) security/forensics research, by effectively identifying a forgery, b) sketch recognition, by providing the ability to employ user-dependent recognition algorithms on a multi-user system, and c) multi-user collaborative systems, by effectively discriminating whose stroke is whose in a complicated diagram. To ensure an adaptive user interface, we cannot expect nor require that users will self-identify nor restrict themselves to a single pen. Instead, we prefer a system that can automatically determine a stroke's owner, even when strokes by different users are drawn with the same pen, in close proximity, and near in timing. We present the results of an experiment that shows that the creator of an individual pen strokes can be determined with high accuracy, without supra-stroke context (such as timing, pen-ID, nor location), and based solely on the physical mechanics of how these strokes are drawn (specifically, pen tilt, pressure, and speed). Results from free-form drawing data, including text and doodles, but not signature data, show that our methods differentiate a single stroke (such as that of a dot of an 'i') between two users at an accuracy of 97.5% and between ten users at an accuracy of 83.5%.

REFERENCES

• 1: Christine Alvarado , Randall Davis, SketchREAD: a multi-domain sketch recognition engine, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029637]
• 2: Heeyoul Choi , Brandon Paulson , Tracy Hammond, Gesture Recognition Based on Manifold Learning, Proceedings of the 2008 Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition, December 04-06, 2008, Orlando, Florida [doi>10.1007/978-3-540-89689-0_29]
• 3: E. v. O. J. Dolfing, J. G. A.; Aarts. On-line signature verification with hidden markov models. Pattern Recognition, 1998. Proceedings. Fourteenth International Conference on, 2:1309--1312 vol. 2, 16--20 Aug 1998.
• 4: T. Hammond and R. Davis. Ladder, a sketching language for user interface developers. Computers & Graphics, 29(4):518--532, 2005.
• 5: Christopher F. Herot, Graphical input through machine recognition of sketches, Proceedings of the 3rd annual conference on Computer graphics and interactive techniques, p.97-102, July 14-16, 1976, Philadelphia, Pennsylvania
• 6: A. K. Jain, F. D. Griess, S. D. Connell, E. Lansing, and M. J. On-line signature verification. Pattern Recognition, 35:2963--2972, 2002.
• 7: Masato Kawamoto , Takayuki Hamamoto , Seiichiro Hangai, Improvement of On-line Signature Verification System Robust to Intersession Variability, Proceedings of the International ECCV 2002 Workshop Copenhagen on Biometric Authentication, p.168-176, June 01, 2002
• 8: K. Koppenhaver. Forensic Document Examination. Humana Press, 2006.
• 9: A. Chris Long , James A. Landay , Lawrence A. Rowe, "Those look similar!" issues in automating gesture design advice, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971510]
• 10: R. N. Morris. Forensic Handwritting Identification. Academic Press, 2000.
• 11: Kouichi Murakami , Hitomi Taguchi, Gesture recognition using recurrent neural networks, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.237-242, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108900]
• 12: D. Muramatsu and T. Matsumoto. Effectiveness of pen pressure, azimuth, and altitude features for online signature verification. Advances in Biometrics, pages 503--512, 2007.
• 13: Vishvjit S. Nalwa, Automatic On-line Signature Verification, Proceedings of the Third Asian Conference on Computer Vision-Volume I, p.10-15, January 08-10, 1998
• 14: Jonas Richiardi , Hamed Ketabdar , Andrzej Drygajlo, Local and Global Feature Selection for On-line Signature Verification, Proceedings of the Eighth International Conference on Document Analysis and Recognition, p.625-629, August 31-September 01, 2005 [doi>10.1109/ICDAR.2005.152]
• 15: Dean Rubine, Specifying gestures by example, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.329-337, July 1991
• 16: Tevfik Metin Sezgin , Randall Davis, HMM-based efficient sketch recognition, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040899]
• 17: Tevfik Metin Sezgin , Thomas Stahovich , Randall Davis, Sketch based interfaces: early processing for sketch understanding, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971487]
• 18: Tevfik Metin Sezgin , Thomas Stahovich , Randall Davis, Sketch based interfaces: early processing for sketch understanding, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971487]
• 19: J. J. Shah, N. Vargas-Hernandez, J. D. Summers, and S. Kulkarni. Collaborative sketching (c-sketch) - an idea generation technique for engineering design. The Journal of Creative Behavior, 35(3): 168--198, 2007.
• 20: Jacob O. Wobbrock , Andrew D. Wilson , Yang Li, Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294238]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)