Behavior-driven visualization recommendation

ABSTRACT

We present a novel approach to visualization recommendation that monitors user behavior for implicit signals of user intent to provide more effective recommendation. This is in contrast to previous approaches which are either insensitive to user intent or require explicit, user specified task information. Our approach, called Behavior-Driven Visualization Recommendation (BDVR), consists of two distinct phases: (1) pattern detection, and (2) visualization recommendation. In the first phase, user behavior is analyzed dynamically to find semantically meaningful interaction patterns using a library of pattern definitions developed through observations of real-world visual analytic activity. In the second phase, our BDVR algorithm uses the detected patterns to infer a user's intended visual task. It then automatically suggests alternative visualizations that support the inferred visual task more directly than the user's current visualization. We present the details of BDVR and describe its implementation within our lab's prototype visual analysis system. We also present study results that demonstrate that our approach shortens task completion time and reduces error rates when compared to behavior-agnostic recommendation.

REFERENCES

• 1: Elisabeth André , Thomas Rist, The design of illustrated documents as a planning task, Intelligent multimedia interfaces, American Association for Artificial Intelligence, Menlo Park, CA, 1993
• 2: L. Bavoil, S. P. Callahan, P. J. Crossno, J. Freire, C. E. Scheidegger, C. T. Silva, and H. T. Vo. Vistrails: Enabling interactive multiple-view visualizations. In IEEE Vis, 2005.
• 3: Stephen M. Casner, Task-analytic approach to the automated design of graphic presentations, ACM Transactions on Graphics (TOG), v.10 n.2, p.111-151, April 1991 [doi>10.1145/108360.108361]
• 4: Mark Derthick , Steven F. Roth, Data exploration across temporal contexts, Proceedings of the 5th international conference on Intelligent user interfaces, p.60-67, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325782]
• 5: Anton N. Dragunov , Thomas G. Dietterich , Kevin Johnsrude , Matthew McLaughlin , Lida Li , Jonathan L. Herlocker, TaskTracer: a desktop environment to support multi-tasking knowledge workers, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040855]
• 6: David Franklin , Jay Budzik , Kristian Hammond, Plan-based interfaces: keeping track of user tasks and acting to cooperate, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502731]
• 7: D. Gotz, Z. Wen, J. Lu, P. Kissa, M. Zhou, N. Cao, W. H. Qian, and S. X. Liu. Harvest -- visualization and analysis for the masses. In IEEE InfoVis Poster, 2008.
• 8: D. Gotz and M. X. Zhou. Characterizing users' visual analytic activity for insight provenance. In IEEE VAST, 2008.
• 9: D. Gotz and M. X. Zhou. An empirical study of user interaction behavior during visual analysis. Technical Report RC24525, IBM Research, 2008.
• 10: Yoshinori Hijikata, Implicit user profiling for on demand relevance feedback, Proceedings of the 9th international conference on Intelligent user interfaces, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964480]
• 11: T. J. Jankun-Kelly , Kwan Liu Ma , Michael Gertz, A model for the visualization exploration process, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
• 12: Alfred Kobsa, An Empirical Comparison of Three Commercial Information Visualization Systems, Proceedings of the IEEE Symposium on Information Visualization 2001 (INFOVIS'01), p.123, October 22-23, 2001
• 13: M. Kreuseler , T. Nocke , H. Schumann, A History Mechanism for Visual Data Mining, Proceedings of the IEEE Symposium on Information Visualization, p.49-56, October 10-12, 2004 [doi>10.1109/INFOVIS.2004.2]
• 14: Jock Mackinlay, Automating the design of graphical presentations of relational information, ACM Transactions on Graphics (TOG), v.5 n.2, p.110-141, April 1986 [doi>10.1145/22949.22950]
• 15: D. W. Oard and J. Kim. Implicit feedback for recommender systems. In AAAI Workshop on Recommender Systems, 1998.
• 16: Nuria Oliver , Greg Smith , Chintan Thakkar , Arun C. Surendran, SWISH: semantic analysis of window titles and switching history, Proceedings of the 11th international conference on Intelligent user interfaces, January 29-February 01, 2006, Sydney, Australia [doi>10.1145/1111449.1111492]
• 17: Adam Perer , Ben Shneiderman, Systematic yet flexible discovery: guiding domain experts through exploratory data analysis, Proceedings of the 13th international conference on Intelligent user interfaces, January 13-16, 2008, Gran Canaria, Spain [doi>10.1145/1378773.1378788]
• 18: Matthew D. Plumlee , Colin Ware, Zooming versus multiple window interfaces: Cognitive costs of visual comparisons, ACM Transactions on Computer-Human Interaction (TOCHI), v.13 n.2, p.179-209, June 2006 [doi>10.1145/1165734.1165736]
• 19: Steven F. Roth , John Kolojejchick , Joe Mattis , Jade Goldstein, Interactive graphic design using automatic presentation knowledge, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.112-117, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191719]
• 20: Daniel M. Russell , Mark J. Stefik , Peter Pirolli , Stuart K. Card, The cost structure of sensemaking, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.269-276, May 1993, Amsterdam, The Netherlands
• 21: Jianqiang Shen , Lida Li , Thomas G. Dietterich , Jonathan L. Herlocker, A hybrid learning system for recognizing user tasks from desktop activities and email messages, Proceedings of the 11th international conference on Intelligent user interfaces, January 29-February 01, 2006, Sydney, Australia [doi>10.1145/1111449.1111473]
• 22: Yedendra Babu Shrinivasan , Jarke J. van Wijk, Supporting the analytical reasoning process in information visualization, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357247]
• 23: Michelle X. Zhou , Vikram Aggarwal, An optimization-based approach to dynamic data content selection in intelligent multimedia interfaces, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029673]
• 24: M. X. Zhou and M. Chen. Automated generation of graphical sketches by example. In Proceedings of IJCAI, pages 65--74, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Algorithms, Human Factors

Keywords:
information visualization, intelligent visualization, user behavior modeling, visualization recommendation