FlowStates: prototypage d'applications interactives avec des flots de données et des machines à états

ABSTRACT

This article introduces FlowStates, a user interface toolkit compatible with Java Swing that combines two models for managing events: dataflow and state machines. The dataflow model makes it easy to support non-standard input devices and to reconfigure interactions according to the available devices, while state machines support the programming of complex interactions. The article illustrates the power and expressivity of this hybrid approach and the flexibility afforded by the explicit decision to not set strict limits between the roles of each model.

REFERENCES

• 1: A metamodel for the runtime architecture of an interactive system: the UIMS tool developers workshop. SIGCHI Bull., 24(1):32--37, 1992.
• 2: J. Accot, S. Chatty, and S. Maury. Formal transducers: Models of devices and building bricks for the design of highly interactive systems. In Proc. DSV-IS'97, 143--160. Springer-Verlag, 1997.
• 3: C. Appert and M. Beaudouin-Lafon. SwingStates: Adding state machines to Java and the Swing toolkit. Software: Practice and Experience, 38(11):1149--1182, 2008.
• 4: R. Ballagas, M. Ringel, M. Stone, and J. Borchers. iStuff: a physical user interface toolkit for ubiquitous computing environments. In Proc. CHI'03, 537--544. ACM, 2003.
• 5: M. Beaudouin-Lafon. Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In Proc. CHI'00, 446--453. ACM, 2000.
• 6: R. Blanch and M. Beaudouin-Lafon. Programming rich interactions using the hierarchical state machine toolkit. In Proc. AVI'06, 51--58. ACM, 2006.
• 7: F. Bourgeois and Y. Guiard. Multiscale pointing: facilitating pan-zoom coordination. In Proc. CHI EA'02, 758--759. ACM, 2002.
• 8: W. Buxton. A three-state model of graphical input. In INTERACT, volume 90, 449--456, 1990.
• 9: S. Chatty, A. Lemort, and S. Vales. Multiple input support in a model-based interaction framework. In Proc. TABLETOP '07, 179--186, Oct. 2007.
• 10: C. D. T. Cicalese and S. Rotenstreich. Behavioral specification of distributed software component interfaces. Computer, 32(7):46--53, 1999.
• 11: Cycling '74. max/msp/jitter. www.cycling74.com.
• 12: Dassault Systemes. Virtools Dev. www.virtools.com.
• 13: G. de Haan and F. H. Post. Flexible architecture for the development of realtime interaction behavior. In Workshop VR'08. IEEE Computer Society, 2008.
• 14: P. Dragicevic and J.-D. Fekete. Support for input adaptability in the ICON toolkit. In Proc. ICMI'04, 212--219. ACM, 2004.
• 15: P. Figueroa, M. Green, and H. J. Hoover. InTml: a description language for VR applications. In Proc. Web3D '02, 53--58. ACM, 2002.
• 16: G. Fitzmaurice, A. Khan, R. Pieké, B. Buxton, and G. Kurtenbach. Tracking menus. In Proc. UIST'03, 71--79. ACM, 2003.
• 17: C. Forlines, D. Vogel, and R. Balakrishnan. Hybrid-pointing: fluid switching between absolute and relative pointing with a direct input device. In Proc. UIST'06, 211--220. ACM, 2006.
• 18: N. Halbwachs, P. Caspi, P. Raymond, and D. Pilaud. The synchronous data flow programming language LUSTRE. Proc. of the IEEE, 79(9):1305--1320, 1991.
• 19: K. Hinckley, M. Czerwinski, and M. Sinclair. Interaction and modeling techniques for desktop two-handed input. In Proc. UIST'98, 49--58. ACM, 1998.
• 20: S. Hudson, J. Mankoff, and I. Smith. Extensible input handling in the subArctic toolkit. In Proc. CHI'05, 381--390. ACM, 2005.
• 21: S. Huot, C. Dumas, P. Dragicevic, J.-D. Fekete, and G. Hégron. The MaggLite post-WIMP toolkit: Draw it, connect it and run it. In Proc. UIST'04, 257--266. ACM, 2004.
• 22: R. J. K. Jacob, L. Deligiannidis, and S. Morrison. A software model and specification language for non-WIMP user interfaces. ACM Trans. Comput.-Hum. Interact., 6(1):1--46, 1999.
• 23: W. A. König, R. Rädle, and H. Reiterer. Squidy: a zoomable design environment for natural user interfaces. In Proc. CHI EA'09, 4561--4566. ACM, 2009.
• 24: Meso Group. vvvv: a multipurpose toolkit. http://vvvv.org/.
• 25: B. Myers. Separating application code from toolkits: eliminating the spaghetti of call-backs. In Proc. UIST'91, 211--220. ACM, 1991.
• 26: B. Myers, D. Giuse, R. Dannenberg, B. Zanden, D. Kosbie, E. Pervin, A. Mickish, and P. Marchal. Garnet: Comprehensive support for graphical, highly interactiveuser interfaces. Computer, 23(11):71--85, 1990.
• 27: B. Myers, R. McDaniel, R. Miller, A. Ferrency, A. Faulring, B. Kyle, A. Mickish, A. Klimovitski, and P. Doane. The Amulet environment: new models for effective user interfacesoftware development. IEEE Trans. Soft. Eng., 23(6):347--365, 1997.
• 28: D. Navarre, P. Palanque, P. Dragicevic, and R. Bastide. An approach integrating two complementary model-based environments for the construction of multimodal interactive applications. Interact. Comput., 18(5):910--941, 2006.
• 29: E. Pietriga. A toolkit for addressing hci issues in visual language environments. In Proc. VL/HCC'05, 145--152. IEEE Computer Society, 2005.
• 30: E. Pietriga and C. Appert. Sigma lenses: focuscontext transitions combining space, time and trans-lucence. In Proc. CHI'08, 1343--1352. ACM, 2008.
• 31: S. Pook, E. Lecolinet, G. Vaysseix, and E. Barillot. Control menus: excecution and control in a single interactor. In Proc. CHI EA'00, 263--264. ACM, 2000.
• 32: SENSE8. World Up. www.sense8.com.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Design, Languages

Keywords:
dataflow, state machine, user interface toolkit