Back
Document
Journal article

Description languages for multimodal interaction : a set of guidelines and its illustration with SMUIML

  • Dumas, Bruno Computer Science Department, University of Fribourg, Switzerland
  • Lalanne, Denis Computer Science Department, University of Fribourg, Switzerland
  • Ingold, Rolf Computer Science Department, University of Fribourg, Switzerland
    11.02.2010
Published in:
  • Journal on multimodal user interfaces. - 2010, vol. 3, no. 3, p. 237-247
Markup languages
Multimodal interfaces
Multimodal modelling
Human-machine interaction
English This article introduces the problem of modeling multimodal interaction, in the form of markup languages. After an analysis of the current state of the art in multimodal interaction description languages, nine guidelines for languages dedicated at multimodal interaction description are introduced, as well as four different roles that such language should target: communication, configuration, teaching and modeling. The article further presents the SMUIML language, our proposed solution to improve the time synchronicity aspect while still fulfilling other guidelines. SMUIML is finally mapped to these guidelines as a way to evaluate their spectrum and to sketch future works.
Faculty
Faculté des sciences et de médecine
Department
Département d'Informatique
Language
  • English
Classification
Computer science and technology
License
License undefined
Identifiers
Persistent URL
https://folia.unifr.ch/unifr/documents/301711
Statistics
Document views: 72 File downloads:
  • 12193_2010_Article_43.pdf: 104