Ielka van der Sluis


2017

pdf bib
Text-Picture Relations in Multimodal Instructions
Ielka van der Sluis | Anne Nienke Eppinga | Gisela Redeker
Proceedings of the IWCS workshop on Foundations of Situated and Multimodal Communication

2016

pdf bib
PAT workbench: Annotation and Evaluation of Text and Pictures in Multimodal Instructions
Ielka van der Sluis | Lennart Kloppenburg | Gisela Redeker
Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH)

This paper presents a tool to investigate the design of multimodal instructions (MIs), i.e., instructions that contain both text and pictures. The benefit of including pictures in information presentation has been established, but the characteristics of those pictures and of their textual counterparts and the rela-tion(s) between them have not been researched in a systematic manner. We present the PAT Work-bench, a tool to store, annotate and retrieve MIs based on a validated coding scheme with currently 42 categories that describe instructions in terms of textual features, pictorial elements, and relations be-tween text and pictures. We describe how the PAT Workbench facilitates collaborative annotation and inter-annotator agreement calculation. Future work on the tool includes expanding its functionality and usability by (i) making the MI annotation scheme dynamic for adding relevant features based on empirical evaluations of the MIs, (ii) implementing algorithms for automatic tagging of MI features, and (iii) implementing automatic MI evaluation algorithms based on results obtained via e.g. crowdsourced assessments of MIs.

2011

pdf bib
A Cross-Linguistic Study on the Production of Multimodal Referring Expressions in Dialogue
Ielka van der Sluis | Saturnino Luz
Proceedings of the 13th European Workshop on Natural Language Generation

pdf bib
Production of Demonstratives in Dutch, English and Portuguese Dialogues
Saturnino Luz | Ielka van der Sluis
Proceedings of the 13th European Workshop on Natural Language Generation

2009

pdf bib
Towards Empirical Evaluation of Affective Tactical NLG
Ielka van der Sluis | Chris Mellish
Proceedings of the 12th European Workshop on Natural Language Generation (ENLG 2009)

2008

pdf bib
Using Tactical NLG to Induce Affective States: Empirical Investigations
Ielka van der Sluis | Chris Mellish
Proceedings of the Fifth International Natural Language Generation Conference

2007

pdf bib
Evaluating algorithms for the Generation of Referring Expressions using a balanced corpus
Albert Gatt | Ielka van der Sluis | Kees van Deemter
Proceedings of the Eleventh European Workshop on Natural Language Generation (ENLG 07)

2006

pdf bib
Building a Semantically Transparent Corpus for the Generation of Referring Expressions.
Kees van Deemter | Ielka van der Sluis | Albert Gatt
Proceedings of the Fourth International Natural Language Generation Conference

2004

pdf bib
Evaluating Multimodal NLG Using Production Experiments
Ielka van der Sluis | Emiel Krahmer
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)

2003

pdf bib
A New Model for Generating Multimodal Referring Expressions
Emiel Krahmer | Ielka van der Sluis
Proceedings of the 9th European Workshop on Natural Language Generation (ENLG-2003) at EACL 2003