Brigitte Krenn


2020

pdf bib
Linguistic, Kinematic and Gaze Information in Task Descriptions: The LKG-Corpus
Tim Reinboth | Stephanie Gross | Laura Bishop | Brigitte Krenn
Proceedings of the 12th Language Resources and Evaluation Conference

Data from neuroscience and psychology suggest that sensorimotor cognition may be of central importance to language. Specifically, the linguistic structure of utterances referring to concrete actions may reflect the structure of the sensorimotor processing underlying the same action. To investigate this, we present the Linguistic, Kinematic and Gaze information in task descriptions Corpus (LKG-Corpus), comprising multimodal data on 13 humans, conducting take, put, and push actions, and describing these actions with 350 utterances. Recorded are audio, video, motion and eye-tracking data while participants perform an action and describe what they do. The dataset is annotated with orthographic transcriptions of utterances and information on: (a) gaze behaviours, (b) when a participant touched an object, (c) when an object was moved, (d) when a participant looked at the location s/he would next move the object to, (e) when the participant’s gaze was stable on an area. With the exception of the annotation of stable gaze, all annotations were performed manually. With the LKG-Corpus, we present a dataset that integrates linguistic, kinematic and gaze data with an explicit focus on relations between action and language. On this basis, we outline applications of the dataset to both basic and applied research.

2018

pdf bib
Action Verb Corpus
Stephanie Gross | Matthias Hirschmanner | Brigitte Krenn | Friedrich Neubarth | Michael Zillich
Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)

2016

pdf bib
The OFAI Multi-Modal Task Description Corpus
Stephanie Schreitter | Brigitte Krenn
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)

The OFAI Multimodal Task Description Corpus (OFAI-MMTD Corpus) is a collection of dyadic teacher-learner (human-human and human-robot) interactions. The corpus is multimodal and tracks the communication signals exchanged between interlocutors in task-oriented scenarios including speech, gaze and gestures. The focus of interest lies on the communicative signals conveyed by the teacher and which objects are salient at which time. Data are collected from four different task description setups which involve spatial utterances, navigation instructions and more complex descriptions of joint tasks.

2010

pdf bib
Episodic Memory for Companion Dialogue
Gregor Sieber | Brigitte Krenn
Proceedings of the 2010 Workshop on Companionable Dialogue Systems

2001

pdf bib
Methods for the Qualitative Evaluation of Lexical Association Measures
Stefan Evert | Brigitte Krenn
Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics

2000

pdf bib
CDB - A Database of Lexical Collocations
Brigitte Krenn
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00)

1997

pdf bib
Tagging Grammatical Functions
Thorsten Brants | Wojciech Skut | Brigitte Krenn
Second Conference on Empirical Methods in Natural Language Processing

pdf bib
An Annotation Scheme for Free Word Order Languages
Wojciech Skut | Brigitte Krenn | Thorsten Brants | Hans Uszkoreit
Fifth Conference on Applied Natural Language Processing

pdf bib
Software for Annotating Argument Structure
Wojciech Skut | Brigitte Krenn | Thorsten Brants | Hans Uszkoreit
Fifth Conference on Applied Natural Language Processing: Descriptions of System Demonstrations and Videos