Nadia Magnenat-Thalmann


pdf bib
The PlayMancer Database: A Multimodal Affect Database in Support of Research and Development Activities in Serious Game Environment
Theodoros Kostoulas | Otilia Kocsis | Todor Ganchev | Fernando Fernández-Aranda | Juan J. Santamaría | Susana Jiménez-Murcia | Maher Ben Moussa | Nadia Magnenat-Thalmann | Nikos Fakotakis
Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)

The present paper reports on a recent effort that resulted in the establishment of a unique multimodal affect database, referred to as the PlayMancer database. This database was created in support of the research and development activities, taking place within the PlayMancer project, which aim at the development of a serious game environment in support of treatment of patients with behavioural and addictive disorders, such as eating disorders and gambling addictions. Specifically, for the purpose of data collection, we designed and implemented a pilot trial with healthy test subjects. Speech, video and bio-signals (pulse-rate, SpO2) were captured synchronously, during the interaction of healthy people with a number of video games. The collected data were annotated by the test subjects (self-annotation), targeting proper interpretation of the underlying affective states. The broad-shouldered design of the PlayMancer database allows its use for the needs of research on multimodal affect-emotion recognition and multimodal human-computer interaction in serious games environment.