Automatic Coding of Facial Expressions of Pain: Are We There Yet?

Faculty/Professorship: Physiological Psychology  ; University of Bamberg  ; Cognitive Systems  
Author(s): Lautenbacher, Stefan ; Hassan, Teena; Seuß, Dominik; Loy, Frederik Werner ; Garbas, Jens-Uwe; Schmid, Ute  ; Kunz, Miriam
Publisher Information: Bamberg : Otto-Friedrich-Universität
Year of publication: 2022
Pages: 8
Source/Other editions: Pain research & management, 2022 (2022), 8 S. - ISSN: 1203-6765
is version of: 10.1155/2022/6635496
Year of first publication: 2022
Language(s): English
Licence: Creative Commons - CC BY - Attribution 4.0 International 
URN: urn:nbn:de:bvb:473-irb-542663
Introduction. The experience of pain is regularly accompanied by facial expressions. The gold standard for analyzing these facial expressions is the Facial Action Coding System (FACS), which provides so-called action units (AUs) as parametrical indicators of facial muscular activity. Particular combinations of AUs have appeared to be pain-indicative. The manual coding of AUs is, however, too time- and labor-intensive in clinical practice. New developments in automatic facial expression analysis have promised to enable automatic detection of AUs, which might be used for pain detection. Objective. Our aim is to compare manual with automatic AU coding of facial expressions of pain. Methods. FaceReader7 was used for automatic AU detection. We compared the performance of FaceReader7 using videos of 40 participants (20 younger with a mean age of 25.7 years and 20 older with a mean age of 52.1 years) undergoing experimentally induced heat pain to manually coded AUs as gold standard labeling. Percentages of correctly and falsely classified AUs were calculated, and we computed as indicators of congruency, “sensitivity/recall,” “precision,” and “overall agreement (F1).” Results. The automatic coding of AUs only showed poor to moderate outcomes regarding sensitivity/recall, precision, and F1. The congruency was better for younger compared to older faces and was better for pain-indicative AUs compared to other AUs. Conclusion. At the moment, automatic analyses of genuine facial expressions of pain may qualify at best as semiautomatic systems, which require further validation by human observers before they can be used to validly assess facial expressions of pain.
GND Keywords: Schmerz; Mimik
Keywords: pain, facial expression, coding
DDC Classification: 610 Medicine & health  
RVK Classification: YI 5793   
Type: Article
Release Date: 11. July 2022

File SizeFormat  
fisba54266.pdf451.3 kBPDFView/Open