Code: Training machine learning algorithms for automatic facial coding: The role of emotional facial expressions’ prototypicality

Item Type:	Dataset
Title:	Code: Training machine learning algorithms for automatic facial coding: The role of emotional facial expressions’ prototypicality
Date:	21 January 2023
Creator:	Büdenbender, Björn, Höfling, Tim, Gerdes, Antje B. M. and Alpers, Georg W.

DDC Classification:	150 Psychology
Keywords:	Automatic Facial Coding; Action Units; Basic Emotions; Machine Learning; Facial Expression; Emotion Recognition; Facial Based Emotion Recognition; Facial Expression Recognition
Abstract:	This repository contains the R-Code necessary for the analyses reported in the article "Training machine learning algorithms for automatic facial coding: The role of emotional facial expressions’ prototypicality" published in Plos ONE. Automatic facial coding (AFC) is a promising new research tool to efficiently analyze emotional facial expressions. AFC is based on machine learning procedures to infer emotion categorization from facial movements (i.e., Action Units). State-of-the-art AFC accurately classifies intense and prototypical facial expressions, whereas it is less accurate for non-prototypical and less intense facial expressions. A potential reason might be that AFC is typically trained with standardized and prototypical facial expression inventories. Because AFC would be useful to analyze less prototypical research material as well, we set out to determine the role of prototypicality in the training material. We trained established machine learning algorithms either with standardized expressions from widely used research inventories or with unstandardized emotional facial expressions obtained in a typical laboratory setting and tested them on identical or cross-over material. All machine learning models’ accuracies were comparable when trained and tested with held-out dataset from the same dataset (acc. = [83.4% to 92.5%]). Strikingly, we found a substantial drop in accuracies for models trained with the highly prototypical standardized dataset when tested in the unstandardized dataset (acc. = [52.8%; 69.8%]). However, when they were trained with unstandardized expressions and tested with standardized datasets, accuracies held up (acc. = [82.7%; 92.5%]). These findings demonstrate a strong impact of the training material’s prototypicality on AFC’s ability to classify emotional faces. Because AFC would be useful for analyzing emotional facial expressions in research or even naturalistic scenarios, future developments should include more naturalistic facial expressions for training. This approach will improve the generalizability of AFC to encode more naturalistic facial expressions and increase robustness for future applications of this promising technology.

URL:	https://madata.bib.uni-mannheim.de/408/
DOI:	https://doi.org/10.7801/408
Availability (Controlled):	Delivery
Availability:	Via Request

Metadata export

Multiline CSVReference ManagerBibTeXEP3 XMLHTML Citation

File	Filename / Infos	Link
	Archive Filename: 2023Büdenbender_Etal_Code.zip Software: RStudio No License defined Restricted to Private (Only you and Repository Staff)	Download (3MB) | Request a copy

Depositing User:	osidata
Date Deposited:	21 Jan 2023 10:38
Last Modified:	26 Jun 2023 14:14

Actions (login required)

View Item