Data & Machine Learning

Reading People's Minds from Emotion Expressions

Here I use multiple mediation analysis to establish that (1) people retrieve, from emotion expressions, information about how others are appraising the ongoing interaction, (2) from appraisals, in turn, people make inferences about the other's mental states.

1. Human-Subject Experiments
Participants engage in the prisoner's dilemma with virtual humans that express emotion.
2. Emotion Expressions Impact Perceptions of Appraisal
The results show that emotion expressions influence perceptions of appraisal (e.g., anger means other does not like the current state of affairs and blames you for it).
3. Emotion Expressions Impact Expectations of Cooperation
The results show that emotion expressions impact expectations of cooperation in the prisoner's dilemma (e.g., regret following exploitation suggests that other is likely to start cooperating in the future).
4. Appraisals Mediate the Effect of Emotion Expressions
Multiple mediation analysis shows that the effect of emotion expressions on expectations of cooperation is mediated by perceptions of appraisal, i.e., people retrieve information about appraisals from emotions!
Bootstrap Slider

Bayesian Model of Social Effects of Emotion

Here I use multiple mediation analysis to establish that (1) people retrieve, from emotion expressions, information about how others are appraising the ongoing interaction, (2) from appraisals, in turn, people make inferences about the other's mental states.

1. Bayesian Network Based on Appraisal Theories
The network reflects reverse appraisal theory: people retrieve information, from emotion displays, about others' appraisals; this information, in turn, leads to inferences about mental states.
2. Learn Parameters Using EM Algorithm
We use the data collected from our human-subjects experiments to train our Bayesian network. The calculated probabilities are intuitive (e.g., low perception of goal conduciveness following mutual cooperation leads to a low expectation of cooperation).
3. Model's Performance
A model that considers appraisals, emotion, and outcome outperforms models that only consider subset of this information.
Bootstrap Slider

Last updated: February 19th, 2017