Relation between facial expression and user described episodic memory timeline in short movies

Narrative or episodic memory is a way of how humans recall a story. Narrative has also a strong connection with human emotions and attention. We combine the analysis of facial expressions and attention to find a way to generate an episodic memory timeline which matches each individual person. We use face shape deformations and eye gaze to understand when a person has a change of facial expression and associate this with a narrative event. To evaluate our assumption, we performed an experiment where several subjects watch a short video while their physical reactions were recorded; then our software generates an episodic memory timeline based on those reactions. We found that, even with the same video, the episodic memory timeline for each subject was unique. We found as well, that physical reactions and participant's memory recalls, were consistent with the generated episodic memory timeline.