Map Task Deviation Scores: A Reconstruction

Abstract

The Human Communication Research Centre Map Task Corpus is a landmark data source for analysis of multimodal dialogue corpora. The task in this dialogue is the communication by an information giver of a path on a map to an information follower. The corpus includes a measure of task success for each dialogue: the deviation from path scores (the information follower's path from the information giver's path). The original HCRC Map Task works gives information on how the scores for each map were calculated. However, upon analysis and inspection of the corpus materials, we find that it is not possible to reproduce the recorded scores exactly. We report four candidate reconstructions that all appear rational, and note the correlations these lead to with the deviation scores recorded with the corpus. This is important to anyone wishing to reproduce the HCRC method on map-task corpora.