When Individual Data Points Matter: Interactively Analysing Classification Landscapes

Abstract

The selection of classification models among several options with similar accuracy cannot be done through purely automated methods, and especially in scenarios in which the cost of misclassified instances is crucial, such as criminal intelligence analysis. To tackle this problem and illustrate our ideas, we developed a prototype for the visualization and comparison of classification landscapes. In our system, the same data is given to different classification models. Classification landscapes are shown in the scatter plots, together with their geographical location on a map and detailed textual description for each data record. To enhance model comparison, we implemented interactive anchor-points selection in classification landscapes. Using those anchors, the user can manipulate and reproject the model results in order to get more comparable classification landscapes. We provided a use case with crime data, for crime intelligence analysis.