Effect of Platform Used for Data Collection on Open-Ended Response Quality

Abstract Although the validity of collecting quantitative data using electronic platforms has been widely accepted, there has been concern that qualitative data collected on an electronic platform may not provide the same depth and richness in response quality as data collected using the pen-and-paper format. This article compares the quality of responses to open-ended questions collected using the pen-and-paper platform with responses collected using an electronic platform. Data for a program evaluation study were collected using either the pen-and-paper platform, an iPad, or an iPad Mini at a series of after-hours events for adults at the Center of Science and Industry, a Midwest science center. Metrics were designed to calculate a comprehensive response score consisting of the breadth of information and the richness of detail in open-ended item responses, allowing us to compare the overall response quality between the three platforms. Results indicate that qualitative data collected using electronic devices are as broad and detailed as data collected using traditional pen-and-paper techniques.