Assessing Content Validity of Enterprise Architecture Adoption Questionnaire (EAAQ) Among Content Experts

Abstract

Content validity is the process to validate the measurement items from the perspective of experts. Notably, there are lack of validated items measuring the perception of intention to adopt Enterprise Architecture (EA) in the public sector organisations. This study intended to develop and assess the content validity of measurement items for EAAQ as a survey instrument to public sector organisations. Twelve academic and industrial content experts have assessed the validity of 14 identified constructs and 52 measurement items. This study was conducted through two cycles of content validation process. The written EAAQ was distributed via email or by a meeting session with the content experts for assessing the measurement items. The analysis of content experts’ consensus was examined using a quantitative approach called Content Validity Ratio (CVR) and Content Validity Index (CVI). Of the 52 items, 50 were accepted, as the CVR’s critical value that must be abided by 0.75 (N = 8) and two items were rejected. Then, the accepted items were computed to a final form using CVI. The acceptable CVI value for the final EAAQ is 0.94. Therefore, a new 50-item EAAQ was developed based on validated content and face values by the experts for public sector organisations. In future, the measurement items should be reassessed on its psychometric properties for the EAAQ reliability and internal consistency. This instrument would be useful for measuring the perception of EA adoption in organisations.