{"title":"测量未测量的:结合技术和行为洞察力来改进业务结果的测量","authors":"Stephen J. Anderson, Christy Lazicky, B. Zia","doi":"10.1596/1813-9450-8836","DOIUrl":null,"url":null,"abstract":"Business survey outcomes for micro and small firms are notoriously noisy, with multiple sources of measurement and recall error. This paper introduces a new survey methodology that combines automatic consistency checks of electronic data collection with triangulation and dynamic adjustment to arrive at more precise estimates of business performance. The methodology uses insights from behavioral science to lower the cognitive cost of initial recall and establishes salient and relevant anchors to allow for dynamic triangulation and adjustment toward a final estimate. The validity of this method is field tested against traditional performance measures as well as administrative data across three emerging markets: Ghana, Rwanda, and Uganda. The results show significant upward adjustment from traditional measures for both sales and profits, a lower coefficient of variation in the cross-section, and higher autocorrelation in panel data. Comparisons with administrative data further confirm a higher correlation and closer magnitude relative to traditional measures. This research reconciles recommendations for increased attention to survey design with a method to leverage electronic survey technology beyond consistency checks.","PeriodicalId":288317,"journal":{"name":"International Political Economy: Globalization eJournal","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":"{\"title\":\"Measuring the Unmeasured: Combining Technology and Behavioral Insights to Improve Measurement of Business Outcomes\",\"authors\":\"Stephen J. Anderson, Christy Lazicky, B. Zia\",\"doi\":\"10.1596/1813-9450-8836\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Business survey outcomes for micro and small firms are notoriously noisy, with multiple sources of measurement and recall error. This paper introduces a new survey methodology that combines automatic consistency checks of electronic data collection with triangulation and dynamic adjustment to arrive at more precise estimates of business performance. The methodology uses insights from behavioral science to lower the cognitive cost of initial recall and establishes salient and relevant anchors to allow for dynamic triangulation and adjustment toward a final estimate. The validity of this method is field tested against traditional performance measures as well as administrative data across three emerging markets: Ghana, Rwanda, and Uganda. The results show significant upward adjustment from traditional measures for both sales and profits, a lower coefficient of variation in the cross-section, and higher autocorrelation in panel data. Comparisons with administrative data further confirm a higher correlation and closer magnitude relative to traditional measures. This research reconciles recommendations for increased attention to survey design with a method to leverage electronic survey technology beyond consistency checks.\",\"PeriodicalId\":288317,\"journal\":{\"name\":\"International Political Economy: Globalization eJournal\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-04-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"8\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Political Economy: Globalization eJournal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1596/1813-9450-8836\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Political Economy: Globalization eJournal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1596/1813-9450-8836","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Measuring the Unmeasured: Combining Technology and Behavioral Insights to Improve Measurement of Business Outcomes
Business survey outcomes for micro and small firms are notoriously noisy, with multiple sources of measurement and recall error. This paper introduces a new survey methodology that combines automatic consistency checks of electronic data collection with triangulation and dynamic adjustment to arrive at more precise estimates of business performance. The methodology uses insights from behavioral science to lower the cognitive cost of initial recall and establishes salient and relevant anchors to allow for dynamic triangulation and adjustment toward a final estimate. The validity of this method is field tested against traditional performance measures as well as administrative data across three emerging markets: Ghana, Rwanda, and Uganda. The results show significant upward adjustment from traditional measures for both sales and profits, a lower coefficient of variation in the cross-section, and higher autocorrelation in panel data. Comparisons with administrative data further confirm a higher correlation and closer magnitude relative to traditional measures. This research reconciles recommendations for increased attention to survey design with a method to leverage electronic survey technology beyond consistency checks.