{"title":"Reviewers","authors":"E. Board","doi":"10.2458/v8i2.22999","DOIUrl":"https://doi.org/10.2458/v8i2.22999","url":null,"abstract":"","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48387080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
D. Iacobucci, Rebecca McBride, Deidre Popovich, Maria Rouziou
{"title":"In Social Network Analysis, Which Centrality Index Should I Use?: Theoretical Differences and Empirical Similarities among Top Centralities","authors":"D. Iacobucci, Rebecca McBride, Deidre Popovich, Maria Rouziou","doi":"10.2458/V8I2.22991","DOIUrl":"https://doi.org/10.2458/V8I2.22991","url":null,"abstract":"This research examines four frequently used centrality indices—degree, closeness, betweenness, and eigenvectors—to understand the extent to which their clear theoretical distinctions are reflected in differences in empirical performance. Even for stylized networks in which one centrality index may seem more relevant than the others, the four indices are frequently highly correlated. This result can be interpreted as good news: it does not diminish the conceptual distinctions, yet it suggests the indices are rather robust, yielding similar information about actors’ positions in networks, which can be reassuring given their widespread use by applied network analysts who may not appreciate the theoretically distinct origins and definitions. This research also compares computational speed across the centrality indices as another practical element that may help determine the choice of centrality index.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V8I2.22991","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47480122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Chi-square and F Ratio: Which should be used when?","authors":"R. Gorsuch, C. Lehmann","doi":"10.2458/V8I2.22990","DOIUrl":"https://doi.org/10.2458/V8I2.22990","url":null,"abstract":"Approximations for Chi-square and F distributions can both be computed to provide a p-value, or probability of Type I error, to evaluate statistical significance. Although Chi-square has been used traditionally for tests of count data and nominal or categorical criterion variables (such as contingency tables) and F ratios for tests of non-nominal or continuous criterion variables (such as regression and analysis of variance), we demonstrate that either statistic can be applied in both situations. We used data simulation studies to examine when one statistic may be more accurate than the other for estimating Type I error rates across different types of analysis (count data/contingencies, dichotomous, and non-nominal) and across sample sizes (Ns) ranging from 20 to 160 (using 25,000 replications for simulating p-value derived from either Chi-squares or F-ratios). Our results showed that those derived from F ratios were generally closer to nominal Type I error rates than those derived from Chi-squares. The p-values derived from F ratios were more consistent for contingency table count data than those derived from Chi-squares. The smaller than 100 the N was, the more discrepant p-values derived from Chi-squares were from the nominal p-value. Only when the N was greater than 80 did the p-values from Chi-square tests become as accurate as those derived from F ratios in reproducing the nominal p-values. Thus, there was no evidence of any need for special treatment of dichotomous dependent variables. The most accurate and/or consistent p's were derived from F ratios. We conclude that Chi-square should be replaced generally with the F ratio as the statistic of choice and that the Chi-square test should only be taught as history.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42850350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Editorial Personnel","authors":"Editorial Board","doi":"10.2458/v5i2.18528","DOIUrl":"https://doi.org/10.2458/v5i2.18528","url":null,"abstract":"","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/v5i2.18528","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45250869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development and Validation of an Adult Greek-American Identity Scale","authors":"S. Constantinou, M. Harvey, K. Larwin","doi":"10.2458/V8I1.22020","DOIUrl":"https://doi.org/10.2458/V8I1.22020","url":null,"abstract":"The current investigation demonstrates the development of an identity instrument, specifically for the measurement of Greek-American ethnic identity: the Adult Greek-American Identity Scale (AGIS). This scale construct validity was assessed with data collected from six Greek Orthodox parishes in northeastern Ohio. As an expansion of earlier research, this study demonstrates that the Greek-American Identity Scale successfully captures the salient elements of this complex and multifaceted phenomenon under four constructs: Ethos, Network, Diaspora, and Attitude. This study makes contributions to three areas of ethnic studies. First, it contributes to the literature on Greek-Americans, a small and understudied ethnic group. Second, this study provides an example of scale development which, although ethnic group specific, can be modified and applied to other ethnic groups. Third, this study makes a contribution to the growing literature that uses structural equation modeling (SEM) in the study of ethnic identity.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"8 1","pages":"20-57"},"PeriodicalIF":0.0,"publicationDate":"2018-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49181880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Reassessment of ANOVA Reporting Practices: A Review of Three APA Journals","authors":"Yuanyuan Zhou, S. T. Skidmore","doi":"10.2458/V8I1.22019","DOIUrl":"https://doi.org/10.2458/V8I1.22019","url":null,"abstract":"Historically, ANOVA has been the most prevalent statistical method used in educational and psychological research and today ANOVA continues to be widely used. A comprehensive review published in 1998 examined several APA journals and discovered persistent concerns in ANOVA reporting practices. The present authors examined all articles published in 2012 in three APA journals ( Journal of Applied Psychology , Journal of Counseling Psychology , and Journal of Personality and Social Psychology ) to review ANOVA reporting practices including p values and effect sizes. Results indicated that ANOVA continues to be prevalent in the reviewed journals as a test of the primary research question, as well as to test conditional assumptions prior to the primary analysis. Still, ANOVA reporting practices are essentially unchanged from what was previously reported. However, effect size reporting has improved.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"8 1","pages":"3-19"},"PeriodicalIF":0.0,"publicationDate":"2018-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V8I1.22019","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43837080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Laura T Colman, Robyn K Sobelson, Corinne J Wigington, Andrea C Young
{"title":"Assessing Participants' Experiences in a Service-Learning Program: A Psychometric Evaluation.","authors":"Laura T Colman, Robyn K Sobelson, Corinne J Wigington, Andrea C Young","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>There is currently a gap in the literature regarding the creation of psychometrically sound measurement tools assessing service-learning programs in health-related fields. Without comprehension of a survey's psychometric properties, evaluators cannot ensure that survey instruments are reliable or valid. This study describes the psychometric evaluation of the Public Health Associate Program (PHAP) Service-Learning Scale (PSLS). PSLS assesses participant experience in PHAP, a Centers for Disease Control and Prevention program. This paper explains survey development, scale validity and reliability, and the internal factor structure of the PSLS. The final scale consisted of 22 items with a high internal consistency (Cronbach's α=.90). Exploratory Factor Analysis (EFA) was used to determine the scale's factor structure; five factors comprising of all 22 items were retained. The factors, or subscales, were Learning Outcomes, Mentoring, Experiential Assignment, Self-Efficacy in Program Competency Domains, and Program Satisfaction. All were also found to have adequate internal consistency (Cronbach's α >.70). Service-learning is vital in developing the next generation of the workforce. These study findings suggest the PSLS fills a critical gap in the literature by providing a valid and reliable instrument to evaluate experiences and satisfaction in service-learning programs and other fellowships.</p>","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"9 2","pages":"32-49"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7185049/pdf/nihms-1039989.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37878061","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Success Rates Depend on the Appropriateness of the Outcome Measures","authors":"K. Royal","doi":"10.2458/V8I1.22018","DOIUrl":"https://doi.org/10.2458/V8I1.22018","url":null,"abstract":"This \"Cheap Lessons\" article emphasizes the importance of selecting an appropriate outcome. A brief example from the sports medicine literature relating to baseball pitching performance and the “Tommy John surgery” (TJS) is discussed. The example illustrates how an inappropriate outcome measure often utilized in studies involving the TJS has resulted in deceptive, overestimates of the surgery’s success rate. The unintended consequence of this methodological miscalculation is that numerous athletes have elected to pursue this unnecessary medical procedure and put both their health and sporting careers at risk.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"7 1","pages":"1-2"},"PeriodicalIF":0.0,"publicationDate":"2017-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V8I1.22018","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49034641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Covert Assessment of the Family System: Patterns, Pictures and Codes","authors":"Linda G. Bell, D. Bell","doi":"10.2458/V7I2.20322","DOIUrl":"https://doi.org/10.2458/V7I2.20322","url":null,"abstract":"Covert measures of the family system can tap concepts and discover patterns of which family members themselves are unaware and can avoid social desirability bias. Covert measures can be particularly useful in cross-cultural research and can avoid many pitfalls of language and translation. Three such measures which have been used cross-culturally are described. The first is a method of measuring triangulation of children by the parents based on patterns of agreement in a true-false questionnaire describing the family. The second is a projective measure in which family members as a group create a picture of their family distinguishing relationships between individuals and boundaries within and around the family. The third is a global coding scheme used to evaluate family processes from taped interaction.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"7 1","pages":"95-121"},"PeriodicalIF":0.0,"publicationDate":"2017-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.2458/V7I2.20322","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48399575","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Transforming the canons of John Stuart Mill from philosophy to replicative, empirical research: The Common Cause research design","authors":"W. Yeaton, Christopher G. Thompson","doi":"10.2458/V7I2.20329","DOIUrl":"https://doi.org/10.2458/V7I2.20329","url":null,"abstract":"When an element or factor is common to a set of circumstances that element may be causal in its relationship to particular dependent variables. This premise was stated by John Stuart Mill more than 170 years ago, and Mill's canon, the Method of Agreement, is used here as a basis to create the \"Common Cause\" (CC) research design. The CC design is particularly relevant when a set of multiple circumstances can be represented by alternative theories of change or competing explanations. We consider several potential applications of the design and elaborate its structure within the validity framework of Shadish, Cook, and Campbell. We discuss threats to validity controlled by the CC design (e.g., selection bias, the bane of applied researchers, is not relevant) and illustrate possible analytic strategies using simulated data. We explicitly compare the CC design to four quasi-experimental designs in terms of the validity threats that they eliminate. Design weaknesses are addressed and ways to enhance the design's inferential power discussed. The CC design itself represents a proof of concept suggesting that other research designs can be created from philosophical principles.","PeriodicalId":90602,"journal":{"name":"Journal of methods and measurement in the social sciences","volume":"7 1","pages":"122-143"},"PeriodicalIF":0.0,"publicationDate":"2017-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44302798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}