Chris Dunn, Doyanne Darnell, Sheng Kung Michael Yi, Mark Steyvers, Kristin Bumgardner, Sarah Peregrine Lord, Zac Imel, David C Atkins
{"title":"Should we trust our judgments about the proficiency of Motivational Interviewing counselors? A glimpse at the impact of low inter-rater reliability.","authors":"Chris Dunn, Doyanne Darnell, Sheng Kung Michael Yi, Mark Steyvers, Kristin Bumgardner, Sarah Peregrine Lord, Zac Imel, David C Atkins","doi":"10.5195/mitrip.2014.43","DOIUrl":"https://doi.org/10.5195/mitrip.2014.43","url":null,"abstract":"<p><p>Standardized rating systems are often used to evaluate the proficiency of Motivational Interviewing (MI) counselors. The published inter-rater reliability (degree of coder agreement) in many studies using these instruments has varied a great deal; some studies report MI proficiency scores that have only fair inter-rater reliability, and others report scores with excellent reliability. How much can we to trust the scores with fair versus excellent reliability? Using a Monte Carlo statistical simulation, we compared the impact of fair (0.50) versus excellent (0.90) reliability on the error rates of falsely judging a given counselor as MI proficient or not proficient. We found that improving the inter-rater reliability of any given score from 0.5 to 0.9 would cause a marked reduction in proficiency judgment errors, a reduction that in some MI evaluation situations would be critical. We discuss some practical tradeoffs inherent in various MI evaluation situations, and offer suggestions for applying findings from formal MI research to problems faced by real-world MI evaluators, to help them minimize the MI proficiency judgment errors bearing the greatest cost.</p>","PeriodicalId":89699,"journal":{"name":"Motivational interviewing : training, research, implementation, practice","volume":"1 3","pages":"38-41"},"PeriodicalIF":0.0,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5008854/pdf/nihms812516.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"34363345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julie A Schumacher, Scott F Coffey, Kimberly S Walitzer, Randy S Burke, Daniel C Williams, Grayson Norquist, T David Elkin
{"title":"Guidance for New Motivational Interviewing Trainers When Training Addiction Professionals: Findings from a Survey of Experienced Trainers.","authors":"Julie A Schumacher, Scott F Coffey, Kimberly S Walitzer, Randy S Burke, Daniel C Williams, Grayson Norquist, T David Elkin","doi":"10.5195/mitrip.2012.7","DOIUrl":"https://doi.org/10.5195/mitrip.2012.7","url":null,"abstract":"<p><p>Evidence-based practices, such as motivational interviewing (MI), are not widely used in community alcohol and drug treatment settings. Successfully broadening the dissemination of MI will require numerous trainers and supervisors who are equipped to manage common barriers to technology transfer. The aims of the our survey of 36 MI trainers were: 1) to gather opinions about the optimal format, duration, and content for beginning level addiction-focused MI training conducted by novice trainers and 2) to identify the challenges most likely to be encountered during provision of beginning-level MI training and supervision, as well as the most highly recommended strategies for managing those challenges in addiction treatment sites. It is hoped that the findings of this survey will help beginning trainers equip themselves for successful training experiences.</p>","PeriodicalId":89699,"journal":{"name":"Motivational interviewing : training, research, implementation, practice","volume":"1 1","pages":"7-15"},"PeriodicalIF":0.0,"publicationDate":"2012-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3685496/pdf/nihms309396.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"31523899","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Research on MI in Equipoise: The Case of Living Organ Donation.","authors":"Allan Zuckoff, Mary Amanda Dew","doi":"10.5195/mitrip.2012.12","DOIUrl":"https://doi.org/10.5195/mitrip.2012.12","url":null,"abstract":"<p><p>Residual ambivalence prior to live organ donation has been shown to predict worse physical and psychological outcomes for the donor following surgery. We are studying whether MI can help individuals who have agreed to become living organ donors to resolve residual ambivalence about their decision. In this situation, ethical practice demands that the counselor take up a stance of equipoise, equally welcoming of strengthened resolve to donate or a decision not to do so. This paper describes our adaptations of MI for this unique application.</p>","PeriodicalId":89699,"journal":{"name":"Motivational interviewing : training, research, implementation, practice","volume":"1 1","pages":"39-41"},"PeriodicalIF":0.0,"publicationDate":"2012-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3479674/pdf/nihms384566.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"31008730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}