{"title":"Inter-annotator Agreement Using the Conversation Analysis Modelling Schema, for Dialogue","authors":"Nathan Duran, Steve Battle, Jim E. Smith","doi":"10.1080/19312458.2021.2020229","DOIUrl":"https://doi.org/10.1080/19312458.2021.2020229","url":null,"abstract":"ABSTRACT We present the Conversation Analysis Modeling Schema (CAMS), a novel dialogue labeling schema that combines the Conversation Analysis concept of Adjacency Pairs, with Dialogue Acts. The aim is to capture both the semantic and syntactic structure of dialogue, in a format that is independent of the domain or topic, and which facilitates the computational modeling of dialogue. A labeling task undertaken by novice annotators is used to evaluate its efficacy on a selection of task-oriented and non-task-oriented dialogs, and to measure inter-annotator agreement. To deepen the “human-factors” analysis we also record and examine users’ self-reported confidence scores and average utterance annotation times. Inter-annotator agreement is shown to be higher for task-oriented dialogs than non-task-oriented, though the structure of the dialogue itself has a more significant impact. We further examine the assumptions around expected agreement for two weighted agreement coefficients, Alpha and Beta, and show that annotators assign labels using similar probability distributions, small variations can result in large differences in agreement values between biased and unbiased measures.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"16 1","pages":"182 - 214"},"PeriodicalIF":11.4,"publicationDate":"2022-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41485430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lauren Jodi Van Scoy, Allison M Scott, Michael J Green, Pamela D Witt, Emily Wasserman, Vernon M Chinchilli, Benjamin H Levi
{"title":"Communication Quality Analysis: A user-friendly observational measure of patient-clinician communication.","authors":"Lauren Jodi Van Scoy, Allison M Scott, Michael J Green, Pamela D Witt, Emily Wasserman, Vernon M Chinchilli, Benjamin H Levi","doi":"10.1080/19312458.2022.2099819","DOIUrl":"https://doi.org/10.1080/19312458.2022.2099819","url":null,"abstract":"<p><p>Communication Quality Analysis (CQA) is a rigorous transcript-based coding method for assessing clinical communication quality. We compared the resource-intensive transcript-based version with a streamlined real-time version of the method with respect to feasibility, validity, reliability, and association with traditional measures of communication quality. Simulated conversations between 108 trainees and 12 standardized patients were assessed by 7 coders using the two versions of CQA (transcript and real-time). Participants also completed two traditional communication quality assessment measures. Real-time CQA was feasible and yielded fair to excellent reliability, with some caveats that can be addressed in future work. CQA ratings were moderately correlated with traditional measures of communication quality, suggesting that CQA captures different aspects of communication quality than do traditional measures. Finally, CQA did not exhibit the ceiling effects observed in the traditional measures of communication quality. We conclude that real-time CQA is a user-friendly method for assessing communication quality that has the potential for broad application in training, research, and intervention contexts and may offer improvements to traditional, self-rated communication measures.</p>","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"16 3","pages":"215-235"},"PeriodicalIF":11.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10104441/pdf/nihms-1862196.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9778484","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
C. Baden, Christian Pipal, Martijn Schoonvelde, M. A. van der Velden
{"title":"Three Gaps in Computational Text Analysis Methods for Social Sciences: A Research Agenda","authors":"C. Baden, Christian Pipal, Martijn Schoonvelde, M. A. van der Velden","doi":"10.1080/19312458.2021.2015574","DOIUrl":"https://doi.org/10.1080/19312458.2021.2015574","url":null,"abstract":"ABSTRACT We identify three gaps that limit the utility and obstruct the progress of computational text analysis methods (CTAM) for social science research. First, we contend that CTAM development has prioritized technological over validity concerns, giving limited attention to the operationalization of social scientific measurements. Second, we identify a mismatch between CTAMs’ focus on extracting specific contents and document-level patterns, and social science researchers’ need for measuring multiple, often complex contents in the text. Third, we argue that the dominance of English language tools depresses comparative research and inclusivity toward scholarly communities examining languages other than English. We substantiate our claims by drawing upon a broad review of methodological work in the computational social sciences, as well as an inventory of leading research publications using quantitative textual analysis. Subsequently, we discuss implications of these three gaps for social scientists’ uneven uptake of CTAM, as well as the field of computational social science text research as a whole. Finally, we propose a research agenda intended to bridge the identified gaps and improve the validity, utility, and inclusiveness of CTAM.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"16 1","pages":"1 - 18"},"PeriodicalIF":11.4,"publicationDate":"2021-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"60018407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Entrevistas en profundidad a docentes sobre el uso de contenido audiovisual infantil en las aulas","authors":"","doi":"10.35951/v3i2.126","DOIUrl":"https://doi.org/10.35951/v3i2.126","url":null,"abstract":"El presente estudio analiza las distintas aplicaciones de la entrevista en profundidad, también denominada entrevista cualitativa, como técnica principal de investigación en temas relacionados con el área de la comunicación. En concreto, se analiza el uso de la entrevista en profundidad para la creación de contenido audiovisual educativo orientado a ser visionado en las escuelas. Para ello, se aplica una metodología de carácter cualitativo con el objetivo de llevar a cabo ocho entrevistas en profundidad a profesores de tres ciudades de España (Barcelona, Madrid y Córdoba), de educación infantil, primaria y secundaria y pertenecientes a distintos tipos de escuelas (privada, concertada y pública).","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"38 1","pages":""},"PeriodicalIF":11.4,"publicationDate":"2021-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90872717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Barranquero Carretero, A., y Sáez Baeza, C. (Eds.) (2021): “La comunicación desde abajo. Historia, sentidos y prácticas de la comunicación alternativa en España”. Barcelona, Gedisa","authors":"","doi":"10.35951/v3i2.141","DOIUrl":"https://doi.org/10.35951/v3i2.141","url":null,"abstract":"Los ensayos publicados sobre comunicación social y tercer sector estaban centrados en su mayoría en las técnicas y estrategias de comunicación de las entidades sociales y las organizaciones no gubernamentales. Gran parte de la literatura relacionada a este tema son manuales y libros profesionales de técnicas de comunicación. Pocos abordan el fenómeno de la comunicación de los medios comunitarios con una perspectiva histórica de su desarrollo en España y sus inspiraciones en las diferentes formas de comunicar en medios comunitarios de otros modelos, como los europeos, estadounidenses y latinoamericanos que sirvieron de referencia. A través de una recopilación de 7 artículos se hilan los inicios con las radios, periódicos y televisiones comunitarias y su extensión a la revolución surgida de la web 2.0.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"2 1","pages":""},"PeriodicalIF":11.4,"publicationDate":"2021-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81756115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Eguizabal Maza, R., y Jiménez Gómez, I. (Eds.) (2021): “Herramientas metodológicas para el estudio de la comunicación”. Madrid, Fragua","authors":"","doi":"10.35951/v3i2.139","DOIUrl":"https://doi.org/10.35951/v3i2.139","url":null,"abstract":"La aplicación de las nuevas tecnologías para facilitar tanto la comunicación entre investigadores como para la realización de entrevistas o encuestas, centra parte de las comunicaciones incluídas en este libro, dejando patente la existencia todavía de una brecha tecnológica entre el desarrollo tecnológico actual y el uso de esta por parte de la academia, ya sea por el desconocimiento de todas las opciones o posibilidades que determinados programas pueden aportar al estudio de las ciencias de la comunicación, por las reticencias de determinados investigadores o por la necesidad de verificar que dichos programas cumplen los requisitos académicos necesarios para su utilización en investigación.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"106 1","pages":""},"PeriodicalIF":11.4,"publicationDate":"2021-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77889486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Methods to investigate communication","authors":"","doi":"10.35951/v3i2","DOIUrl":"https://doi.org/10.35951/v3i2","url":null,"abstract":"","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"118 1","pages":""},"PeriodicalIF":11.4,"publicationDate":"2021-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74172998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Metodología bifásica para el estudio de la estética de un autor cinematográfico","authors":"","doi":"10.35951/v3i2.129","DOIUrl":"https://doi.org/10.35951/v3i2.129","url":null,"abstract":"El estudio sistemático del texto cinematográfico se puede llevar a cabo según diversos enfoques analíticos. No se ha definido hasta ahora, sin embargo, metodología alguna para el estudio de la estética del corpus completo un autor cinematográfico. Se propone aquí un método en dos fases bien definidas, de carácter eminentemente inductivo, y deudor tanto del método científico como de la crítica cinematográfica. La primera fase consiste en el análisis de estilo, secuencia por secuencia, de un film representativo de la filmografía del autor. La segunda comprende la verificación de los elementos recurrentes hallados en la primera fase en el resto de la filmografía; dichos elementos son agrupados en torno a categorías más amplias -correspondientes a diversas metodologías de análisis- a fin de determinar las constantes de la estética del autor. La aplicación del método propuesto a la filmografía de Wes Anderson permite exponer sus particularidades y demostrar su validez.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"4 1","pages":""},"PeriodicalIF":11.4,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74901524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Casos exploratorios aplicados a partir de distintos diseños metodológicos: eye-tracking fijo y online","authors":"","doi":"10.35951/v3i2.136","DOIUrl":"https://doi.org/10.35951/v3i2.136","url":null,"abstract":"Las herramientas de neurocomunicación permiten registrar y analizar las respuestas implícitas o no conscientes de los individuos mientras visualizan una creatividad, un video, web o un texto. Técnicas como el eye-tracking permiten estudiar la atención, el engagement, la atracción y procesos cognitivos de forma cuantitativa y rigurosa. Los objetivos son: 1) analizar las características de diferentes herramientas para el estudio de eye-tracking, 2) estudiar las diferencias entre el eye-tracker fijo y online, 3) definir la funcionalidad de las diferentes herramientas en función del tipo de investigación deseada y 4) estudiar distintos diseños metodológicos de neurocomunicación con diferentes tipos de eye-tracking. Para ello se realiza un análisis descriptivo en profundad de varios tipos de tracker (fijo y online), características y medidas biométricas. Se analizan tres casos exploratorios aplicados a partir de distintos diseños metodológicos que permita definir la funcionalidad de estas herramientas en el campo de la investigación de la comunicación.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"41 1","pages":""},"PeriodicalIF":11.4,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88550949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Análisis y validación de la respuesta emocional en grupos focales con el sistema NeuroLynQ","authors":"","doi":"10.35951/v3i2.127","DOIUrl":"https://doi.org/10.35951/v3i2.127","url":null,"abstract":"El avance tecnológico ha favorecido la aparición de equipos accesibles que permiten aplicar técnicas de neurociencia al campo de la comunicación. De este modo se pueden analizar las llamadas respuestas implícitas, respuestas que los sujetos emiten de forma automática sin ser conscientes de ello. Este trabajo tiene como objetivo validar, mediante dos casos prácticos de grupos focales, si los resultados del sistema NeuroLynQ siguen una lógica que permita utilizarlo como una nueva forma de metodología para sacar conclusiones de las respuestas emocionales de los participantes en un grupo focal. En la metodología se describe el fundamento y uso de esta técnica, presentando a continuación los resultados de la respuesta emocional registrada de los participantes de los grupos focales obtenidos en diferentes ventanas temporales durante la exposición de un tema, y se finaliza discutiendo su aplicación en el análisis de resultados en grupo focales.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"8 1","pages":""},"PeriodicalIF":11.4,"publicationDate":"2021-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87539271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}