Frontiers in Communication最新文献_第9页

Automatic speech recognition and the transcription of indistinct forensic audio: how do the new generation of systems fare? 自动语音识别和模糊法证音频的转录：新一代系统表现如何？

IF 2.4

Frontiers in Communication Pub Date : 2024-02-14 DOI: 10.3389/fcomm.2024.1281407

Debbie Loakes

{"title":"Automatic speech recognition and the transcription of indistinct forensic audio: how do the new generation of systems fare?","authors":"Debbie Loakes","doi":"10.3389/fcomm.2024.1281407","DOIUrl":"https://doi.org/10.3389/fcomm.2024.1281407","url":null,"abstract":"This study provides an update on an earlier study in the “Capturing Talk” research topic, which aimed to demonstrate how automatic speech recognition (ASR) systems work with indistinct forensic-like audio, in comparison with good-quality audio. Since that time, there has been rapid technological advancement, with newer systems having access to extremely large language models and having their performance proclaimed as being human-like in accuracy. This study compares various ASR systems, including OpenAI’s Whisper, to continue to test how well automatic speaker recognition works with forensic-like audio. The results show that the transcription of a good-quality audio file is at ceiling for some systems, with no errors. For the poor-quality (forensic-like) audio, Whisper was the best performing system but had only 50% of the entire speech material correct. The results for the poor-quality audio were also generally variable across the systems, with differences depending on whether a .wav or .mp3 file was used and differences between earlier and later versions of the same system. Additionally, and against expectations, Whisper showed a drop in performance over a 2-month period. While more material was transcribed in the later attempt, more was also incorrect. This study concludes that forensic-like audio is not suitable for automatic analysis.","PeriodicalId":31739,"journal":{"name":"Frontiers in Communication","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139837623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Rethinking multimodal corpora from the perspective of Peircean semiotics 从皮尔斯符号学的角度反思多模态语料库

IF 2.4

Frontiers in Communication Pub Date : 2024-02-12 DOI: 10.3389/fcomm.2024.1337434

Tuomo Hiippala

{"title":"Rethinking multimodal corpora from the perspective of Peircean semiotics","authors":"Tuomo Hiippala","doi":"10.3389/fcomm.2024.1337434","DOIUrl":"https://doi.org/10.3389/fcomm.2024.1337434","url":null,"abstract":"This article discusses annotating and querying multimodal corpora from the perspective of Peircean semiotics. Corpora have had a significant impact on empirical research in the field of linguistics and are increasingly considered essential for multimodality research as well. I argue that Peircean semiotics can be used to gain a deeper understanding of multimodal corpora and rethink the way we work with them. I demonstrate the proposed approach in an empirical study, which uses Peircean semiotics to guide the process of querying multimodal corpora using computer vision and vector-based information retrieval. The results show that computer vision algorithms are restricted to particular domains of experience, which may be circumscribed using Peirce's theory of semiotics. However, the applicability of such algorithms may be extended using annotations, which capture aspects of meaning-making that remain beyond algorithms. Overall, the results suggest that the process of building and analysing multimodal corpora should be actively theorized in order to identify new ways of working with the information stored in them, particularly in terms of dividing the annotation tasks between humans and algorithms.","PeriodicalId":31739,"journal":{"name":"Frontiers in Communication","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139784495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Rethinking multimodal corpora from the perspective of Peircean semiotics 从皮尔斯符号学的角度反思多模态语料库

IF 2.4

Frontiers in Communication Pub Date : 2024-02-12 DOI: 10.3389/fcomm.2024.1337434

Tuomo Hiippala

{"title":"Rethinking multimodal corpora from the perspective of Peircean semiotics","authors":"Tuomo Hiippala","doi":"10.3389/fcomm.2024.1337434","DOIUrl":"https://doi.org/10.3389/fcomm.2024.1337434","url":null,"abstract":"This article discusses annotating and querying multimodal corpora from the perspective of Peircean semiotics. Corpora have had a significant impact on empirical research in the field of linguistics and are increasingly considered essential for multimodality research as well. I argue that Peircean semiotics can be used to gain a deeper understanding of multimodal corpora and rethink the way we work with them. I demonstrate the proposed approach in an empirical study, which uses Peircean semiotics to guide the process of querying multimodal corpora using computer vision and vector-based information retrieval. The results show that computer vision algorithms are restricted to particular domains of experience, which may be circumscribed using Peirce's theory of semiotics. However, the applicability of such algorithms may be extended using annotations, which capture aspects of meaning-making that remain beyond algorithms. Overall, the results suggest that the process of building and analysing multimodal corpora should be actively theorized in order to identify new ways of working with the information stored in them, particularly in terms of dividing the annotation tasks between humans and algorithms.","PeriodicalId":31739,"journal":{"name":"Frontiers in Communication","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139844271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Making sense of radiomics: insights on human–AI collaboration in medical interaction from an observational user study 理解放射组学：从用户观察研究中洞察医疗互动中的人机协作

IF 2.4

Frontiers in Communication Pub Date : 2024-02-12 DOI: 10.3389/fcomm.2023.1234987

Jakub Mlynář, Adrien Depeursinge, John O. Prior, Roger Schaer, Alexandre Martroye de Joly, Florian Evéquoz

{"title":"Making sense of radiomics: insights on human–AI collaboration in medical interaction from an observational user study","authors":"Jakub Mlynář, Adrien Depeursinge, John O. Prior, Roger Schaer, Alexandre Martroye de Joly, Florian Evéquoz","doi":"10.3389/fcomm.2023.1234987","DOIUrl":"https://doi.org/10.3389/fcomm.2023.1234987","url":null,"abstract":"Technologies based on “artificial intelligence” (AI) are transforming every part of our society, including healthcare and medical institutions. An example of this trend is the novel field in oncology and radiology called radiomics, which is the extracting and mining of large-scale quantitative features from medical imaging by machine-learning (ML) algorithms. This paper explores situated work with a radiomics software platform, QuantImage (v2), and interaction around it, in educationally framed hands-on trial sessions where pairs of novice users (physicians and medical radiology technicians) work on a radiomics task consisting of developing a predictive ML model with a co-present tutor. Informed by ethnomethodology and conversation analysis (EM/CA), the results show that learning about radiomics more generally and learning how to use this platform specifically are deeply intertwined. Common-sense knowledge (e.g., about meanings of colors) can interfere with the visual representation standards established in the professional domain. Participants' skills in using the platform and knowledge of radiomics are routinely displayed in the assessment of performance measures of the resulting ML models, in the monitoring of the platform's pace of operation for possible problems, and in the ascribing of independent actions (e.g., related to algorithms) to the platform. The findings are relevant to current discussions about the explainability of AI in medicine as well as issues of machinic agency.","PeriodicalId":31739,"journal":{"name":"Frontiers in Communication","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139844504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Making sense of radiomics: insights on human–AI collaboration in medical interaction from an observational user study 理解放射组学：从用户观察研究中洞察医疗互动中的人机协作

IF 2.4

Frontiers in Communication Pub Date : 2024-02-12 DOI: 10.3389/fcomm.2023.1234987

Jakub Mlynář, Adrien Depeursinge, John O. Prior, Roger Schaer, Alexandre Martroye de Joly, Florian Evéquoz

{"title":"Making sense of radiomics: insights on human–AI collaboration in medical interaction from an observational user study","authors":"Jakub Mlynář, Adrien Depeursinge, John O. Prior, Roger Schaer, Alexandre Martroye de Joly, Florian Evéquoz","doi":"10.3389/fcomm.2023.1234987","DOIUrl":"https://doi.org/10.3389/fcomm.2023.1234987","url":null,"abstract":"Technologies based on “artificial intelligence” (AI) are transforming every part of our society, including healthcare and medical institutions. An example of this trend is the novel field in oncology and radiology called radiomics, which is the extracting and mining of large-scale quantitative features from medical imaging by machine-learning (ML) algorithms. This paper explores situated work with a radiomics software platform, QuantImage (v2), and interaction around it, in educationally framed hands-on trial sessions where pairs of novice users (physicians and medical radiology technicians) work on a radiomics task consisting of developing a predictive ML model with a co-present tutor. Informed by ethnomethodology and conversation analysis (EM/CA), the results show that learning about radiomics more generally and learning how to use this platform specifically are deeply intertwined. Common-sense knowledge (e.g., about meanings of colors) can interfere with the visual representation standards established in the professional domain. Participants' skills in using the platform and knowledge of radiomics are routinely displayed in the assessment of performance measures of the resulting ML models, in the monitoring of the platform's pace of operation for possible problems, and in the ascribing of independent actions (e.g., related to algorithms) to the platform. The findings are relevant to current discussions about the explainability of AI in medicine as well as issues of machinic agency.","PeriodicalId":31739,"journal":{"name":"Frontiers in Communication","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139784902","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

The whole is larger than the sum of its parts: additive effects of SMS nudge bundles 整体大于部分之和：短信提示捆绑的叠加效应

IF 2.4

Frontiers in Communication Pub Date : 2024-02-08 DOI: 10.3389/fcomm.2024.1298607

Sergio Barbosa, Juan Pablo Bermúdez

{"title":"The whole is larger than the sum of its parts: additive effects of SMS nudge bundles","authors":"Sergio Barbosa, Juan Pablo Bermúdez","doi":"10.3389/fcomm.2024.1298607","DOIUrl":"https://doi.org/10.3389/fcomm.2024.1298607","url":null,"abstract":"Public access to housing is a challenge for a large number of societies and follows a great number of limitations. Here, we test several SMS-interventions aiming at motivating people to get information on affordable loans for housing options actually available to them. We randomly assigned 6,247 people to receive an SMS inviting them to get information about government backed housing loans for which they were already eligible. SMSs followed one of 14 possible nudges including “simple” nudges (e.g., messages personalized with the recipient's name or mentioning a social norm) and “bundled” nudges (combining personalization with another simple nudge). We observed SMS response rates (i.e., responding to sign up for receiving more information) according to which nudge was assigned. No other independent variable was considered. While most nudges were more effective than a control SMS, we observed significant variation across nudges on their ability to elicit responses from users. Combinations of multiple nudges were more successful in behavior elicitation than simple nudges. We discuss the possible implications of “single” or “bundled” SMS on response rates and as an effective tool of behavior change.","PeriodicalId":31739,"journal":{"name":"Frontiers in Communication","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139791016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exemplification in news narratives: stigmatizing and securitizing effects 新闻叙事中的示范：污名化和安全化效应

IF 2.4

Frontiers in Communication Pub Date : 2024-02-08 DOI: 10.3389/fcomm.2024.1316677

Deborah D. Sellnow-Richmond, Marta Natalia Lukacovic, Scott Sellnow-Richmond

引用次数: 0

Exemplification in news narratives: stigmatizing and securitizing effects 新闻叙事中的示范：污名化和安全化效应

IF 2.4

Frontiers in Communication Pub Date : 2024-02-08 DOI: 10.3389/fcomm.2024.1316677

Deborah D. Sellnow-Richmond, Marta Natalia Lukacovic, Scott Sellnow-Richmond

引用次数: 0

The whole is larger than the sum of its parts: additive effects of SMS nudge bundles 整体大于部分之和：短信提示捆绑的叠加效应

IF 2.4

Frontiers in Communication Pub Date : 2024-02-08 DOI: 10.3389/fcomm.2024.1298607

Sergio Barbosa, Juan Pablo Bermúdez

{"title":"The whole is larger than the sum of its parts: additive effects of SMS nudge bundles","authors":"Sergio Barbosa, Juan Pablo Bermúdez","doi":"10.3389/fcomm.2024.1298607","DOIUrl":"https://doi.org/10.3389/fcomm.2024.1298607","url":null,"abstract":"Public access to housing is a challenge for a large number of societies and follows a great number of limitations. Here, we test several SMS-interventions aiming at motivating people to get information on affordable loans for housing options actually available to them. We randomly assigned 6,247 people to receive an SMS inviting them to get information about government backed housing loans for which they were already eligible. SMSs followed one of 14 possible nudges including “simple” nudges (e.g., messages personalized with the recipient's name or mentioning a social norm) and “bundled” nudges (combining personalization with another simple nudge). We observed SMS response rates (i.e., responding to sign up for receiving more information) according to which nudge was assigned. No other independent variable was considered. While most nudges were more effective than a control SMS, we observed significant variation across nudges on their ability to elicit responses from users. Combinations of multiple nudges were more successful in behavior elicitation than simple nudges. We discuss the possible implications of “single” or “bundled” SMS on response rates and as an effective tool of behavior change.","PeriodicalId":31739,"journal":{"name":"Frontiers in Communication","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139850719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Challenges and opportunities of Facebook during bereavement: experiences from Taung in South Africa 丧亲期间 Facebook 的挑战与机遇：南非 Taung 的经验

IF 2.4

Frontiers in Communication Pub Date : 2024-02-02 DOI: 10.3389/fcomm.2024.1292961

Kealeboga Aiseng

引用次数: 0