Jonathon Love, Quentin F Gronau, Gemma Palmer, Ami Eidels, Scott D Brown
{"title":"In human-machine trust, humans rely on a simple averaging strategy.","authors":"Jonathon Love, Quentin F Gronau, Gemma Palmer, Ami Eidels, Scott D Brown","doi":"10.1186/s41235-024-00583-5","DOIUrl":"10.1186/s41235-024-00583-5","url":null,"abstract":"<p><p>With the growing role of artificial intelligence (AI) in our lives, attention is increasingly turning to the way that humans and AI work together. A key aspect of human-AI collaboration is how people integrate judgements or recommendations from machine agents, when they differ from their own judgements. We investigated trust in human-machine teaming using a perceptual judgement task based on the judge-advisor system. Participants ( <math><mrow><mi>n</mi> <mo>=</mo> <mn>89</mn></mrow> </math> ) estimated a perceptual quantity, then received a recommendation from a machine agent. The participants then made a second response which combined their first estimate and the machine's recommendation. The degree to which participants shifted their second response in the direction of the recommendations provided a measure of their trust in the machine agent. We analysed the role of advice distance in people's willingness to change their judgements. When a recommendation falls a long way from their initial judgement, do people come to doubt their own judgement, trusting the recommendation more, or do they doubt the machine agent, trusting the recommendation less? We found that although some participants exhibited these behaviours, the most common response was neither of these tendencies, and a simple model based on averaging accounted best for participants' trust behaviour. We discuss implications for theories of trust, and human-machine teaming.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"58"},"PeriodicalIF":3.4,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11366733/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142113259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Laura E Matzen, Zoe N Gastelum, Breannan C Howell, Kristin M Divis, Mallory C Stites
{"title":"Effects of machine learning errors on human decision-making: manipulations of model accuracy, error types, and error importance.","authors":"Laura E Matzen, Zoe N Gastelum, Breannan C Howell, Kristin M Divis, Mallory C Stites","doi":"10.1186/s41235-024-00586-2","DOIUrl":"10.1186/s41235-024-00586-2","url":null,"abstract":"<p><p>This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and L-shaped distractors. They were tasked with categorizing each image as target present or target absent. In Experiment 1, they performed this task without the aid of ML outputs. In Experiments 2-5, they were shown images with bounding boxes, representing the output of an ML model. The outputs could be correct (hits and correct rejections), or they could be erroneous (false alarms and misses). Experiment 2 manipulated the overall accuracy of these mock ML outputs. Experiment 3 manipulated the proportion of different types of errors. Experiments 4 and 5 manipulated the importance of specific types of stimuli or model errors, as well as the framing of the task in terms of human or model performance. These experiments showed that model misses were consistently harder for participants to detect than model false alarms. In general, as the model's performance increased, human performance increased as well, but in many cases the participants were more likely to overlook model errors when the model had high accuracy overall. Warning participants to be on the lookout for specific types of model errors had very little impact on their performance. Overall, our results emphasize the importance of considering human cognition when determining what level of model performance and types of model errors are acceptable for a given task.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"56"},"PeriodicalIF":3.4,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345344/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142056909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emily N Line, Sara Jaramillo, Micah Goldwater, Zachary Horne
{"title":"Anecdotes impact medical decisions even when presented with statistical information or decision aids.","authors":"Emily N Line, Sara Jaramillo, Micah Goldwater, Zachary Horne","doi":"10.1186/s41235-024-00577-3","DOIUrl":"10.1186/s41235-024-00577-3","url":null,"abstract":"<p><p>People are inundated with popular press reports about medical research concerning what is healthy, get advice from doctors, and hear personal anecdotes. How do people integrate conflicting anecdotal and statistical information when making medical decisions? In four experiments (N = 4126), we tested how people use conflicting information to judge the efficacy of artificial and real medical treatments. Participants read an anecdote from someone in a clinical trial, or who had undergone a medical treatment previously, for whom the medical treatment was ineffective. We found that reading anecdotes for either artificial or real medical treatments shifted participants' beliefs about the efficacy of a medical treatment. We observed this result even when the anecdote was uninformative, was paired with an icon array, or when participants were provided with thorough medical decision aids about reproductive health procedures. Our findings highlight the pervasive effect of anecdotes on medical decision making.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"51"},"PeriodicalIF":3.4,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345347/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142056889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Paige L Kemp, Vanessa M Loaiza, Colleen M Kelley, Christopher N Wahlheim
{"title":"Correcting fake news headlines after repeated exposure: memory and belief accuracy in younger and older adults.","authors":"Paige L Kemp, Vanessa M Loaiza, Colleen M Kelley, Christopher N Wahlheim","doi":"10.1186/s41235-024-00585-3","DOIUrl":"10.1186/s41235-024-00585-3","url":null,"abstract":"<p><p>The efficacy of fake news corrections in improving memory and belief accuracy may depend on how often adults see false information before it is corrected. Two experiments tested the competing predictions that repeating fake news before corrections will either impair or improve memory and belief accuracy. These experiments also examined whether fake news exposure effects would differ for younger and older adults due to age-related differences in the recollection of contextual details. Younger and older adults read real and fake news headlines that appeared once or thrice. Next, they identified fake news corrections among real news headlines. Later, recognition and cued recall tests assessed memory for real news, fake news, if corrections occurred, and beliefs in retrieved details. Repeating fake news increased detection and remembering of corrections, correct real news retrieval, and erroneous fake news retrieval. No age differences emerged for detection of corrections, but younger adults remembered corrections better than older adults. At test, correct fake news retrieval for earlier-detected corrections was associated with better real news retrieval. This benefit did not differ between age groups in recognition but was greater for younger than older adults in cued recall. When detected corrections were not remembered at test, repeated fake news increased memory errors. Overall, both age groups believed correctly retrieved real news more than erroneously retrieved fake news to a similar degree. These findings suggest that fake news repetition effects on subsequent memory accuracy depended on age differences in recollection-based retrieval of fake news and that it was corrected.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"55"},"PeriodicalIF":3.4,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345346/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142056890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Prerika R Sharma, Emily R Spearing, Kimberley A Wade, Laura Jobson
{"title":"Distress reactions and susceptibility to misinformation for an analogue trauma event.","authors":"Prerika R Sharma, Emily R Spearing, Kimberley A Wade, Laura Jobson","doi":"10.1186/s41235-024-00582-6","DOIUrl":"10.1186/s41235-024-00582-6","url":null,"abstract":"<p><p>Accuracy of memory is critical in legal and clinical contexts. These contexts are often linked with high levels of emotional distress and social sources that can provide potentially distorting information about stressful events. This study investigated how distress was associated with susceptibility to misinformation about a trauma analogue event. We employed an experimental design whereby in Phase 1, participants (N = 243, aged 20-72, 122 females, 117 males, 4 gender diverse) watched a trauma film (car crash) and heard an audio summary that contained misinformation (misled items), true reminders (consistent items), and no reminders (control items) about the film. Participants rated their total distress, and symptoms of avoidance, intrusions, and hyperarousal, in response to the film. They then completed cued recall, recognition, and source memory tasks. One week later in Phase 2, participants (N = 199) completed the same measures again. Generalised linear mixed models were used. A significant misinformation effect was found, and importantly, participants with higher distress levels showed a smaller misinformation effect, owing to especially poor memory for consistent items compared to their less distressed counterparts. Distress was also associated with improved source memory for misled items. Avoidance of the film's reminders was associated with a smaller misinformation effect during immediate retrieval and a larger misinformation effect during delayed retrieval. Findings suggest that distress is associated with decreased susceptibility to misinformation in some cases, but also associated with poorer memory accuracy in general. Limitations are discussed, and the need for further research is highlighted.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"53"},"PeriodicalIF":3.4,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345351/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142056907","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ullrich K H Ecker, Toby Prike, Antonia B Paver, Rosie J Scott, Briony Swire-Thompson
{"title":"Don't believe them! Reducing misinformation influence through source discreditation.","authors":"Ullrich K H Ecker, Toby Prike, Antonia B Paver, Rosie J Scott, Briony Swire-Thompson","doi":"10.1186/s41235-024-00581-7","DOIUrl":"10.1186/s41235-024-00581-7","url":null,"abstract":"<p><p>Misinformation often continues to influence people's reasoning even after it has been corrected. Therefore, an important aim of applied cognition research is to identify effective measures to counter misinformation. One frequently recommended but hitherto insufficiently tested strategy is source discreditation, that is, attacking the credibility of a misinformation source. In two experiments, we tested whether immediate source discreditation could reduce people's subsequent reliance on fictional event-related misinformation. In Experiment 1, the discreditation targeted a person source of misinformation, pointing to a conflict of interest. This intervention was compared with a commonly employed message-focused correction and a combination of correction and discreditation. The discreditation alone was effective, but less effective than a correction, with the combination of both most effective. Experiment 2 compared discreditations that targeted a person versus a media source of misinformation, pointing either to a conflict of interest or a poor track record of communication. Discreditations were effective for both types of sources, although track-record discreditations were less effective when the misinformation source was a media outlet compared to a person. Results demonstrate that continued influence of misinformation is shaped by social as well as cognitive factors and that source discreditation is a broadly applicable misinformation countermeasure.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"52"},"PeriodicalIF":3.4,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345350/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142056908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cue relevance drives early quitting in visual search.","authors":"Jeff Moher, Anna Delos Reyes, Trafton Drew","doi":"10.1186/s41235-024-00587-1","DOIUrl":"10.1186/s41235-024-00587-1","url":null,"abstract":"<p><p>Irrelevant salient distractors can trigger early quitting in visual search, causing observers to miss targets they might otherwise find. Here, we asked whether task-relevant salient cues can produce a similar early quitting effect on the subset of trials where those cues fail to highlight the target. We presented participants with a difficult visual search task and used two cueing conditions. In the high-predictive condition, a salient cue in the form of a red circle highlighted the target most of the time a target was present. In the low-predictive condition, the cue was far less accurate and did not reliably predict the target (i.e., the cue was often a false positive). These were contrasted against a control condition in which no cues were presented. In the high-predictive condition, we found clear evidence of early quitting on trials where the cue was a false positive, as evidenced by both increased miss errors and shorter response times on target absent trials. No such effects were observed with low-predictive cues. Together, these results suggest that salient cues which are false positives can trigger early quitting, though perhaps only when the cues have a high-predictive value. These results have implications for real-world searches, such as medical image screening, where salient cues (referred to as computer-aided detection or CAD) may be used to highlight potentially relevant areas of images but are sometimes inaccurate.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"54"},"PeriodicalIF":3.4,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345343/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142056906","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Caitlin Dawson, Hanna Julku, Milla Pihlajamäki, Johanna K Kaakinen, Jonathan W Schooler, Jaana Simola
{"title":"Evidence-based scientific thinking and decision-making in everyday life.","authors":"Caitlin Dawson, Hanna Julku, Milla Pihlajamäki, Johanna K Kaakinen, Jonathan W Schooler, Jaana Simola","doi":"10.1186/s41235-024-00578-2","DOIUrl":"10.1186/s41235-024-00578-2","url":null,"abstract":"<p><p>In today's knowledge economy, it is critical to make decisions based on high-quality evidence. Science-related decision-making is thought to rely on a complex interplay of reasoning skills, cognitive styles, attitudes, and motivations toward information. By investigating the relationship between individual differences and behaviors related to evidence-based decision-making, our aim was to better understand how adults engage with scientific information in everyday life. First, we used a data-driven exploratory approach to identify four latent factors in a large set of measures related to cognitive skills and epistemic attitudes. The resulting structure suggests that key factors include curiosity and positive attitudes toward science, prosociality, cognitive skills, and openmindedness to new information. Second, we investigated whether these factors predicted behavior in a naturalistic decision-making task. In the task, participants were introduced to a real science-related petition and were asked to read six online articles related to the petition, which varied in scientific quality, while deciding how to vote. We demonstrate that curiosity and positive science attitudes, cognitive flexibility, prosociality and emotional states, were related to engaging with information and discernment of evidence reliability. We further found that that social authority is a powerful cue for source credibility, even above the actual quality and relevance of the sources. Our results highlight that individual motivating factors toward information engagement, like curiosity, and social factors such as social authority are important drivers of how adults judge the credibility of everyday sources of scientific information.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"50"},"PeriodicalIF":3.4,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11306497/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141898627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Grammatical structures of emoji in Japanese-language text conversations.","authors":"Kazuki Sekine, Manaka Ikuta","doi":"10.1186/s41235-024-00571-9","DOIUrl":"10.1186/s41235-024-00571-9","url":null,"abstract":"<p><p>Emojis have become a ubiquitous part of everyday text communication worldwide. Cohn et al. (Cognit Res Princ Implic 4(1):1-18, 2019) studied the grammatical structure of emoji usage among English speakers and found a correlation between the sequence of emojis used and English word order, tending towards an subject-verb-object (SVO) sequence. However, it remains unclear whether emoji usage follows a universal grammar or whether it is influenced by native language grammar. Therefore, this study explored the potential influence of Japanese grammar on emoji usage by Japanese speakers. Twenty adults, all native Japanese speakers, participated in pairs. In Experiment 1, participants engaged in conversations through Google Hangouts on iPads. The experiment consisted of four conversation rounds of approximately 8 min each. The first two rounds involved one participant using only written Japanese and the other using only emojis and punctuation, with roles reversed in the second round. The third round required both participants to use only emojis and punctuation. The results indicated that participants preferred subject-object-verb (SOV) or object-verb (OV) sequences, with OV patterns being more common. This pattern reflects a distinctive attribute of Japanese grammatical structure, marked by the frequent omission of the subject. Experiment 2 substituted emojis for words, showing nouns were more commonly replaced than verbs due to the difficulty in conveying complex meanings. Reduced subject replacements again emphasised Japanese grammatical structure. In essence, emoji usage reflects native language structures, but complexities are challenging to convey, resulting in simplified sequences. This study offers insights for enhancing emoji-based communication and interface design, with implications for translation and broader communication.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"49"},"PeriodicalIF":3.4,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11286883/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141789458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the linguistic complexity of third-grade numerical literacy.","authors":"Ella Shalit, Dror Dotan","doi":"10.1186/s41235-024-00575-5","DOIUrl":"10.1186/s41235-024-00575-5","url":null,"abstract":"<p><p>Reading numbers aloud, a central aspect of numerical literacy, is a challenging skill to acquire, but the origins of this difficulty remain poorly understood. To investigate this matter, we examined the performance of 127 third- and fourth-grade children who read aloud, in Hebrew, numbers with 2-5 digits. We found several key observations. First, we observed a substantial variation among the 3rd graders-7% and 59% errors in the top and bottom deciles, respectively. Second, the task difficulty stemmed from syntactic processing: Most errors were distortions of the number's syntax, as opposed to digit substitutions or transpositions, and the main factor affecting a specific number's difficulty was not its magnitude, as is commonly assumed, but rather its syntactic structure. Third, number reading performance was not predicted by a school-like task that assessed syntactic-conceptual knowledge of the decimal system structure, but rather by knowledge of specific syntactic-verbal rules, suggesting that the syntactic-verbal knowledge is separate from the syntactic-conceptual knowledge. Last, there was a double dissociation between 4-digit numbers and 5-digit numbers, which in Hebrew have completely different syntactic structures: Half of the children showed a significant advantage in one number length compared to the other, with equal numbers of children preferring either length. This indicates that the different syntactic-verbal rules are learned relatively independently of each other, with little or no generalization from one rule to another. In light of these findings, we propose that schools should specifically teach number reading, with focus on specific syntactic-verbal rules.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"48"},"PeriodicalIF":3.4,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11255179/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141634955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}