Sahra Kim, Alyssa Currao, Emma Brown, William P Milberg, Catherine B Fortier
{"title":"效度检验在精神病评估中的重要性:来自9/11后多重疾病退伍军人样本的证据。","authors":"Sahra Kim, Alyssa Currao, Emma Brown, William P Milberg, Catherine B Fortier","doi":"10.1017/S1355617723000711","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Performance validity (PVTs) and symptom validity tests (SVTs) are necessary components of neuropsychological testing to identify suboptimal performances and response bias that may impact diagnosis and treatment. The current study examined the clinical and functional characteristics of veterans who failed PVTs and the relationship between PVT and SVT failures.</p><p><strong>Method: </strong>Five hundred and sixteen post-9/11 veterans participated in clinical interviews, neuropsychological testing, and several validity measures.</p><p><strong>Results: </strong>Veterans who failed 2+ PVTs performed significantly worse than veterans who failed one PVT in verbal memory (Cohen's <i>d =</i> .60-.69), processing speed (Cohen's <i>d =</i> .68), working memory (Cohen's <i>d</i> = .98), and visual memory (Cohen's <i>d =</i> .88-1.10). Individuals with 2+ PVT failures had greater posttraumatic stress (PTS; <i>β</i> = 0.16; <i>p</i> = .0002), and worse self-reported depression (<i>β</i> = 0.17; <i>p</i> = .0001), anxiety (<i>β</i> = 0.15; <i>p</i> = .0007), sleep (<i>β</i> = 0.10; <i>p</i> = .0233), and functional outcomes (<i>β</i> = 0.15; <i>p</i> = .0009) compared to veterans who passed PVTs. 7.8% veterans failed the SVT (Validity-10; ≥19 cutoff); Multiple PVT failures were significantly associated with Validity-10 failure at the ≥19 and ≥23 cutoffs (<i>p</i>'s < .0012). The Validity-10 had moderate correspondence in predicting 2+ PVTs failures (<i>AUC</i> = 0.83; <i>95% CI</i> = 0.76, 0.91).</p><p><strong>Conclusion: </strong>PVT failures are associated with psychiatric factors, but not traumatic brain injury (TBI). PVT failures predict SVT failure and vice versa. Standard care should include SVTs and PVTs in all clinical assessments, not just neuropsychological assessments, particularly in clinically complex populations.</p>","PeriodicalId":49995,"journal":{"name":"Journal of the International Neuropsychological Society","volume":" ","pages":"410-419"},"PeriodicalIF":2.6000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Importance of validity testing in psychiatric assessment: evidence from a sample of multimorbid post-9/11 veterans.\",\"authors\":\"Sahra Kim, Alyssa Currao, Emma Brown, William P Milberg, Catherine B Fortier\",\"doi\":\"10.1017/S1355617723000711\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>Performance validity (PVTs) and symptom validity tests (SVTs) are necessary components of neuropsychological testing to identify suboptimal performances and response bias that may impact diagnosis and treatment. The current study examined the clinical and functional characteristics of veterans who failed PVTs and the relationship between PVT and SVT failures.</p><p><strong>Method: </strong>Five hundred and sixteen post-9/11 veterans participated in clinical interviews, neuropsychological testing, and several validity measures.</p><p><strong>Results: </strong>Veterans who failed 2+ PVTs performed significantly worse than veterans who failed one PVT in verbal memory (Cohen's <i>d =</i> .60-.69), processing speed (Cohen's <i>d =</i> .68), working memory (Cohen's <i>d</i> = .98), and visual memory (Cohen's <i>d =</i> .88-1.10). Individuals with 2+ PVT failures had greater posttraumatic stress (PTS; <i>β</i> = 0.16; <i>p</i> = .0002), and worse self-reported depression (<i>β</i> = 0.17; <i>p</i> = .0001), anxiety (<i>β</i> = 0.15; <i>p</i> = .0007), sleep (<i>β</i> = 0.10; <i>p</i> = .0233), and functional outcomes (<i>β</i> = 0.15; <i>p</i> = .0009) compared to veterans who passed PVTs. 7.8% veterans failed the SVT (Validity-10; ≥19 cutoff); Multiple PVT failures were significantly associated with Validity-10 failure at the ≥19 and ≥23 cutoffs (<i>p</i>'s < .0012). The Validity-10 had moderate correspondence in predicting 2+ PVTs failures (<i>AUC</i> = 0.83; <i>95% CI</i> = 0.76, 0.91).</p><p><strong>Conclusion: </strong>PVT failures are associated with psychiatric factors, but not traumatic brain injury (TBI). PVT failures predict SVT failure and vice versa. Standard care should include SVTs and PVTs in all clinical assessments, not just neuropsychological assessments, particularly in clinically complex populations.</p>\",\"PeriodicalId\":49995,\"journal\":{\"name\":\"Journal of the International Neuropsychological Society\",\"volume\":\" \",\"pages\":\"410-419\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the International Neuropsychological Society\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1017/S1355617723000711\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/11/28 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the International Neuropsychological Society","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1017/S1355617723000711","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/11/28 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
Importance of validity testing in psychiatric assessment: evidence from a sample of multimorbid post-9/11 veterans.
Objective: Performance validity (PVTs) and symptom validity tests (SVTs) are necessary components of neuropsychological testing to identify suboptimal performances and response bias that may impact diagnosis and treatment. The current study examined the clinical and functional characteristics of veterans who failed PVTs and the relationship between PVT and SVT failures.
Method: Five hundred and sixteen post-9/11 veterans participated in clinical interviews, neuropsychological testing, and several validity measures.
Results: Veterans who failed 2+ PVTs performed significantly worse than veterans who failed one PVT in verbal memory (Cohen's d = .60-.69), processing speed (Cohen's d = .68), working memory (Cohen's d = .98), and visual memory (Cohen's d = .88-1.10). Individuals with 2+ PVT failures had greater posttraumatic stress (PTS; β = 0.16; p = .0002), and worse self-reported depression (β = 0.17; p = .0001), anxiety (β = 0.15; p = .0007), sleep (β = 0.10; p = .0233), and functional outcomes (β = 0.15; p = .0009) compared to veterans who passed PVTs. 7.8% veterans failed the SVT (Validity-10; ≥19 cutoff); Multiple PVT failures were significantly associated with Validity-10 failure at the ≥19 and ≥23 cutoffs (p's < .0012). The Validity-10 had moderate correspondence in predicting 2+ PVTs failures (AUC = 0.83; 95% CI = 0.76, 0.91).
Conclusion: PVT failures are associated with psychiatric factors, but not traumatic brain injury (TBI). PVT failures predict SVT failure and vice versa. Standard care should include SVTs and PVTs in all clinical assessments, not just neuropsychological assessments, particularly in clinically complex populations.
期刊介绍:
The Journal of the International Neuropsychological Society is the official journal of the International Neuropsychological Society, an organization of over 4,500 international members from a variety of disciplines. The Journal of the International Neuropsychological Society welcomes original, creative, high quality research papers covering all areas of neuropsychology. The focus of articles may be primarily experimental, applied, or clinical. Contributions will broadly reflect the interest of all areas of neuropsychology, including but not limited to: development of cognitive processes, brain-behavior relationships, adult and pediatric neuropsychology, neurobehavioral syndromes (such as aphasia or apraxia), and the interfaces of neuropsychology with related areas such as behavioral neurology, neuropsychiatry, genetics, and cognitive neuroscience. Papers that utilize behavioral, neuroimaging, and electrophysiological measures are appropriate.
To assure maximum flexibility and to promote diverse mechanisms of scholarly communication, the following formats are available in addition to a Regular Research Article: Brief Communication is a shorter research article; Rapid Communication is intended for "fast breaking" new work that does not yet justify a full length article and is placed on a fast review track; Case Report is a theoretically important and unique case study; Critical Review and Short Review are thoughtful considerations of topics of importance to neuropsychology and include meta-analyses; Dialogue provides a forum for publishing two distinct positions on controversial issues in a point-counterpoint format; Special Issue and Special Section consist of several articles linked thematically; Letter to the Editor responds to recent articles published in the Journal of the International Neuropsychological Society; and Book Review, which is considered but is no longer solicited.