Envisioning the Future of Creative Thinking Assessment

IF 2.8 2区 心理学 Q2 PSYCHOLOGY, EDUCATIONAL
Mathias Benedek, Roger E. Beaty
{"title":"Envisioning the Future of Creative Thinking Assessment","authors":"Mathias Benedek,&nbsp;Roger E. Beaty","doi":"10.1002/jocb.70036","DOIUrl":null,"url":null,"abstract":"<p>The PISA assessment 2022 of creative thinking was a moonshot effort that introduced significant advancements over existing creativity tests, including a broad range of domains (written, visual, social, and scientific), implementation in many languages, and sophisticated scoring methods. PISA 2022 demonstrated the general feasibility of assessing creative thinking ability comprehensively at an international scale. However, the complexity of its assessment approach—such as time-consuming scoring requiring human raters—implies the risk that it may not be easily applied by the scientific community and practitioners. In this commentary, we outline important next steps building on the PISA assessment to further enhance future assessments of creative thinking. Crucial future directions include 1) determining what tasks and scorings ensure high psychometric quality including content validity, 2) enabling efficient, objective scoring by applying AI methods such as Large Language Models (LLMs), 3) ensuring high language accessibility via multilingual tests, 4) targeting a broader age group, and 5) facilitating standardized, reproducible assessments via an open online testing platform. In sum, these developments would lead to an efficient, validated multilingual test of creative thinking, which enhances the accessibility of effective creative thinking assessments and thereby supports the democratization and reproducibility of creativity research.</p>","PeriodicalId":39915,"journal":{"name":"Journal of Creative Behavior","volume":"59 2","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jocb.70036","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Creative Behavior","FirstCategoryId":"102","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/jocb.70036","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, EDUCATIONAL","Score":null,"Total":0}
引用次数: 0

Abstract

The PISA assessment 2022 of creative thinking was a moonshot effort that introduced significant advancements over existing creativity tests, including a broad range of domains (written, visual, social, and scientific), implementation in many languages, and sophisticated scoring methods. PISA 2022 demonstrated the general feasibility of assessing creative thinking ability comprehensively at an international scale. However, the complexity of its assessment approach—such as time-consuming scoring requiring human raters—implies the risk that it may not be easily applied by the scientific community and practitioners. In this commentary, we outline important next steps building on the PISA assessment to further enhance future assessments of creative thinking. Crucial future directions include 1) determining what tasks and scorings ensure high psychometric quality including content validity, 2) enabling efficient, objective scoring by applying AI methods such as Large Language Models (LLMs), 3) ensuring high language accessibility via multilingual tests, 4) targeting a broader age group, and 5) facilitating standardized, reproducible assessments via an open online testing platform. In sum, these developments would lead to an efficient, validated multilingual test of creative thinking, which enhances the accessibility of effective creative thinking assessments and thereby supports the democratization and reproducibility of creativity research.

展望创造性思维评估的未来
2022年的PISA创造性思维评估是一项“登月计划”,与现有的创造力测试相比,它取得了重大进展,包括广泛的领域(书面、视觉、社会和科学),多种语言的实施,以及复杂的评分方法。PISA 2022证明了在国际范围内全面评估创造性思维能力的总体可行性。然而,其评估方法的复杂性——比如耗时的评分需要人工评分——意味着它可能不容易被科学界和从业者应用的风险。在这篇评论中,我们概述了在PISA评估的基础上下一步的重要步骤,以进一步加强未来对创造性思维的评估。未来的关键方向包括:1)确定哪些任务和评分能够确保高心理测量质量(包括内容有效性);2)通过应用大型语言模型(llm)等人工智能方法实现高效、客观的评分;3)通过多语言测试确保高语言可访问性;4)针对更广泛的年龄组;5)通过开放的在线测试平台促进标准化、可重复的评估。总而言之,这些发展将导致创造性思维的有效、有效的多语言测试,从而提高有效的创造性思维评估的可及性,从而支持创造性研究的民主化和可重复性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Creative Behavior
Journal of Creative Behavior Arts and Humanities-Visual Arts and Performing Arts
CiteScore
7.50
自引率
7.70%
发文量
44
期刊介绍: The Journal of Creative Behavior is our quarterly academic journal citing the most current research in creative thinking. For nearly four decades JCB has been the benchmark scientific periodical in the field. It provides up to date cutting-edge ideas about creativity in education, psychology, business, arts and more.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信