CAP: The creativity assessment platform for online testing and automated scoring.

IF 3.9 2区 心理学 Q1 PSYCHOLOGY, EXPERIMENTAL
John D Patterson, Jimmy Pronchick, Ruchi Panchanadikar, Mark Fuge, Janet G van Hell, Scarlett R Miller, Dan R Johnson, Roger E Beaty
{"title":"CAP: The creativity assessment platform for online testing and automated scoring.","authors":"John D Patterson, Jimmy Pronchick, Ruchi Panchanadikar, Mark Fuge, Janet G van Hell, Scarlett R Miller, Dan R Johnson, Roger E Beaty","doi":"10.3758/s13428-025-02761-9","DOIUrl":null,"url":null,"abstract":"<p><p>Creativity is increasingly recognized as a core competency for the 21st century, making its development a priority in education, research, and industry. To effectively cultivate creativity, researchers and educators need reliable and accessible assessment tools. Recent software developments have significantly enhanced the administration and scoring of creativity measures; however, existing software often requires expertise in experiment design and computer programming, limiting its accessibility to many educators and researchers. In the current work, we introduce CAP-the Creativity Assessment Platform-a free web application for building creativity assessments, collecting data, and automatically scoring responses (cap.ist.psu.edu). CAP allows users to create custom creativity assessments in ten languages using a simple, point-and-click interface, selecting from tasks such as the Short Story Task, Drawing Task, and Scientific Creative Thinking Test. Users can automatically score task responses using machine learning models trained to match human creativity ratings-with multilingual capabilities, including the new Cross-Lingual Alternate Uses Scoring (CLAUS), a large language model achieving strong prediction of human creativity ratings in ten languages. CAP also provides a centralized dashboard to monitor data collection, score assessments, and automatically generate text for a Methods section based on the study's tasks, metrics, and instructions-with a single click-promoting transparency and reproducibility in creativity assessment. Designed for ease of use, CAP aims to democratize creativity measurement for researchers, educators, and everyone in between.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 9","pages":"264"},"PeriodicalIF":3.9000,"publicationDate":"2025-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12361297/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Research Methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-025-02761-9","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0

Abstract

Creativity is increasingly recognized as a core competency for the 21st century, making its development a priority in education, research, and industry. To effectively cultivate creativity, researchers and educators need reliable and accessible assessment tools. Recent software developments have significantly enhanced the administration and scoring of creativity measures; however, existing software often requires expertise in experiment design and computer programming, limiting its accessibility to many educators and researchers. In the current work, we introduce CAP-the Creativity Assessment Platform-a free web application for building creativity assessments, collecting data, and automatically scoring responses (cap.ist.psu.edu). CAP allows users to create custom creativity assessments in ten languages using a simple, point-and-click interface, selecting from tasks such as the Short Story Task, Drawing Task, and Scientific Creative Thinking Test. Users can automatically score task responses using machine learning models trained to match human creativity ratings-with multilingual capabilities, including the new Cross-Lingual Alternate Uses Scoring (CLAUS), a large language model achieving strong prediction of human creativity ratings in ten languages. CAP also provides a centralized dashboard to monitor data collection, score assessments, and automatically generate text for a Methods section based on the study's tasks, metrics, and instructions-with a single click-promoting transparency and reproducibility in creativity assessment. Designed for ease of use, CAP aims to democratize creativity measurement for researchers, educators, and everyone in between.

Abstract Image

Abstract Image

Abstract Image

CAP:在线测试和自动评分的创造力评估平台。
创造力越来越被认为是21世纪的核心竞争力,它的发展成为教育、研究和工业的优先事项。为了有效地培养创造力,研究人员和教育工作者需要可靠和易于获取的评估工具。最近的软件开发大大增强了创造性措施的管理和评分;然而,现有的软件通常需要实验设计和计算机编程方面的专业知识,限制了许多教育工作者和研究人员的可访问性。在目前的工作中,我们介绍了cap -创造力评估平台-一个免费的网络应用程序,用于建立创造力评估,收集数据,并自动对回复进行评分(cap.ist.psu.edu)。CAP允许用户使用简单的点击界面创建十种语言的自定义创造力评估,从诸如短篇故事任务、绘图任务和科学创造性思维测试等任务中进行选择。用户可以使用经过训练的机器学习模型自动对任务响应进行评分,该模型与人类创造力评级相匹配,具有多语言功能,包括新的跨语言替代使用评分(CLAUS),这是一个大型语言模型,可以用十种语言对人类创造力评级进行强有力的预测。CAP还提供了一个集中式仪表板,用于监控数据收集、评分评估,并根据研究的任务、指标和说明自动生成方法部分的文本(只需单击一下),从而提高了创造力评估的透明度和可重复性。为了便于使用,CAP旨在为研究人员、教育工作者和中间的每个人实现创造力测量的民主化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
10.30
自引率
9.30%
发文量
266
期刊介绍: Behavior Research Methods publishes articles concerned with the methods, techniques, and instrumentation of research in experimental psychology. The journal focuses particularly on the use of computer technology in psychological research. An annual special issue is devoted to this field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信