Critiki: A Scaffolded Approach to Gathering Design Feedback from Paid Crowdworkers

Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition Pub Date : 2015-06-22 DOI:10.1145/2757226.2757249

M. Greenberg, Matthew W. Easterday, E. Gerber

{"title":"Critiki: A Scaffolded Approach to Gathering Design Feedback from Paid Crowdworkers","authors":"M. Greenberg, Matthew W. Easterday, E. Gerber","doi":"10.1145/2757226.2757249","DOIUrl":null,"url":null,"abstract":"Feedback is important to the creative process, but not everyone has a personal crowd of individuals they can turn to for high-quality feedback. We introduce and evaluate Critiki, a novel system for gathering design critiques on crowdfunding project pages from paid crowdworkers. Stemming from previous research on crowdfunding project creators and their need for early-stage design feedback, we design and build a working system which fits the need of this population: rapid and inexpensive feedback. To solve issues with critique quality we describe a scaffolding technique designed to assist crowdworkers in writing high-quality critiques. We evaluate Critiki with two field deployments: 1) A randomized controlled experiment with 450 crowdworkers to evaluate the efficacy of the scaffolding technique and 2) A user study with 31 crowdfunding project creators to determine usability and user satisfaction. We contribute to research on Creativity and Cognition by demonstrating a working creativity support system, empirically evaluating the system, and describing how scaffolding approaches can be designed for other crowdsourced tasks","PeriodicalId":231794,"journal":{"name":"Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2015-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"46","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/2757226.2757249","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 46

Abstract

Feedback is important to the creative process, but not everyone has a personal crowd of individuals they can turn to for high-quality feedback. We introduce and evaluate Critiki, a novel system for gathering design critiques on crowdfunding project pages from paid crowdworkers. Stemming from previous research on crowdfunding project creators and their need for early-stage design feedback, we design and build a working system which fits the need of this population: rapid and inexpensive feedback. To solve issues with critique quality we describe a scaffolding technique designed to assist crowdworkers in writing high-quality critiques. We evaluate Critiki with two field deployments: 1) A randomized controlled experiment with 450 crowdworkers to evaluate the efficacy of the scaffolding technique and 2) A user study with 31 crowdfunding project creators to determine usability and user satisfaction. We contribute to research on Creativity and Cognition by demonstrating a working creativity support system, empirically evaluating the system, and describing how scaffolding approaches can be designed for other crowdsourced tasks

查看原文本刊更多论文

Critiki:从付费众包工作者那里收集设计反馈的脚手架式方法

反馈对创意过程很重要，但并不是每个人都有自己的一群人可以向他们寻求高质量的反馈。我们介绍并评估了Critiki，这是一个从付费众筹工作者那里收集众筹项目页面上设计评论的新系统。根据之前对众筹项目创造者的研究以及他们对早期设计反馈的需求，我们设计并构建了一个适合这一人群需求的工作系统:快速且廉价的反馈。为了解决评论质量问题，我们描述了一种脚手架技术，旨在帮助众包工作者撰写高质量的评论。我们通过两个实地部署来评估Critiki: 1)与450名众筹工作者进行随机对照实验，以评估脚手架技术的有效性;2)与31名众筹项目创建者进行用户研究，以确定可用性和用户满意度。我们通过展示一个有效的创造力支持系统，对该系统进行实证评估，并描述如何为其他众包任务设计脚手架方法，从而为创造力和认知的研究做出贡献

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition

自引率

0.00%

发文量