{"title":"A Crowdsourcing-based Air Pollution Measurement System Using DIY Atomic Force Microscopes","authors":"D. Martinez, D. Lombraña, F. Grey, E. Hwu","doi":"10.15346/HC.V3I1.14","DOIUrl":"https://doi.org/10.15346/HC.V3I1.14","url":null,"abstract":"Air pollutants have become the major problem of many cities, causing millions of human deaths worldwide every year. Among all the noxious pollutants in air, particles with a diameter of 2.5 micrometers or less (PM2.5) are the most hazardous because they are small enough to penetrate to the lungs and invade the smallest airways. Since the presence of dangerous levels of PM2.5, commonly reported in newspapers and on TV, is intertwined with the global pattern of production and consumption, there is a need for citizen science projects that engage the young generations in efforts toward reducing air pollution as they will become the future leaders of society. With this goal, and to enable the geo-temporal characterization of PM2.5, we present a crowdsourcing-based air pollution measurement system that uses affordable DIY atomic force microscopes to measure and characterize PM2.5, exploiting the power of human computation through an online crowdsourcing platform to study how PM2.5 varies over time and across geographical locations. Our system is intended as both a scientific platform and a teaching tool for children to engage in environmental policy.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"54 1","pages":"235-241"},"PeriodicalIF":0.0,"publicationDate":"2016-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89817027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Design Guidelines for the User-Centred Collaborative Citizen Science Platforms","authors":"Poonam Yadav, J. Darlington","doi":"10.15346/HC.V3I1.11","DOIUrl":"https://doi.org/10.15346/HC.V3I1.11","url":null,"abstract":"Online Citizen Science platforms are good examples of socio-technical systems where technology-enabled interactions occur between scientists and the general public (volunteers). Citizen Science platforms usually host multiple Citizen Science projects, and allow volunteers to choose the ones to participate in. Recent work in the area has demonstrated a positive feedback loop between participation and learning and creativity in Citizen Science projects, which is one of the motivating factors both for scientists and the volunteers. This emphasises the importance of creating successful Citizen Science platforms, which support this feedback process, and enable enhanced learning and creativity to occur through knowledge sharing and diverse participation. In this paper, we discuss how scientists' and volunteers' motivation and participation influence the design of Citizen Science platforms. We present our summary as guidelines for designing these platforms as user-inspired socio-technical systems. We also present the case-studies on popular Citizen Science platforms, including our own CitizenGrid platform, developed as part of the CCL EU project, as well as Zooniverse, World Community Grid, CrowdCrafting and EpiCollect+ to see how closely these platforms follow our proposed guidelines and how these may be further improved to incorporate the creativity enabled by the collective knowledge sharing.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"604 1","pages":"205-211"},"PeriodicalIF":0.0,"publicationDate":"2016-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86889206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Target Acquisition and the Crowd Actor","authors":"Jeffrey P. Bigham, J. Wobbrock, Walter S. Lasecki","doi":"10.15346/hc.v2i2.2","DOIUrl":"https://doi.org/10.15346/hc.v2i2.2","url":null,"abstract":"Work in human-computer interaction has generally assumed either a single user or a group of users working together in a shared virtual space. Recent crowd-powered systems use a different model in which a dynamic group of individuals (the crowd) collectively form a single actor that responds to real-time performance tasks, e.g., controlling an on-screen character, driving a robot, or operating an existing desktop interface. In this paper, we introduce the idea of the crowd actor as a way to model coordination strategies and resulting collective performance, and discuss how the crowd actor is influenced not only by the domain on which it is asked to operate but also by the personality endowed to it by algorithms used to combine the inputs of constituent participants. Nowhere is the focus on the individual performer more finely resolved than in the study of the human psychomotor system, a mainstay topic in psychology that, largely owing to Fitts’ law, also has a legacy in HCI. Therefore, we explored our notion of a crowd actor by modeling the crowd as a individual motor system performing pointing tasks. We combined the input of 200 participants in a controlled offline experiment to demonstrate the inherent trade-offs between speed and errors based on personality, the number of constituent individuals, and the mechanism used to distribute work across the group. Finally, 10 workers participated in a synchronous experiment to explore how the crowd actor responds in a real online setting. This work contributes to the beginning of a predictive science for the general crowd actor model.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"27 1","pages":"135-154"},"PeriodicalIF":0.0,"publicationDate":"2015-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75244494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Softening electronic institutions to support natural interaction","authors":"Dave Murray-Rust, P. Papapanagiotou, D. Robertson","doi":"10.15346/HC.V2I2.3","DOIUrl":"https://doi.org/10.15346/HC.V2I2.3","url":null,"abstract":"A necessary feature of social networks is a model of interaction which is followed on the network---some structure which coordinates activity between the participants. These interaction models are typically implicit, making it a challenge to both design and communicate the protocols for interaction and coordination. Electronic institution systems are one of the principal ways in which multi-agent systems engineers address this issue of coordination in complex interactions between groups of agents. In electronic institutions, interaction models can be concisely specified as protocols which encode the norms which computational agents follow. However, the formality and the up-front costs of discovering and choosing to engage with these systems has limited their applicability to human interaction. The vast majority of human (and, increasingly, automated) social interaction is now taking place in social media systems where social norms are softer concepts regulated essentially by the people involved. Being able to leverage the power of electronic institutions in these systems would ease the application of computational intelligence in support of social tasks. We describe a method by which electronic institutions can act in synergy with these sorts of social media streams and, in doing so, we define a ``softer'' style of system that, nevertheless, retains connection to precise specifications of coordination. In addition, we question the tacit assumption that participating agents deliberately join appropriate institutions. Although our method is independent of choice of social media stream (given a few standard characteristics of these) we describe an implementation of the method using Twitter as a target media stream. We illustrate the utility of our approach with an example which benefits from computational coordination, but where the use of a traditional EI would have prohibitive up-front costs. As well as a trace of a synthetic version, we demonstrate the functioning of a complete implementation which can run the example, and discuss how minimal the end-user configuration to setup complex examples can be.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"6 1","pages":"155-188"},"PeriodicalIF":0.0,"publicationDate":"2015-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83646620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sandy J. J. Gould, A. Cox, Duncan P. Brumby, Sarah Wiseman
{"title":"Home is Where the Lab is: A Comparison of Online and Lab Data From a Time-sensitive Study of Interruption","authors":"Sandy J. J. Gould, A. Cox, Duncan P. Brumby, Sarah Wiseman","doi":"10.15346/hc.v2i1.4","DOIUrl":"https://doi.org/10.15346/hc.v2i1.4","url":null,"abstract":"While experiments have been run online for some time with positive results, there are still outstanding questions about the kinds of tasks that can be successfully deployed to remotely situated online participants. Some tasks, such as menu selection, have worked well but these do not represent the gamut of tasks that interest HCI researchers. In particular, we wondered whether long-lasting, time-sensitive tasks that require continuous concentration could work successfully online, given the confounding effects that might accompany the online deployment of such a task. We ran an archetypal interruption experiment both online and in the lab to investigate whether studies demonstrating such characteristics might be more vulnerable to a loss of control than the short, time-insensitive studies that are representative of the majority of previous online studies. Statistical comparisons showed no significant differences in performance on a number of dimensions. However, there were issues with data quality that stemmed from participants misunderstanding the task. Our findings suggest that long-lasting experiments using time-sensitive performance measures can be run online but that care must be taken when introducing participants to experimental procedures.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"20 1","pages":"45-67"},"PeriodicalIF":0.0,"publicationDate":"2015-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81301322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Cristina Sarasua, E. Simperl, Natasha Noy, A. Bernstein, J. Leimeister
{"title":"Crowdsourcing and the Semantic Web: A Research Manifesto","authors":"Cristina Sarasua, E. Simperl, Natasha Noy, A. Bernstein, J. Leimeister","doi":"10.15346/HC.V2I1.2","DOIUrl":"https://doi.org/10.15346/HC.V2I1.2","url":null,"abstract":"Our goal with this research manifesto is to define a roadmap to guide the evolution of the new research field that is emerging at the intersection between crowdsourcing and the Semantic Web. We analyze the confluence of these two disciplines by exploring their relationship. First, we focus on how the application of crowdsourcing techniques can enhance the machine-driven execution of Semantic Web tasks. Second, we look at the ways in which machine-processable semantics can benefit the design and management of crowdsourcing projects. As a result, we are able to describe a list of successful or promising scenarios for both perspectives, identify scientific and technological challenges, and compile a set of recommendations to realize these scenarios effectively. This research manifesto is an outcome of the Dagstuhl Seminar 14282: Crowdsourcing and the Semantic Web.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"509 1","pages":"3-17"},"PeriodicalIF":0.0,"publicationDate":"2015-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86793776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Crowdsourcing the mapping problem for design space exploration of custom reconfigurable architecture designs","authors":"Anil Kumar Sistla, Krunalkumar Patel, Gayatri Mehta","doi":"10.15346/hc.v2i1.5","DOIUrl":"https://doi.org/10.15346/hc.v2i1.5","url":null,"abstract":"One of the grand challenges in the design of portable/wearable electronics is to achieve optimal efficiency and flexibility in a tiny low power package. Coarse grained reconfigurable architectures (CGRAs) hold great promise for low power, high performance, and flexible designs for a domain of applications. CGRAs are very promising due to the ability to highly customize such architectures to an application domain. However, greater customization makes the mapping of applications onto these architectures very challenging. Good tools and fast, effective mapping algorithms are needed to support design space exploration for CGRAs. In particular, the mapping problem has been difficult to solve in a satisfying and general way. In this paper, we present an architectural design flow using crowdsourcing to provide mappings of benchmarks onto new architectures. We show that the crowd can provide high quality, reliable mappings, significantly outperforming our custom Simulated Annealing algorithm in almost all cases. We further show that the crowd can provide other types of feedback that are difficult to obtain from an automatic mapping algorithm. Our proof of concept cross-architectural study supports an 8Way or 4Way1Hop architecture as a top choice, concludes that a custom modification that constrains inputs and outputs consumes less energy but requires more area than its less constrained counterpart, and suggests that Stripe architectures are interesting to consider because they perform nearly as well as our mesh variants and may present a more straightforward mapping problem for the crowd or an automatic mapping algorithm.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"369 1","pages":"69-103"},"PeriodicalIF":0.0,"publicationDate":"2015-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76755224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Privacy in Participatory Research: Advancing Policy to support Human Computation","authors":"A. Bowser, A. Wiggins","doi":"10.15346/hc.v2i1.3","DOIUrl":"https://doi.org/10.15346/hc.v2i1.3","url":null,"abstract":"Citizen science and participatory sensing are two models of human computation in which participant privacy is a key concern. Technological safeguards are important but partial solutions; a full and accurate description of policies explaining privacy practices must also be present so volunteers can make informed decisions regarding participation. Our study surveyed the policies of 30 participatory research projects to establish how privacy-related policies were presented, and how they aligned with actual practices. This paper contributes a description of the privacy-related elements of policies evident in these projects. We found that while the majority of projects demonstrated some understanding of the need for policies, many hosted incomplete policies or inaccurately described practices. We discuss the implications for project management, design, and research or operational policy, both for projects that self-categorize as citizen science or participatory sensing, and for the larger field of human computation. We conclude by proposing a set of Ethical Practices for Participatory Research Design as guidelines to inform the development of policies and the design of technologies supporting participatory research.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"75 1","pages":"19-44"},"PeriodicalIF":0.0,"publicationDate":"2015-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82238775","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sakyajit Bhattacharya, L. E. Celis, D. Chander, K. Dasgupta, Saraschandra Karanam, Vaibhav Rajan
{"title":"Crowds of Crowds: Performance based Modeling and Optimization over Multiple Crowdsourcing Platforms","authors":"Sakyajit Bhattacharya, L. E. Celis, D. Chander, K. Dasgupta, Saraschandra Karanam, Vaibhav Rajan","doi":"10.15346/hc.v2i1.6","DOIUrl":"https://doi.org/10.15346/hc.v2i1.6","url":null,"abstract":"The dynamic nature of crowdsourcing platforms poses interesting problems for users who wish to schedule large batches of tasks on these platforms. Of particular interest is that of scheduling the right number of tasks with the right price at the right time, in order to achieve the best performance with respect to accuracy and completion time. Research results, however, have shown that the performance exhibited by online platforms are both dynamic and largely unpredictable. This is primarily attributed to the fact that, unlike a traditional organizational workforce, a crowd platform is inherently composed of a dynamic set of workers with varying performance characteristics. Thus, any effort to optimize the performance needs to be complemented by a deep understanding and robust techniques to model the behaviour of the underlying platform(s). To this end, the research in this paper studies the above interrelated facets of crowdsourcing in two parts. The first part comprises the aspects of manual and automated statistical modeling of the crowd-workers' performance; the second part deals with optimization via intelligent scheduling over multiple platforms. %based on simulation testbed generated by the statistical models. Detailed experimentation with competing techniques, under varying operating conditions, validate the efficacy of our proposed algorithms while posting tasks either on a single crowd platform or multiple platforms. Our research has led to the development of a platform recommendation tool that is now being used by a large enterprise for performance optimization of voluminous crowd tasks.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"101 ","pages":"105-131"},"PeriodicalIF":0.0,"publicationDate":"2015-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72541536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Andreas Lieberoth, M. K. Pedersen, Andreea Catalina Marin, Tilo Planke, J. Sherson
{"title":"Getting Humans to do Quantum Optimization - User Acquisition, Engagement and Early Results from the Citizen Cyberscience Game Quantum Moves","authors":"Andreas Lieberoth, M. K. Pedersen, Andreea Catalina Marin, Tilo Planke, J. Sherson","doi":"10.15346/hc.v1i2.11","DOIUrl":"https://doi.org/10.15346/hc.v1i2.11","url":null,"abstract":"The game Quantum Moves was designed to pit human players against computer algorithms, combining their solutions into hybrid optimization to control a scalable quantum computer. In this midstream report, we open our design process and describe the series of constitutive building stages going into a quantum physics citizen science game. We present our approach from designing a core gameplay around quantum simulations, to putting extra game elements in place in order to frame, structure, and motivate players' difficult path from curious visitors to competent science contributors. The player base is extremely diverse - for instance, two top players are a 40 year old female accountant and a male taxi driver. Among statistical predictors for retention and in-game high scores, the data from our first year suggest that people recruited based on real-world physics interest and via real-world events, but only with an intermediate science education, are more likely to become engaged and skilled contributors. Interestingly, female players tended to perform better than male players, even though men played more games per day. To understand this relationship, we explore the profiles of our top players in more depth. We discuss in-world and in-game performance factors departing in psychological theories of intrinsic and extrinsic motivation, and the implications for using real live humans to do hybrid optimization via initially simple, but ultimately very cognitively complex games.","PeriodicalId":92785,"journal":{"name":"Human computation (Fairfax, Va.)","volume":"9 1","pages":"221-246"},"PeriodicalIF":0.0,"publicationDate":"2014-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88714979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}