Jorge Luis Díaz, Núria Codern-Bové, Maria-Dolors Zomeño, Camille Lassale, Helmut Schröder, María Grau
{"title":"Quantitative and qualitative evaluation of the COMPASS mobile app: a citizen science project.","authors":"Jorge Luis Díaz, Núria Codern-Bové, Maria-Dolors Zomeño, Camille Lassale, Helmut Schröder, María Grau","doi":"10.1080/17538157.2021.1902332","DOIUrl":null,"url":null,"abstract":"<p><p>To evaluate the usability of the COMPASS application with mixed-methodology, using a citizen science approach. Parents/tutors of 10-11 years old children attending a primary school in Barcelona, Spain, were invited to take part in the study. We conducted semi-structured interviews on a subset (n = 7) of participants, two weeks after using the app for the first time. A list of suggestions of improvement was extracted from the interviews. The System Usability Scale (SUS, range 0-100) was administered to all participants before and after the improvements were implemented. We provide both a quantitative analysis (t-test of change in SUS scores) and a qualitative thematic analysis of the interviews. A total of 22 participants were included in the study. The mean score before implementation of changes was 68.5 (Standard deviation, SD = 11.1), and improved to 73.1 (10.5) (<i>p</i>-value = 0.025). Regarding the qualitative assessment, we obtained 24 codes and grouped them into 3 categories. It uncovered problems in the installation phase and the main barriers to use: lack of time and the need for the app to evolve. The new version of COMPASS, improved by taking into account the participants' comments and suggestions, was more usable than the initial version.</p>","PeriodicalId":54984,"journal":{"name":"Informatics for Health & Social Care","volume":"46 4","pages":"412-424"},"PeriodicalIF":2.5000,"publicationDate":"2021-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/17538157.2021.1902332","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Informatics for Health & Social Care","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/17538157.2021.1902332","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/4/13 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 3
Abstract
To evaluate the usability of the COMPASS application with mixed-methodology, using a citizen science approach. Parents/tutors of 10-11 years old children attending a primary school in Barcelona, Spain, were invited to take part in the study. We conducted semi-structured interviews on a subset (n = 7) of participants, two weeks after using the app for the first time. A list of suggestions of improvement was extracted from the interviews. The System Usability Scale (SUS, range 0-100) was administered to all participants before and after the improvements were implemented. We provide both a quantitative analysis (t-test of change in SUS scores) and a qualitative thematic analysis of the interviews. A total of 22 participants were included in the study. The mean score before implementation of changes was 68.5 (Standard deviation, SD = 11.1), and improved to 73.1 (10.5) (p-value = 0.025). Regarding the qualitative assessment, we obtained 24 codes and grouped them into 3 categories. It uncovered problems in the installation phase and the main barriers to use: lack of time and the need for the app to evolve. The new version of COMPASS, improved by taking into account the participants' comments and suggestions, was more usable than the initial version.
期刊介绍:
Informatics for Health & Social Care promotes evidence-based informatics as applied to the domain of health and social care. It showcases informatics research and practice within the many and diverse contexts of care; it takes personal information, both its direct and indirect use, as its central focus.
The scope of the Journal is broad, encompassing both the properties of care information and the life-cycle of associated information systems.
Consideration of the properties of care information will necessarily include the data itself, its representation, structure, and associated processes, as well as the context of its use, highlighting the related communication, computational, cognitive, social and ethical aspects.
Consideration of the life-cycle of care information systems includes full range from requirements, specifications, theoretical models and conceptual design through to sustainable implementations, and the valuation of impacts. Empirical evidence experiences related to implementation are particularly welcome.
Informatics in Health & Social Care seeks to consolidate and add to the core knowledge within the disciplines of Health and Social Care Informatics. The Journal therefore welcomes scientific papers, case studies and literature reviews. Examples of novel approaches are particularly welcome. Articles might, for example, show how care data is collected and transformed into useful and usable information, how informatics research is translated into practice, how specific results can be generalised, or perhaps provide case studies that facilitate learning from experience.