Ever Augusto Torres-Silva, Juan José Gaviria-Jiménez, Eider Pereira-Montiel, David Andrés Montoya-Arenas, José Fernando Flórez-Arango
{"title":"Clinical System for Mood Disorder Care in Córdoba, Colombia: Participatory Design and Scenario-Based Usability Evaluation Study.","authors":"Ever Augusto Torres-Silva, Juan José Gaviria-Jiménez, Eider Pereira-Montiel, David Andrés Montoya-Arenas, José Fernando Flórez-Arango","doi":"10.2196/58909","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Mood disorders are among the leading causes of disability worldwide and present a growing public health concern. In Córdoba, Colombia, suicide rates have risen significantly in recent years, exposing structural gaps in mental health care delivery. Digital health solutions and telehealth interventions can expand access to early detection, referral, and monitoring of patients in underserved regions. However, their effectiveness depends on rigorous and diverse evaluations to ensure adoption and sustainability.</p><p><strong>Objective: </strong>This study evaluated the usability of a clinical telehealth system for mood disorder care developed through participatory design, with emphasis on user-centered functionality and workload analysis.</p><p><strong>Methods: </strong>The system was designed through 2 iterative development cycles, followed by a scenario-based usability evaluation. A functional Domain Ontology was constructed to prioritize 8 core functionalities, including telecounseling, a georeferenced institutional directory, hotline services, patient self-report tools, educational content, forums, and a population dashboard. Thirty participants representing patients, caregivers, clinical staff, and administrative personnel were recruited through convenience sampling. Usability was assessed through cognitive walk-throughs, the NASA (National Aeronautics and Space Administration) Task Load Index, and the Post-Study System Usability Questionnaire.</p><p><strong>Results: </strong>A total of 34 usability sessions and 223 task-level workload assessments were conducted across 2 evaluation cycles. The system demonstrated high usability, with overall Post-Study System Usability Questionnaire scores of 2.2 in cycle 1 and 2.3 in cycle 2. Interfaces prioritized for patients and clinical staff achieved better evaluations (average 1.9-2.0) than administrative interfaces (average 3.0). Workload analysis indicated improvements between cycles, particularly for patient-centered tasks, with mental workload as the most significant source of cognitive demand. Twenty-three critical issues (9 system errors and 14 design flaws) were identified and corrected between cycles, leading to measurable usability gains.</p><p><strong>Conclusions: </strong>The participatory and scenario-based approach facilitated early identification of usability challenges and supported iterative refinement of the system. Results suggest that the system is usable, acceptable, and effective in reducing workload for key user groups, particularly patients and clinicians. The findings reinforce the value of participatory methodologies in digital mental health and highlight the need to prioritize patient-facing interfaces. Future research should extend evaluations to mobile platforms and larger populations to support scalability and integration into regional mental health services.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"9 ","pages":"e58909"},"PeriodicalIF":2.0000,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Formative Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/58909","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Mood disorders are among the leading causes of disability worldwide and present a growing public health concern. In Córdoba, Colombia, suicide rates have risen significantly in recent years, exposing structural gaps in mental health care delivery. Digital health solutions and telehealth interventions can expand access to early detection, referral, and monitoring of patients in underserved regions. However, their effectiveness depends on rigorous and diverse evaluations to ensure adoption and sustainability.
Objective: This study evaluated the usability of a clinical telehealth system for mood disorder care developed through participatory design, with emphasis on user-centered functionality and workload analysis.
Methods: The system was designed through 2 iterative development cycles, followed by a scenario-based usability evaluation. A functional Domain Ontology was constructed to prioritize 8 core functionalities, including telecounseling, a georeferenced institutional directory, hotline services, patient self-report tools, educational content, forums, and a population dashboard. Thirty participants representing patients, caregivers, clinical staff, and administrative personnel were recruited through convenience sampling. Usability was assessed through cognitive walk-throughs, the NASA (National Aeronautics and Space Administration) Task Load Index, and the Post-Study System Usability Questionnaire.
Results: A total of 34 usability sessions and 223 task-level workload assessments were conducted across 2 evaluation cycles. The system demonstrated high usability, with overall Post-Study System Usability Questionnaire scores of 2.2 in cycle 1 and 2.3 in cycle 2. Interfaces prioritized for patients and clinical staff achieved better evaluations (average 1.9-2.0) than administrative interfaces (average 3.0). Workload analysis indicated improvements between cycles, particularly for patient-centered tasks, with mental workload as the most significant source of cognitive demand. Twenty-three critical issues (9 system errors and 14 design flaws) were identified and corrected between cycles, leading to measurable usability gains.
Conclusions: The participatory and scenario-based approach facilitated early identification of usability challenges and supported iterative refinement of the system. Results suggest that the system is usable, acceptable, and effective in reducing workload for key user groups, particularly patients and clinicians. The findings reinforce the value of participatory methodologies in digital mental health and highlight the need to prioritize patient-facing interfaces. Future research should extend evaluations to mobile platforms and larger populations to support scalability and integration into regional mental health services.