Elena Zaitseva, Simon Ochotnicky, Miriam Fandakova, Vitaly Levashenko, Jan Rabcan
{"title":"A multi-agent large language model (LLM) platform for structured medical anamnesis in outpatient care.","authors":"Elena Zaitseva, Simon Ochotnicky, Miriam Fandakova, Vitaly Levashenko, Jan Rabcan","doi":"10.3389/fdgth.2026.1882397","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Medical anamnesis is fundamental to clinical decision-making, yet outpatient consultations often provide limited time for systematic information collection. This study investigates whether structured anamnesis acquisition can be redistributed to a pre-consultation phase using a framework-driven large language model (LLM) platform.</p><p><strong>Methods: </strong>We developed Symptio, a proof-of-concept multi-agent LLM platform that operationalises the SOCRATES, Review of Systems, and SAMPLE frameworks as machine-interpretable constraints within a human-in-the-loop workflow. The system was evaluated in 100 simulated outpatient scenarios. Generated anamneses were compared with reference-standard representations using structural agreement and field-level performance metrics.</p><p><strong>Results: </strong>Full structural agreement across all three frameworks was achieved in 87% of scenarios. Framework-specific agreement reached 96% for SOCRATES, 88% for Review of Systems, and 93% for SAMPLE. Micro-averaged precision, recall, and F1-score were 99.04%, 98.54%, and 98.79%, respectively. Although no high-severity errors were identified, 58 field-level discrepancies, including 28 medium-severity errors, were observed, supporting the need for physician review of all outputs.</p><p><strong>Discussion: </strong>The findings demonstrate the technical feasibility of acquiring structured anamnesis in a framework-driven manner within a process-oriented multi-agent LLM architecture under controlled conditions. The proposed approach enables the relocation of routine information collection to a pre-consultation phase while preserving physician authority through human-in-the-loop validation. Further studies are required to evaluate clinical safety, workflow impact, and effectiveness in real-world settings.</p>","PeriodicalId":73078,"journal":{"name":"Frontiers in digital health","volume":"8 ","pages":"1882397"},"PeriodicalIF":5.2000,"publicationDate":"2026-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13662122/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in digital health","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/fdgth.2026.1882397","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction: Medical anamnesis is fundamental to clinical decision-making, yet outpatient consultations often provide limited time for systematic information collection. This study investigates whether structured anamnesis acquisition can be redistributed to a pre-consultation phase using a framework-driven large language model (LLM) platform.
Methods: We developed Symptio, a proof-of-concept multi-agent LLM platform that operationalises the SOCRATES, Review of Systems, and SAMPLE frameworks as machine-interpretable constraints within a human-in-the-loop workflow. The system was evaluated in 100 simulated outpatient scenarios. Generated anamneses were compared with reference-standard representations using structural agreement and field-level performance metrics.
Results: Full structural agreement across all three frameworks was achieved in 87% of scenarios. Framework-specific agreement reached 96% for SOCRATES, 88% for Review of Systems, and 93% for SAMPLE. Micro-averaged precision, recall, and F1-score were 99.04%, 98.54%, and 98.79%, respectively. Although no high-severity errors were identified, 58 field-level discrepancies, including 28 medium-severity errors, were observed, supporting the need for physician review of all outputs.
Discussion: The findings demonstrate the technical feasibility of acquiring structured anamnesis in a framework-driven manner within a process-oriented multi-agent LLM architecture under controlled conditions. The proposed approach enables the relocation of routine information collection to a pre-consultation phase while preserving physician authority through human-in-the-loop validation. Further studies are required to evaluate clinical safety, workflow impact, and effectiveness in real-world settings.