Anbukkarasi S, Hemalatha S, Arunkumar B, Shanmugavalli V, Kokila S, Yashaswini K A
{"title":"From text to multimodality: A comprehensive survey of LLMs and MLLMs across diverse domains","authors":"Anbukkarasi S, Hemalatha S, Arunkumar B, Shanmugavalli V, Kokila S, Yashaswini K A","doi":"10.1016/j.icte.2026.07.023","DOIUrl":null,"url":null,"abstract":"<div><div>The rapid development of Artificial Intelligence has made it possible for advanced language learning systems, including Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), to be created. These models go beyond the traditional text-based processing by incorporating different modalities like video, audio, text creating more accurate prediction systems. Here, we aim to give a thorough look at multimodal models focusing on their use and challenges in different real-world domains including healthcare, education, industry, governance, security, assistive systems, scientific research, and creative media. We break down model architecture, multimodal fusion techniques, training methods, and specific adaptations for domains that improve understanding, decision-making, and interactive capabilities. On top of that, we discuss major benchmark datasets, performance evaluation methods, and real-world examples with the help of which we point out the present capabilities and practical limitations. We engage with major challenges such as data inconsistency, model alignment scalability computational cost, privacy issues, bias, and explainability. Besides, this article explores instructional-tuned multimodal systems, lightweight domain adaptations, retrieval-augmented multimodal reasoning, and human-in-the-loop learning models that are gaining ground. We finish by listing prospective research directions that lead to trustworthy, energy-efficient, context-aware, and ethically aligned multimodal AI systems that connect artificial and augmented intelligence. This article is a thorough guide for researchers, professionals, and policymakers in pushing forward multimodal models to strong and socially responsible usage across different domains.</div></div>","PeriodicalId":48526,"journal":{"name":"ICT Express","volume":"12 5","pages":"Pages 1189-1209"},"PeriodicalIF":4.6000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ICT Express","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2405959526001372","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/7/31 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
The rapid development of Artificial Intelligence has made it possible for advanced language learning systems, including Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs), to be created. These models go beyond the traditional text-based processing by incorporating different modalities like video, audio, text creating more accurate prediction systems. Here, we aim to give a thorough look at multimodal models focusing on their use and challenges in different real-world domains including healthcare, education, industry, governance, security, assistive systems, scientific research, and creative media. We break down model architecture, multimodal fusion techniques, training methods, and specific adaptations for domains that improve understanding, decision-making, and interactive capabilities. On top of that, we discuss major benchmark datasets, performance evaluation methods, and real-world examples with the help of which we point out the present capabilities and practical limitations. We engage with major challenges such as data inconsistency, model alignment scalability computational cost, privacy issues, bias, and explainability. Besides, this article explores instructional-tuned multimodal systems, lightweight domain adaptations, retrieval-augmented multimodal reasoning, and human-in-the-loop learning models that are gaining ground. We finish by listing prospective research directions that lead to trustworthy, energy-efficient, context-aware, and ethically aligned multimodal AI systems that connect artificial and augmented intelligence. This article is a thorough guide for researchers, professionals, and policymakers in pushing forward multimodal models to strong and socially responsible usage across different domains.
期刊介绍:
The ICT Express journal published by the Korean Institute of Communications and Information Sciences (KICS) is an international, peer-reviewed research publication covering all aspects of information and communication technology. The journal aims to publish research that helps advance the theoretical and practical understanding of ICT convergence, platform technologies, communication networks, and device technologies. The technology advancement in information and communication technology (ICT) sector enables portable devices to be always connected while supporting high data rate, resulting in the recent popularity of smartphones that have a considerable impact in economic and social development.