{"title":"基于双阶段注意力的立体视频质量评价对称框架","authors":"Kairui Zhang , Xiao Ke , Xin Chen","doi":"10.1016/j.displa.2025.103232","DOIUrl":null,"url":null,"abstract":"<div><div>The compelling creative capabilities of stereo video have captured the attention of scholars towards its quality. Given the substantial challenge posed by asymmetric distortion in stereoscopic visual perception within the realm of stereoscopic video quality evaluation (SVQA), this study introduces the novel <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> (Dual Branch, dual-stage Attention, Dual Task) framework for stereoscopic video quality assessment. Leveraging its innovative dual-task architecture, <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> employs a dual-branch independent prediction mechanism for the left and right views. This approach not only effectively addresses the prevalent issue of asymmetric distortion in stereoscopic videos but also pinpoints which view drags the overall score down. To surmount the limitations of existing models in capturing global detail attention, <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> incorporates a two-stage distorted attention fusion module. This module enables multi-level fusion of video features at both block and pixel levels, bolstering the model’s attention towards global details and its processing capabilities, consequently enhancing the overall performance of the model. <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> has exhibited exceptional performance across mainstream and cross-domain datasets, establishing itself as the current state-of-the-art (SOTA) technology.</div></div>","PeriodicalId":50570,"journal":{"name":"Displays","volume":"91 ","pages":"Article 103232"},"PeriodicalIF":3.4000,"publicationDate":"2025-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual-stage attention based symmetric framework for stereo video quality assessment\",\"authors\":\"Kairui Zhang , Xiao Ke , Xin Chen\",\"doi\":\"10.1016/j.displa.2025.103232\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The compelling creative capabilities of stereo video have captured the attention of scholars towards its quality. Given the substantial challenge posed by asymmetric distortion in stereoscopic visual perception within the realm of stereoscopic video quality evaluation (SVQA), this study introduces the novel <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> (Dual Branch, dual-stage Attention, Dual Task) framework for stereoscopic video quality assessment. Leveraging its innovative dual-task architecture, <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> employs a dual-branch independent prediction mechanism for the left and right views. This approach not only effectively addresses the prevalent issue of asymmetric distortion in stereoscopic videos but also pinpoints which view drags the overall score down. To surmount the limitations of existing models in capturing global detail attention, <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> incorporates a two-stage distorted attention fusion module. This module enables multi-level fusion of video features at both block and pixel levels, bolstering the model’s attention towards global details and its processing capabilities, consequently enhancing the overall performance of the model. <span><math><mrow><msup><mrow><mi>D</mi></mrow><mrow><mn>3</mn></mrow></msup><mi>N</mi><mi>e</mi><mi>t</mi></mrow></math></span> has exhibited exceptional performance across mainstream and cross-domain datasets, establishing itself as the current state-of-the-art (SOTA) technology.</div></div>\",\"PeriodicalId\":50570,\"journal\":{\"name\":\"Displays\",\"volume\":\"91 \",\"pages\":\"Article 103232\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Displays\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0141938225002690\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Displays","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0141938225002690","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
Dual-stage attention based symmetric framework for stereo video quality assessment
The compelling creative capabilities of stereo video have captured the attention of scholars towards its quality. Given the substantial challenge posed by asymmetric distortion in stereoscopic visual perception within the realm of stereoscopic video quality evaluation (SVQA), this study introduces the novel (Dual Branch, dual-stage Attention, Dual Task) framework for stereoscopic video quality assessment. Leveraging its innovative dual-task architecture, employs a dual-branch independent prediction mechanism for the left and right views. This approach not only effectively addresses the prevalent issue of asymmetric distortion in stereoscopic videos but also pinpoints which view drags the overall score down. To surmount the limitations of existing models in capturing global detail attention, incorporates a two-stage distorted attention fusion module. This module enables multi-level fusion of video features at both block and pixel levels, bolstering the model’s attention towards global details and its processing capabilities, consequently enhancing the overall performance of the model. has exhibited exceptional performance across mainstream and cross-domain datasets, establishing itself as the current state-of-the-art (SOTA) technology.
期刊介绍:
Displays is the international journal covering the research and development of display technology, its effective presentation and perception of information, and applications and systems including display-human interface.
Technical papers on practical developments in Displays technology provide an effective channel to promote greater understanding and cross-fertilization across the diverse disciplines of the Displays community. Original research papers solving ergonomics issues at the display-human interface advance effective presentation of information. Tutorial papers covering fundamentals intended for display technologies and human factor engineers new to the field will also occasionally featured.