{"title":"对文本提示的人工智能生成图像中表意意义的跨符号分析","authors":"Arash Ghazvineh","doi":"10.1515/lass-2023-0030","DOIUrl":null,"url":null,"abstract":"Abstract This paper explores the inter-semiotic analysis of the ideational meaning in images generated by the text-to-image AI tool, Bing Image Creator. It adopts Kress and Van Leeuwen’s Grammar of Visual Design as its theoretical framework as the original grounding of the framework in systemic functional grammar (SFG) ensures a solid theoretical basis for undertaking analyses that involve the incorporation of textual and visual components. The integration of an AI generative model within the analytical framework enables a systematic connection between language and visual representations. This incorporation offers the potential to generate well-regulated pictorial representations that are systematically grounded in controlled textual prompts. This approach introduces a novel avenue for re-examining inter-semiotic processes, leveraging the power of AI technology. The paper argues that visual representations possess unique structural devices that surpass the limitations of verbal or written communication as they readily accommodate larger amounts of information in contrast to the limitations of the linear nature of alphabetic writing. Moreover, this paper extends its contribution by critically evaluating specific aspects of the Grammar of Visual Design.","PeriodicalId":74056,"journal":{"name":"Language and semiotic studies","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An inter-semiotic analysis of ideational meaning in text-prompted AI-generated images\",\"authors\":\"Arash Ghazvineh\",\"doi\":\"10.1515/lass-2023-0030\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract This paper explores the inter-semiotic analysis of the ideational meaning in images generated by the text-to-image AI tool, Bing Image Creator. It adopts Kress and Van Leeuwen’s Grammar of Visual Design as its theoretical framework as the original grounding of the framework in systemic functional grammar (SFG) ensures a solid theoretical basis for undertaking analyses that involve the incorporation of textual and visual components. The integration of an AI generative model within the analytical framework enables a systematic connection between language and visual representations. This incorporation offers the potential to generate well-regulated pictorial representations that are systematically grounded in controlled textual prompts. This approach introduces a novel avenue for re-examining inter-semiotic processes, leveraging the power of AI technology. The paper argues that visual representations possess unique structural devices that surpass the limitations of verbal or written communication as they readily accommodate larger amounts of information in contrast to the limitations of the linear nature of alphabetic writing. Moreover, this paper extends its contribution by critically evaluating specific aspects of the Grammar of Visual Design.\",\"PeriodicalId\":74056,\"journal\":{\"name\":\"Language and semiotic studies\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Language and semiotic studies\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1515/lass-2023-0030\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Language and semiotic studies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1515/lass-2023-0030","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
摘要 本文探讨了由文本到图像的人工智能工具必应图像生成器生成的图像中表意意义的跨交际分析。本文采用 Kress 和 Van Leeuwen 的《视觉设计语法》(Grammar of Visual Design)作为其理论框架,因为该框架以系统功能语法(SFG)为原始基础,为进行包含文本和视觉成分的分析奠定了坚实的理论基础。在分析框架中融入人工智能生成模型,可以将语言和视觉表征系统地联系起来。这种结合提供了在受控文本提示的基础上系统地生成规范的图像表征的可能性。这种方法利用人工智能技术的力量,为重新审视跨交际过程提供了一条新途径。本文认为,视觉表征拥有独特的结构装置,超越了口头或书面交流的局限性,因为与字母书写的线性局限性相比,视觉表征可轻松容纳更大量的信息。此外,本文还对《视觉设计语法》的具体方面进行了批判性评估,从而进一步扩大了其贡献。
An inter-semiotic analysis of ideational meaning in text-prompted AI-generated images
Abstract This paper explores the inter-semiotic analysis of the ideational meaning in images generated by the text-to-image AI tool, Bing Image Creator. It adopts Kress and Van Leeuwen’s Grammar of Visual Design as its theoretical framework as the original grounding of the framework in systemic functional grammar (SFG) ensures a solid theoretical basis for undertaking analyses that involve the incorporation of textual and visual components. The integration of an AI generative model within the analytical framework enables a systematic connection between language and visual representations. This incorporation offers the potential to generate well-regulated pictorial representations that are systematically grounded in controlled textual prompts. This approach introduces a novel avenue for re-examining inter-semiotic processes, leveraging the power of AI technology. The paper argues that visual representations possess unique structural devices that surpass the limitations of verbal or written communication as they readily accommodate larger amounts of information in contrast to the limitations of the linear nature of alphabetic writing. Moreover, this paper extends its contribution by critically evaluating specific aspects of the Grammar of Visual Design.