{"title":"盲人如何通过听觉、触觉和听觉-触觉模式记忆数学表达式","authors":"Paraskevi Riga, G. Kouroupetroglou","doi":"10.3390/mti8070057","DOIUrl":null,"url":null,"abstract":"In contrast to sighted students who acquire mathematical expressions (MEs) from their visual sources, blind students must keep MEs in their memory using the Tactile or Auditory Modality. In this work, we rigorously investigate the ability to temporarily retain MEs by blind individuals when they use different input modalities: Auditory, Tactile, and Auditory–Tactile. In the experiments with 16 blind participants, we meticulously measured the users’ capacity for memory retention utilizing ME recall. Based on a robust methodology, our results indicate that the distribution of the recall errors regarding their types (Deletions, Substitutions, Insertions) and math element categories (Structural, Numerical, Identifiers, Operators) are the same across the tested modalities. Deletions are the favored recall error, while operator elements are the hardest to forget. Our findings show a threshold to the cognitive overload of the short-term memory in terms of type and number of elements in an ME, where the recall rapidly decreases. The increase in the number of errors is affected by the increase in complexity; however, it is significantly higher in the Auditory modality than in the other two. Therefore, segmenting a math expression into smaller parts will benefit the ability of the blind reader to retain it in memory while studying.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"355 18","pages":"57"},"PeriodicalIF":0.0000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"How Blind Individuals Recall Mathematical Expressions in Auditory, Tactile, and Auditory-Tactile Modalities\",\"authors\":\"Paraskevi Riga, G. Kouroupetroglou\",\"doi\":\"10.3390/mti8070057\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In contrast to sighted students who acquire mathematical expressions (MEs) from their visual sources, blind students must keep MEs in their memory using the Tactile or Auditory Modality. In this work, we rigorously investigate the ability to temporarily retain MEs by blind individuals when they use different input modalities: Auditory, Tactile, and Auditory–Tactile. In the experiments with 16 blind participants, we meticulously measured the users’ capacity for memory retention utilizing ME recall. Based on a robust methodology, our results indicate that the distribution of the recall errors regarding their types (Deletions, Substitutions, Insertions) and math element categories (Structural, Numerical, Identifiers, Operators) are the same across the tested modalities. Deletions are the favored recall error, while operator elements are the hardest to forget. Our findings show a threshold to the cognitive overload of the short-term memory in terms of type and number of elements in an ME, where the recall rapidly decreases. The increase in the number of errors is affected by the increase in complexity; however, it is significantly higher in the Auditory modality than in the other two. Therefore, segmenting a math expression into smaller parts will benefit the ability of the blind reader to retain it in memory while studying.\",\"PeriodicalId\":408374,\"journal\":{\"name\":\"Multimodal Technol. Interact.\",\"volume\":\"355 18\",\"pages\":\"57\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Multimodal Technol. Interact.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3390/mti8070057\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Multimodal Technol. Interact.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/mti8070057","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
与视力正常的学生通过视觉获取数学表达式(ME)不同,盲人学生必须通过触觉或听觉模式将数学表达式保存在记忆中。在这项工作中,我们严格研究了盲人在使用不同输入模式时暂时保留数学表达式的能力:听觉、触觉和听觉-触觉。在对 16 名盲人参与者进行的实验中,我们利用 ME 召回对用户的记忆保持能力进行了细致的测量。基于稳健的方法,我们的结果表明,在不同的测试模式下,记忆错误在类型(删除、替换、插入)和数学元素类别(结构、数字、标识符、运算符)方面的分布是相同的。删除是最容易出现的记忆错误,而运算符元素则最难遗忘。我们的研究结果表明,就 ME 中元素的类型和数量而言,短时记忆的认知超载有一个临界点,在这个临界点上,回忆能力会迅速下降。错误数量的增加受复杂性增加的影响,但听觉模式的错误数量明显高于其他两种模式。因此,将数学表达式分割成较小的部分将有利于盲人读者在学习时将其保留在记忆中。
How Blind Individuals Recall Mathematical Expressions in Auditory, Tactile, and Auditory-Tactile Modalities
In contrast to sighted students who acquire mathematical expressions (MEs) from their visual sources, blind students must keep MEs in their memory using the Tactile or Auditory Modality. In this work, we rigorously investigate the ability to temporarily retain MEs by blind individuals when they use different input modalities: Auditory, Tactile, and Auditory–Tactile. In the experiments with 16 blind participants, we meticulously measured the users’ capacity for memory retention utilizing ME recall. Based on a robust methodology, our results indicate that the distribution of the recall errors regarding their types (Deletions, Substitutions, Insertions) and math element categories (Structural, Numerical, Identifiers, Operators) are the same across the tested modalities. Deletions are the favored recall error, while operator elements are the hardest to forget. Our findings show a threshold to the cognitive overload of the short-term memory in terms of type and number of elements in an ME, where the recall rapidly decreases. The increase in the number of errors is affected by the increase in complexity; however, it is significantly higher in the Auditory modality than in the other two. Therefore, segmenting a math expression into smaller parts will benefit the ability of the blind reader to retain it in memory while studying.