Referring Phenomena in a Multimedia Context and their Computational Treatment on - ReferringPhenomena '97最新文献

筛选

英文中文

Constraints on the Use of Language, Gesture and Speech for Multimodal Dialogues 多模态对话中语言、手势和语音使用的限制

Referring Phenomena in a Multimedia Context and their Computational Treatment on - ReferringPhenomena '97 Pub Date : 1997-07-11 DOI: 10.3115/1621585.1621602

B. Gaiffe, Laurent Romary

{"title":"Constraints on the Use of Language, Gesture and Speech for Multimodal Dialogues","authors":"B. Gaiffe, Laurent Romary","doi":"10.3115/1621585.1621602","DOIUrl":"https://doi.org/10.3115/1621585.1621602","url":null,"abstract":"In the domain of natural language understanding and more precisely man-machine dialogue design, there are usually two trends of research which seem to be rather differentiated. On the one hand, many studies have tackled the problem of interpreting spatial references expressed in verbal utterances, focusing in particular on the different geometric or functionnal constraints which are bound to the existance of a 'source' (or site) element in relation to which a 'target' is being situated. Such studies are usually based upon fine grained linguistic descriptions for different languages (Vandeloise, 1986). On the other hand, the problem raised by the integration of a gestural mode within classical NL interfaces has yielded some specific research about the association of demonstrative or deictic Nps together with designations, as initited by Bolt some two decades ago (cf. Thorisson et alii, 1992; Bellalem and Romary, 1995). Our aim in this paper is to show that the different phenomena described in the context of spatial reference or multimodal interaction should not necessarily be considered as two independant issues, but should rather be analysed in a unified way to account for the fact that they are both based on linguistic and perceptual data.","PeriodicalId":339726,"journal":{"name":"Referring Phenomena in a Multimedia Context and their Computational Treatment on - ReferringPhenomena '97","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128394126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2