Multimodal Technol. Interact.最新文献

{"title":"Data as a Resource for Designing Digitally Enhanced Consumer Packaged Goods","authors":"G. Berumen, J. Fischer, M. Baumers","doi":"10.3390/mti6110101","DOIUrl":"https://doi.org/10.3390/mti6110101","url":null,"abstract":"The incorporation of digital functionalities into consumer packaged goods (CPG) has the potential to improve our lives by supporting us in our daily practises. However, despite the increasing availability of data about their use, research is needed to explore how these data can be harnessed to create such digital enhancements. This paper explores how consumers can utilise data about interactions with CPGs to conceptualise their enhanced versions. We devised a data-inspired ideation approach, using data visualisations and design cards to facilitate the conceptualisation of enhanced CPGs. Analysing the role of data as expressed through participants’ comments and designs, we found that data served as a basis for the creation of unique concepts imbued with greater consideration for the experiences of others and attention to their own interests. Our study shows the value of empowering consumers through data to broaden and inform their contributions towards the creation of smart products.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123486115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Effects of Cognitive Behavioral Stress Management Delivered by a Virtual Human, Teletherapy, and an E-Manual on Psychological and Physiological Outcomes in Adult Women: An Experimental Test","authors":"Kate Loveys, M. Antoni, L. Donkin, Mark Sagar, William Xu, E. Broadbent","doi":"10.3390/mti6110099","DOIUrl":"https://doi.org/10.3390/mti6110099","url":null,"abstract":"Technology may expand the reach of stress management to broader populations. However, issues with engagement can reduce intervention effectiveness. Technologies with highly social interfaces, such as virtual humans (VH), may offer advantages in this space. However, it is unclear how VH compare to telehealth and e-manuals at delivering psychological interventions. This experiment compared the effects of single laboratory session of Cognitive Behavioral Stress Management (CBSM) delivered by a VH (VH-CBSM), human telehealth (T-CBSM), and an e-manual (E-CBSM) on psychological and physiological outcomes in a community sample of stressed adult women. A pilot randomized controlled trial (RCT) with a parallel, mixed design was conducted. Adult women (M age =43.21, SD = 10.70) who self-identified as stressed were randomly allocated to VH-CBSM, T-CBSM, or E-CBSM involving one 90 min session and homework. Perceived stress, stress management skills, negative affect, optimism, relaxation, and physiological stress were measured. Mixed factorial ANOVAs and pairwise comparisons with Bonferroni correction investigated main and interaction effects of time and condition. Participants’ data (N = 38) were analysed (12 = VH-CBSM; 12 = T-CBSM; 14 = E-CBSM). Each condition significantly improved stress, negative affect, optimism, relaxation, and physiological stress over time with large effect sizes. No significant differences were found between conditions on outcomes. Overall, all three technologies showed promise for remotely delivering CBSM in a controlled setting. The findings suggest feasibility of the VH-CBSM delivery approach and support conducting a fully powered RCT to examine its effectiveness when delivering a full 10-week CBSM intervention.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128280409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Effect of Arm Pivot Joints on Stiffness Discrimination in Haptic Environments","authors":"Khan Hafiz, Ernur Karadoğan","doi":"10.3390/mti6110098","DOIUrl":"https://doi.org/10.3390/mti6110098","url":null,"abstract":"We investigated the effect of arm pivot joints that are typically used during haptic exploration by evaluating four joints of the human arm (metacarpophalangeal joint of the index finger, wrist, elbow, and shoulder joints). Using a virtual stiffness discrimination task, a four-session psychophysical experiment was conducted with 38 participants (25 male and 13 female); each session was conducted with one of the four joints as the pivot joint during haptic exploration. The participants were asked to judge the stiffness of the top surface of two computer-generated cylinders by determining the stiffer one while using their dominant hand’s index finger. A two-alternative forced-choice procedure was employed by assigning one cylinder a constant stiffness value of 1.0 N/mm (standard side) and the remaining cylinder a variable stiffness value (comparison side). Using a custom-made stylus for the Geomagic TouchTM (3D Systems, Inc., Rock Hill, SC, USA) haptic interface, the participants were able to feel the stiffness of these virtual surfaces only with their index fingers. It was observed that the average Weber fraction monotonically decreased as the pivot joint shifted toward the torso (i.e., a shift from the metacarpophalangeal joint to the shoulder joint); this decrease was not statistically significant, which suggests that the selection of the pivot joint was not a determining factor for the sensitivity to discriminate stiffness. In general, the palpation speed and force exerted by the participants on the standard side during the haptic exploration showed a tendency to increase when the pivot joint shifted toward the torso; the difference in average palpation speed and force across the pivot joints was not statistically significant.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"62 7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131390043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Collaborative Design in Kinetic Performance: Safeguarding the Uilleann Pipes through Inertial Motion Capture","authors":"Philip I. Morris, Joan Ramon Rodríguez-Amat","doi":"10.3390/mti6110097","DOIUrl":"https://doi.org/10.3390/mti6110097","url":null,"abstract":"This paper explores the possibilities of motion capture as a tool to preserve and study Intangible Cultural Heritage (ICH) practices such as playing instruments. The Uilleann pipes are both an instrument and a culture with a now strong community following and recovering after being almost extinguished several times in Ireland. The playing and making of the Uilleann pipes was incorporated into the Representative list of the UNESCO Convention of Intangible Cultural Heritage in 2017. This experience was performed in collaboration with several Uillean pipe players who contributed at every stage of the performance recording with comments and orientation. Some of these comments were also later formally kept as interviews to the players. The technical capture of the movements was done using a Rokoko Smart suit and paired Smart gloves which the piper wears for the performance. The resulting motion file was then cleaned and redirected to Blender 3D, a community made software package that allows the incorporation of a renderable avatar that helps for the dissemination of the performance. This recording process, called Inertial system, allows performers to perform almost anywhere and to capture the movements of the players with good accuracy. This process of recording and collaboration with the community is a cost-effective solution that can be of particular interest for scholars as well as for cultural communities wishing to archive these practices quickly. This design of technology and collaborative recording allows for a round experience that combined the detail of the technically enhanced recording with the interpretive nuance of the player that enriches the capturing process with mentions to how it is ‘relatively’ comfortable for the player and how efficient it is in terms of resulting detail. This collaboratively designed experience also provides the three aspects of intangible heritage preservation: supports the community -who can learn from the resulting animation; helps situating the practice within the cultural practice of the community-as they are part of the process; and helps materialise the output permitting its digital cataloguing, archival, and storage.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126938821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Techno-Concepts for the Cultural Field: n-Dimensional Space and Its Conceptual Constellation","authors":"Nuria Rodríguez-Ortega","doi":"10.3390/mti6110096","DOIUrl":"https://doi.org/10.3390/mti6110096","url":null,"abstract":"This paper advocates an epistemological turn in the field of digital art history and cultural heritage studies. This epistemological turn is understood as the elaboration of a new (or renewed) epistemic apparatus that allows us to understand and interpret cultural phenomena from the perspective of a different order of thought. This epistemological labor is conceived of as an «epistemological technical practice», which means integrating epistemological reflection and production into technical making and design. Within this framework of discussion, this paper introduces the idea of a techno-concept, which is defined as a co-production between the machine rationale and the human thought/imagination. As particular cases, this paper argues that the mathematical concepts of n-dimensional, vector and latent spaces constitute examples of techno-concepts that can be reappropriated and reworked for cultural analysis and interpretation. This paper offers a preliminary inquiry, in which certain epistemological propositions are exposed as open gates for further discussions.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133434187","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Invisible but Understandable: In Search of the Sweet Spot between Technology Invisibility and Transparency in Smart Spaces and Beyond","authors":"S. Diefenbach, Lara Christoforakos, Daniel Ullrich, A. Butz","doi":"10.3390/mti6100095","DOIUrl":"https://doi.org/10.3390/mti6100095","url":null,"abstract":"Smart technology is already present in many areas of everyday life. People rely on algorithms in crucial life domains such as finance and healthcare, and the smart car promises a more relaxed driving experience—all the while, the technology recedes further into the background. The smarter the technology, the more intransparent it tends to become. Users no longer understand how the technology works, what its limits are, and what consequences regarding autonomy and privacy emerge. Both extremes, total invisibility and total transparency, come with specific challenges and do not form reasonable design goals. This research explores the potential tension between smart and invisible versus transparent and understandable technology. We discuss related theories from the fields of explainable AI (XAI) as well as trust psychology, and then introduce transparency in smart spaces as a special field of application. A case study explores specific challenges and design approaches through the example of a so-called room intelligence (RI), i.e., a special kind of smart living room. We conclude with research perspectives for more general design approaches and implications for future research.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"633 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123277244","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf Smartphones","authors":"Teo Babic, Harald Reiterer, M. Haller","doi":"10.3390/mti6100094","DOIUrl":"https://doi.org/10.3390/mti6100094","url":null,"abstract":"Over decades, many researchers developed complex in-lab systems with the overall goal to track multiple body parts of the user for a richer and more powerful 2D/3D interaction with a distant display. In this work, we introduce a novel smartphone-based tracking approach that eliminates the need for complex tracking systems. Relying on simultaneous usage of the front and rear smartphone cameras, our solution enables rich spatial interactions with distant displays by combining touch input with hand-gesture input, body and head motion, as well as eye-gaze input. In this paper, we firstly present a taxonomy for classifying distant display interactions, providing an overview of enabling technologies, input modalities, and interaction techniques, spanning from 2D to 3D interactions. Further, we provide more details about our implementation—using off-the-shelf smartphones. Finally, we validate our system in a user study by a variety of 2D and 3D multimodal interaction techniques, including input refinement.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123703017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Scare-Away Risks: The Effects of a Serious Game on Adolescents' Awareness of Health and Security Risks in an Italian Sample","authors":"Francesca D’Errico, Paolo Giovanni Cicirelli, C. Papapicco, R. Scardigno","doi":"10.3390/mti6100093","DOIUrl":"https://doi.org/10.3390/mti6100093","url":null,"abstract":"Digital games can be defined as games supported by audiovisual apparatus and based on storytelling. This work aims to frame video games in the recent perspective offered by positive psychology and focuses on risk perception and on the promotion of protective behaviors in adolescent students, by means of a new Italian ad hoc created digital game named ‘Scare-away risks’ (Scacciarischi). In its storytelling, the different characters must defeat monsters that symbolically represent potential risks in home, school and work contexts. On this basis, the present study assumes that playing video games, as an engaging and motivating activity, can improve the adolescents’ psychological perception of home, school and work risks. To verify these hypotheses, a quasi-experiment comparing students who played Scacciarischi (experimental group) with a control group was conducted. At the end of the game, a questionnaire was administered to 149 participants, balanced for gender, investigating (a) the level of engagement during the game, (b) the perceived risks, (c) the locus of control, (d) the protective behavior intentions. The results showed that playing Scacciarischi is related to higher levels of engagement, internal locus of control, risk perception and protective behavioral intentions. In addition, both engagement and internal locus of control act as precursors of the other two variables. Finally, reflections about the importance of the engaging experience of Scacciarischi in the domain of safety, prevention and health issues are proposed.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"04 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131334423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Are the Instructions Clear? Evaluating the Visual Characteristics of Augmented Reality Content for Remote Guidance","authors":"Bernardo Marques, Carlos Ferreira, S. Silva, Andreia Santos, Paulo Dias, B. Santos","doi":"10.3390/mti6100092","DOIUrl":"https://doi.org/10.3390/mti6100092","url":null,"abstract":"Augmented Reality (AR) solutions are emerging in multiple scenarios of application as Industry 4.0 takes shape. In particular, for remote collaboration, flexible mechanisms such as authoring tools can be used to generate instructions and assist human operators as they experience increased complexity in their daily tasks. In addition to the traditional handicap of ensuring instructions can be intuitively created without having to understand complicated AR concepts, another relevant topic is the fact that the quality of said instructions is not properly analyzed prior to the tools being evaluated. This means that the characteristics of the visual content are not adequately assessed beforehand. Hence, it is essential to be aware of the cognitive workload associated with AR instructions to assert if they can be easily understood and accepted before being deployed in real-world scenarios. To address this, we focused on AR during sessions of remote guidance. Based on a participatory process with domain experts from the industry sector, a prototype for creating AR-based instructions was developed, and a user study with two parts was conducted: (1) first, a set of step-by-step instructions was produced, and their visual characteristics were evaluated by 129 participants based on a set of relevant dimensions; (2) afterward, these instructions were used by nine participants to understand if they could be used to assist on-site collaborators during real-life remote maintenance tasks. The results suggest that the AR instructions offer low visual complexity and considerable visual impact, clarity, and directed focus, thus improving situational understanding and promoting task resolution.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129521928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A Dialogue System That Models User Opinions Based on Information Content","authors":"Yoshiki Ohira, Takahisa Uchida, T. Minato, H. Ishiguro","doi":"10.3390/mti6100091","DOIUrl":"https://doi.org/10.3390/mti6100091","url":null,"abstract":"When designing rule-based dialogue systems, the need for the creation of an elaborate design by the designer is a challenge. One way to reduce the cost of creating content is to generate utterances from data collected in an objective and reproducible manner. This study focuses on rule-based dialogue systems using survey data and, more specifically, on opinion dialogue in which the system models the user. In the field of opinion dialogue, there has been little study on the topic of transition methods for modeling users while maintaining their motivation to engage in dialogue. To model them, we adopted information content. Our contribution includes the design of a rule-based dialogue system that does not require an elaborate design. We also reported an appropriate topic transition method based on information content. This is confirmed by the influence of the user’s personality characteristics. The content of the questions gives the user a sense of the system’s intention to understand them. We also reported the possibility that the system’s rational intention contributes to the user’s motivation to engage in dialogue with the system.","PeriodicalId":408374,"journal":{"name":"Multimodal Technol. Interact.","volume":"41 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113939257","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}