Binyang Song, Nicolas F. Soria Zurita, H. Nolte, H. Singh, J. Cagan, Christopher McComb
{"title":"Addressing Challenges to Problem Complexity: Effectiveness of AI Assistance During the Design Process","authors":"Binyang Song, Nicolas F. Soria Zurita, H. Nolte, H. Singh, J. Cagan, Christopher McComb","doi":"10.1115/detc2021-70467","DOIUrl":"https://doi.org/10.1115/detc2021-70467","url":null,"abstract":"\u0000 As Artificial Intelligence (AI) assistance tools become more ubiquitous in engineering design, it becomes increasingly necessary to understand the influence of AI assistance on the design process and design effectiveness. Previous work has shown the advantages of incorporating AI design agents to assist human designers. However, the influence of AI assistance on the behavior of designers during the design process is still unknown. This study examines the differences in participants’ design process and effectiveness with and without AI assistance during a complex drone design task using the HyForm design research platform. Data collected from this study is analyzed to assess the design process and effectiveness using quantitative methods, such as Hidden Markov Models and network analysis. The results indicate that AI assistance is most beneficial when addressing moderately complex objectives but exhibits a reduced advantage in addressing highly complex objectives. During the design process, the individual designers working with AI assistance employ a relatively explorative search strategy, while the individual designers working without AI assistance devote more effort to parameter design.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115355742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Influence of Different Representation of Requirements on Idea Generation: An Experimental Study","authors":"A. Patel, J. Summers, Sourabh Karmakar","doi":"10.1115/detc2021-70805","DOIUrl":"https://doi.org/10.1115/detc2021-70805","url":null,"abstract":"\u0000 The objective of this research is to understand how different representations of requirements influence idea generation in terms of quantity, addressment, sketch detail, novelty, and variety of conceptual sketches. Requirements are statements of need, desires, and wishes of the stakeholders that are used by engineers to frame the problem. Essentially, requirements are the raison d’etre for any engineering project. As the requirements document provides constraints and criteria for a design, it defines and determines the success of a project. While there is research studying the effect of requirements on the conceptual sketch, little study has focused one the impact of different requirement representations on solution development. An experimental study was conducted with 52 fourth year mechanical engineering undergraduate students. Two design problems were formulated with three different representations: a problem statement with embedded requirements, a problem statement and a traditional requirement list, and a problem statement with contextualized scrum stories. Each student was provided each design problems with two different representations of requirements. It was found that the use of contextualized scrum story representations significantly affected the conceptual sketch in the novelty of solution fragments and addressment of requirements, while no significant change in variety, sketch detail, and quantity was seen. Also, the contextualized representation positively affected all metrics but the sketch quantity. Finally, it was found that quantity is not directly related to the number of requirements addressed in the sketches.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126054350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-Modal Search for Inspirational Examples in Design","authors":"E. Kwon, Forrest Huang, K. Goucher-Lambert","doi":"10.1115/detc2021-71825","DOIUrl":"https://doi.org/10.1115/detc2021-71825","url":null,"abstract":"Inspirational stimuli are known to be effective in supporting ideation during the design process. However, minimal prior work has allowed individuals to search using multiple modes of input simultaneously, which is more representative of real design behavior. In the current work, we developed a multi-modal search platform that retrieves 3D model parts based on text, appearance, and function-based search inputs. This work presents the results of an experimental study (n = 21) in which the search platform was used to find parts identified as potentially useful for inspiring solutions to a design challenge. Participants were asked to engage with three different search modalities: search by keywords, by curated 3D parts, and by user-assembled 3D parts in their workspace. When searching by parts that are curated or in their workspace, additional control over the similarity of appearance and function of results in reference to the input was available to participants. The results of this study demonstrate that the modality used affects search behavior, such as in the frequency of searches, how participants engage with retrieved search results, and how broadly the search space is covered. Specific results link interactions with the interface to search strategies participants may have used during the task. Findings suggest that multi-modal search should enable intentional search for desired goals through direct search inputs (e.g., by keyword) and incremental adjustments to features of visually represented search inputs. Moreover, enabling discovery of inexplicitly searched for examples through related information or more randomly encountered examples may assist exploratory search behavior.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"191 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121733196","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
C. Cole, Jacqueline Marhefka, K. Jablokow, S. Mohammed, Sarah C. Ritter, Scarlett R. Miller
{"title":"Predicting a Paradigm Shift: Exploring the Relationship Between Cognitive Style and the Paradigm-Relatedness of Design Solutions","authors":"C. Cole, Jacqueline Marhefka, K. Jablokow, S. Mohammed, Sarah C. Ritter, Scarlett R. Miller","doi":"10.1115/detc2021-70909","DOIUrl":"https://doi.org/10.1115/detc2021-70909","url":null,"abstract":"\u0000 Nearly 60 years ago, Thomas Kuhn revolutionized how we think of scientific discovery and innovation when he identified that scientific change can occur in incremental developments that improve upon existing solutions, or it can occur as drastic change in the form of a paradigm shift. In engineering design, both types of scientific change are critical when exploring the solution space. However, most methods of examining design outputs look at whether an idea is creative or not and not the type of creativity that is deployed or if we can predict what types of individuals or teams is more likely to develop a paradigm-shifting idea. Without knowing how to identify who will generate ideas that fit a certain paradigm, we do not know how to build teams that can develop ideas that better explore the solution space. This study provides the first attempt at answering this question through an empirical study with 60 engineering design student teams over the course of a 4- and 8-week design project. Specifically, we sought to identify the role of cognitive style using KAI score, derived from Kirton’s Adaption-Innovation (A-I) theory, on the paradigm-relatedness of ideas generated by individuals and teams. We also sought to investigate the role of crowdsourcing for measuring the paradigm-relatedness of design solutions. The results showed that KAI was positively related to a greater likelihood of an individual’s idea being categorized as paradigm-breaking. In addition, the team KAI diversity was also linked to a greater likelihood of teams’ ideas being categorized as paradigm-challenging. Finally, the results support the use of crowdsourcing for measuring the paradigm-relatedness of design solutions.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125535010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aashay Mokadam, Shrikrishna Shivakumar, V. Viswanathan, Mahima Agumbe Suresh
{"title":"Online Product Review Analysis to Automate the Extraction of Customer Requirements","authors":"Aashay Mokadam, Shrikrishna Shivakumar, V. Viswanathan, Mahima Agumbe Suresh","doi":"10.1115/detc2021-71555","DOIUrl":"https://doi.org/10.1115/detc2021-71555","url":null,"abstract":"\u0000 The increasing use of online retail platforms has generated an enormous amount of textual data on the user experiences with these products in online reviews. These reviews provide a rich resource to elicit customer requirements for a category of products. The recent research has explored this possibility to some extent. The study reported here investigates the coding of publically available user reviews to understand customer sentiments on environmentally-friendly products. The manual review typically consists of a qualitative analysis of textual content, which is a resource-intensive process. An automated procedure based on Aspect-Based Sentiment Analysis (ABSA) is proposed and explored in this study. This procedure can be beneficial in analyzing reviews of products that belong to a specific category. As a case study, environmentally-friendly products are used. Manual content analysis and automated ABSA-based analysis are performed on the same review data to extract customer sentiments. The results show that we obtain over a 50% classification accuracy for a multiclass classification NLP task with a very elementary word vector-based model. The drop in accuracy (compared to human annotation) can be offset because an automated system is thousands of times faster than a human. Given enough data, it will perform better than its human counterpart in tasks on customer requirement modeling. We also discuss the future routes that can be taken to extend our system by leveraging more sophisticated paradigms and substantially improving our system’s performance.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132871573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Survey of Important Factors in Human - Artificial Intelligence Trust for Engineering System Design","authors":"Mostaan Lotfalian Saremi, A. E. Bayrak","doi":"10.1115/detc2021-70550","DOIUrl":"https://doi.org/10.1115/detc2021-70550","url":null,"abstract":"\u0000 Incorporating user trust in the development of intelligent systems is one of the new challenges in engineering design field. Trust in human-intelligent system interaction determines how much user relies on the system and directly influences the benefits that an intelligent system provides to human decision-making. This paper reviews the existing literature on trust in human-AI interaction to highlight key areas for engineering system design research to address the overarching issue of user trust in system development. We present how trust influences the use of an intelligent system, describe multiple contexts that users interact with intelligent systems and categorize ways in which trust is formed based on the literature. We classify the key factors that are critical in the formation of user trust in three categories of human user attributes, design of the intelligent system, and task characteristics. We also present the analytical models that exist in the literature used to evaluate and predict trust. This paper is not intended to be a thorough literature review but rather a position paper that provides a structure to the existing literature as a reference for engineering design research. We propose future directions for engineering system design community based on the gaps and open questions identified in the literature.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"76 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134456893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Effect of Dynamic Speed Information and Timing of Displaying EHMI on Automated Vehicle and Pedestrian Interactions","authors":"Jinjuan She, Marufa Islam, Feng Zhou","doi":"10.1115/detc2021-68319","DOIUrl":"https://doi.org/10.1115/detc2021-68319","url":null,"abstract":"\u0000 Pedestrian-AV (automated vehicle) interaction attracts a significant amount of attention in recent years. However, there are controversial opinions about whether an external human-machine interface (eHMI) that communicates AV’s intent is needed. The authors propose that vehicle built-in cues (e.g., dynamic speed information) and the timing of displaying eHMI when communicating an AV’s yielding intent are both important. An online study was conducted to understand the impact on a 2-way street with a marked but not signalized crosswalk. As predicted, pedestrians were more likely to cross, with higher trust in AV and perceived safety, when the eHMI was displayed earlier. Information of the AV’s decreasing speed did not have a significant effect on crossing decisions, however, it increased trust and perceived safety. In addition, eHMI did have a positive add-on effect on pedestrian’s trust in AV, especially when it was displayed earlier, in the scenarios that dynamic speed of an AV was visible. Moreover, both the timing of eHMI and dynamic speed information played a role in enhancing a pedestrian’s judgment consistency in the short period of the interaction with AV, i.e., viewing the approaching AV from 20 meters away until it stopped near the pedestrian. The study indicated that both information about the vehicle’s physical behavior (i.e., speed) and the eHMI are beneficial in pedestrian-AV communication. More in-depth virtual reality or field studies are needed to further validate the findings.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130732520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Lloyd, Almila Akdag Salah, Senthil K. Chandrasegaran
{"title":"How Designers Talk: Constructing and Analysing a Design Thinking Data Corpus","authors":"P. Lloyd, Almila Akdag Salah, Senthil K. Chandrasegaran","doi":"10.1115/detc2021-71200","DOIUrl":"https://doi.org/10.1115/detc2021-71200","url":null,"abstract":"\u0000 A necessary condition of understanding how designers work is understanding how designers talk. In this paper we show how new methods of linguistic data analysis are beginning to reveal insights into the general nature of design conversations. For the first time we combine design activity data collected over 30 years by the Design Thinking Research Symposium (DTRS) ‘shared data’ series into a single corpus. We apply emerging techniques of analysis on this corpus and explore word forms, expressions, topics, and themes related to the particularities of how designers talk. We describe three such methods: generating category network maps using the Linguistic Inquiry and Word Count (LIWC) system; semantic grouping of words using word embeddings and examining the distribution of these groups across the datasets, and custom text generation using an A1-based language modeller. In applying these methods, we show that exploring design activity data at the corpus level can reveal more general patterns of design talk and raise key questions and hypotheses for further study. We see these methods as a first step in developing an understanding of how people not considered to be designers (e.g., scientists, business people, politicians) talk in ways that might be considered ‘designerly’ [1].","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130767477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing Early Stage Design Sketches and Reflections on Prototyping","authors":"Madhurima Das, Maria C. Yang","doi":"10.1115/detc2021-66748","DOIUrl":"https://doi.org/10.1115/detc2021-66748","url":null,"abstract":"\u0000 Designers routinely create informal “thinking” sketches to explore a design space and “talking” sketches to communicate design ideas during the early phases of the design process. This study proposes a rubric for assessing the quality of novice designers’ early stage design sketches including line smoothness, proportion, and understandability. The study finds a positive correlation between sketch quality and understandability, which indicates the importance of sketch quality when using sketches as a communication tool. Results indicate that early stage sketch quantity is linked with design outcomes, though sketch quality does not have a strong correlation with design outcomes. The study also finds a link between frequency of sketching and having higher maximum sketch quality scores (i.e. at least one excellent sketch) as well as a correlation between individuals’ maximum sketch quality scores and their overall design outcomes. This study presents a new tool to capture what is learned by the designer after each iteration of a prototype. Preliminary results indicate that reflection on both the technical and emotional aspects of prototyping may be valuable and should be an area of further study. Finally, several results point to novice designers’ lack of consistent focus on users in their prototyping reflections and presentations.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128575803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ashish M. Chaudhari, E. Gralla, Z. Szajnfarber, Jitesh H. Panchal
{"title":"Co-Evolution of Communication and System Performance in Engineering Systems Design: A Stochastic Network-Behavior Dynamics Model","authors":"Ashish M. Chaudhari, E. Gralla, Z. Szajnfarber, Jitesh H. Panchal","doi":"10.1115/detc2021-71277","DOIUrl":"https://doi.org/10.1115/detc2021-71277","url":null,"abstract":"\u0000 The socio-technical perspective on engineering system design emphasizes the mutual dynamics between interdisciplinary interactions and system design outcomes. How different disciplines interact with each other depends on technical factors such as design interdependence and system performance. On the other hand, the design outcomes are influenced by social factors such as the frequency of interactions and their distribution. Understanding this co-evolution can lead to not only better behavioral insights, but also efficient communication pathways. In this context, we investigate how to quantify the temporal influences of social and technical factors on interdisciplinary interactions and their influence on system performance. We present a stochastic network-behavior dynamics model that quantifies the design interdependence, discipline-specific interaction decisions, the evolution of system performance, as well as their mutual dynamics. We employ two datasets, one of student subjects designing an automotive engine and the other of NASA engineers designing a spacecraft. Then, we apply statistical Bayesian inference to estimate model parameters and compare insights across the two datasets. The results indicate that design interdependence and social network statistics both have strong positive effects on interdisciplinary interactions for the expert and student subjects alike. For the student subjects, an additional modulating effect of system performance on interactions is observed. Inversely, the total number of interactions, irrespective of their discipline-wise distribution, has a weak but statistically significant positive effect on system performance in both cases. However, excessive interactions mirrored with design interdependence and inflexible design space exploration reduce system performance. These insights support the case for open organizational boundaries as a way for increasing interactions and improving system performance.","PeriodicalId":261968,"journal":{"name":"Volume 6: 33rd International Conference on Design Theory and Methodology (DTM)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120960499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}