Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology最新文献_第9页

CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling CodeToon:故事构思，自动漫画生成，以及代码驱动故事叙述的结构映射

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-27 DOI: 10.1145/3526113.3545617

Sangho Suh, Jian Zhao

引用次数: 10

CrossA11y: Identifying Video Accessibility Issues via Cross-modal Grounding 交叉:通过跨模式接地识别视频可访问性问题

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-23 DOI: 10.1145/3526113.3545703

Xingyu Bruce Liu, Ruolin Wang, Dingzeyu Li, Xiang 'Anthony' Chen, Amy Pavel

{"title":"CrossA11y: Identifying Video Accessibility Issues via Cross-modal Grounding","authors":"Xingyu Bruce Liu, Ruolin Wang, Dingzeyu Li, Xiang 'Anthony' Chen, Amy Pavel","doi":"10.1145/3526113.3545703","DOIUrl":"https://doi.org/10.1145/3526113.3545703","url":null,"abstract":"Authors make their videos visually accessible by adding audio descriptions (AD), and auditorily accessible by adding closed captions (CC). However, creating AD and CC is challenging and tedious, especially for non-professional describers and captioners, due to the difficulty of identifying accessibility problems in videos. A video author will have to watch the video through and manually check for inaccessible information frame-by-frame, for both visual and auditory modalities. In this paper, we present CrossA11y, a system that helps authors efficiently detect and address visual and auditory accessibility issues in videos. Using cross-modal grounding analysis, CrossA11y automatically measures accessibility of visual and audio segments in a video by checking for modality asymmetries. CrossA11y then displays these segments and surfaces visual and audio accessibility issues in a unified interface, making it intuitive to locate, review, script AD/CC in-place, and preview the described and captioned video immediately. We demonstrate the effectiveness of CrossA11y through a lab study with 11 participants, comparing to existing baseline.","PeriodicalId":200048,"journal":{"name":"Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130663099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 9

DualVoice: Speech Interaction that Discriminates between Normal and Whispered Voice Input DualVoice:区分正常和低语语音输入的语音交互

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-22 DOI: 10.1145/3526113.3545685

J. Rekimoto

{"title":"DualVoice: Speech Interaction that Discriminates between Normal and Whispered Voice Input","authors":"J. Rekimoto","doi":"10.1145/3526113.3545685","DOIUrl":"https://doi.org/10.1145/3526113.3545685","url":null,"abstract":"Interactions based on automatic speech recognition (ASR) have become widely used, with speech input being increasingly utilized to create documents. However, as there is no easy way to distinguish between commands being issued and text required to be input in speech, misrecognitions are difficult to identify and correct, meaning that documents need to be manually edited and corrected. The input of symbols and commands is also challenging because these may be misrecognized as text letters. To address these problems, this study proposes a speech interaction method called DualVoice, by which commands can be input in a whispered voice and letters in a normal voice. The proposed method does not require any specialized hardware other than a regular microphone, enabling a complete hands-free interaction. The method can be used in a wide range of situations where speech recognition is already available, ranging from text input to mobile/wearable computing. Two neural networks were designed in this study, one for discriminating normal speech from whispered speech, and the second for recognizing whisper speech. A prototype of a text input system was then developed to show how normal and whispered voice can be used in speech text input. Other potential applications using DualVoice are also discussed.","PeriodicalId":200048,"journal":{"name":"Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology","volume":"244 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134084888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries 超越文本生成:支持作家连续自动文本摘要

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-19 DOI: 10.1145/3526113.3545672

Hai Dang, Karim Benharrak, Florian Lehmann, D. Buschek

引用次数: 25

TangibleGrid: Tangible Web Layout Design for Blind Users 有形网格:盲人用户的有形网页布局设计

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-17 DOI: 10.1145/3526113.3545627

Jiasheng Li, Zeyu Yan, Ebrima Jarjue, Ashrith Shetty, Huaishu Peng

引用次数: 10

Fibercuit: Prototyping High-Resolution Flexible and Kirigami Circuits with a Fiber Laser Engraver 光纤电路:用光纤激光雕刻机制作高分辨率柔性和Kirigami电路的原型

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-17 DOI: 10.1145/3526113.3545652

Zeyu Yan, Anup Sathya, Sahra Yusuf, Jyh-Ming Lien, Huaishu Peng

引用次数: 8

FeedLens: Polymorphic Lenses for Personalizing Exploratory Search over Knowledge Graphs FeedLens:用于个性化知识图谱探索性搜索的多态透镜

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-16 DOI: 10.1145/3526113.3545631

Harmanpreet Kaur, Doug Downey, Amanpreet Singh, Evie (Yu-Yen) Cheng, Daniel S. Weld, Jonathan Bragg

{"title":"FeedLens: Polymorphic Lenses for Personalizing Exploratory Search over Knowledge Graphs","authors":"Harmanpreet Kaur, Doug Downey, Amanpreet Singh, Evie (Yu-Yen) Cheng, Daniel S. Weld, Jonathan Bragg","doi":"10.1145/3526113.3545631","DOIUrl":"https://doi.org/10.1145/3526113.3545631","url":null,"abstract":"The vast scale and open-ended nature of knowledge graphs (KGs) make exploratory search over them cognitively demanding for users. We introduce a new technique, polymorphic lenses, that improves exploratory search over a KG by obtaining new leverage from the existing preference models that KG-based systems maintain for recommending content. The approach is based on a simple but powerful observation: in a KG, preference models can be re-targeted to recommend not only entities of a single base entity type (e.g., papers in the scientific literature KG, products in an e-commerce KG), but also all other types (e.g., authors, conferences, institutions; sellers, buyers). We implement our technique in a novel system, FeedLens, which is built over Semantic Scholar, a production system for navigating the scientific literature KG. FeedLens reuses the existing preference models on Semantic Scholar—people’s curated research feeds—as lenses for exploratory search. Semantic Scholar users can curate multiple feeds/lenses for different topics of interest, e.g., one for human-centered AI and another for document embeddings. Although these lenses are defined in terms of papers, FeedLens re-purposes them to also guide search over authors, institutions, venues, etc. Our system design is based on feedback from intended users via two pilot surveys (n = 17 and n = 13, respectively). We compare FeedLens and Semantic Scholar via a third (within-subjects) user study (n = 15) and find that FeedLens increases user engagement while reducing the cognitive effort required to complete a short literature review task. Our qualitative results also highlight people’s preference for this more effective exploratory search experience enabled by FeedLens.","PeriodicalId":200048,"journal":{"name":"Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122663460","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Scholastic: Graphical Human-AI Collaboration for Inductive and Interpretive Text Analysis 学术:用于归纳和解释文本分析的图形人机协作

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-12 DOI: 10.1145/3526113.3545681

Matt-Heun Hong, Lauren A. Marsh, Jessica L. Feuston, Joan H Ruppert, Jed R. Brubaker, D. Szafir

{"title":"Scholastic: Graphical Human-AI Collaboration for Inductive and Interpretive Text Analysis","authors":"Matt-Heun Hong, Lauren A. Marsh, Jessica L. Feuston, Joan H Ruppert, Jed R. Brubaker, D. Szafir","doi":"10.1145/3526113.3545681","DOIUrl":"https://doi.org/10.1145/3526113.3545681","url":null,"abstract":"Interpretive scholars generate knowledge from text corpora by manually sampling documents, applying codes, and refining and collating codes into categories until meaningful themes emerge. Given a large corpus, machine learning could help scale this data sampling and analysis, but prior research shows that experts are generally concerned about algorithms potentially disrupting or driving interpretive scholarship. We take a human-centered design approach to addressing concerns around machine-assisted interpretive research to build Scholastic, which incorporates a machine-in-the-loop clustering algorithm to scaffold interpretive text analysis. As a scholar applies codes to documents and refines them, the resulting coding schema serves as structured metadata which constrains hierarchical document and word clusters inferred from the corpus. Interactive visualizations of these clusters can help scholars strategically sample documents further toward insights. Scholastic demonstrates how human-centered algorithm design and visualizations employing familiar metaphors can support inductive and interpretive research methodologies through interactive topic modeling and document clustering.","PeriodicalId":200048,"journal":{"name":"Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology","volume":"140 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123343889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 8

Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UI 素描现实:素描虚拟和物理世界之间的双向交互与AR和驱动的有形用户界面

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-12 DOI: 10.1145/3526113.3545626

Hiroki Kaimoto, Kyzyl Monteiro, Mehrad Faridan, Jiatong Li, Samin Farajian, Yasuaki Kakehi, Ken Nakagaki, R. Suzuki

{"title":"Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UI","authors":"Hiroki Kaimoto, Kyzyl Monteiro, Mehrad Faridan, Jiatong Li, Samin Farajian, Yasuaki Kakehi, Ken Nakagaki, R. Suzuki","doi":"10.1145/3526113.3545626","DOIUrl":"https://doi.org/10.1145/3526113.3545626","url":null,"abstract":"This paper introduces Sketched Reality, an approach that combines AR sketching and actuated tangible user interfaces (TUI) for bi-directional sketching interaction. Bi-directional sketching enables virtual sketches and physical objects to “affect” each other through physical actuation and digital computation. In the existing AR sketching, the relationship between virtual and physical worlds is only one-directional — while physical interaction can affect virtual sketches, virtual sketches have no return effect on the physical objects or environment. In contrast, bi-directional sketching interaction allows the seamless coupling between sketches and actuated TUIs. In this paper, we employ tabletop-size small robots (Sony Toio) and an iPad-based AR sketching tool to demonstrate the concept. In our system, virtual sketches drawn and simulated on an iPad (e.g., lines, walls, pendulums, and springs) can move, actuate, collide, and constrain physical Toio robots, as if virtual sketches and the physical objects exist in the same space through seamless coupling between AR and robot motion. This paper contributes a set of novel interactions and a design space of bi-directional AR sketching. We demonstrate a series of potential applications, such as tangible physics education, explorable mechanism, tangible gaming for children, and in-situ robot programming via sketching.","PeriodicalId":200048,"journal":{"name":"Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123785419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13

RealityTalk: Real-Time Speech-Driven Augmented Presentation for AR Live Storytelling RealityTalk:实时语音驱动的增强演示，用于AR现场讲故事

Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology Pub Date : 2022-08-12 DOI: 10.1145/3526113.3545702

Jian Liao, Adnan Karim, S. Jadon, Rubaiat Habib Kazi, Ryo Suzuki

引用次数: 17