Hearable devices with sound bubbles

IF 33.7 1区工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC

Nature Electronics Pub Date : 2024-11-14 DOI:10.1038/s41928-024-01276-z

Tuochao Chen, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

引用次数: 0

Abstract

The human auditory system has a limited ability to perceive distance and distinguish speakers in crowded settings. A headset technology that can create a sound bubble in which all speakers within the bubble are audible but speakers and noise outside the bubble are suppressed could augment human hearing. However, developing such technology is challenging. Here, we report an intelligent headset system capable of creating sound bubbles. The system is based on real-time neural networks that use acoustic data from up to six microphones integrated into noise-cancelling headsets and are run on the device, processing 8 ms audio chunks in 6.36 ms on an embedded central processing unit. Our neural networks can generate sound bubbles with programmable radii between 1 m and 2 m, and with output signals that reduce the intensity of sounds outside the bubble by 49 dB. With previously unseen environments and wearers, our system can focus on up to two speakers within the bubble, with one to two interfering speakers and noise outside the bubble.

Abstract Image

查看原文本刊更多论文

带有声音气泡的可听设备

在拥挤的环境中，人类听觉系统感知距离和分辨扬声器的能力有限。一种耳机技术可以产生一个声音气泡，气泡内的所有扬声器都可以听到，而气泡外的扬声器和噪音则被抑制，这种技术可以增强人类的听力。然而，开发这种技术具有挑战性。在此，我们报告了一种能够产生声泡的智能耳机系统。该系统基于实时神经网络，使用集成在降噪耳机中多达六个麦克风的声学数据，并在设备上运行，在嵌入式中央处理单元上以 6.36 毫秒的时间处理 8 毫秒的音频块。我们的神经网络可以生成半径在 1 米至 2 米之间的可编程声泡，其输出信号可将声泡外的声音强度降低 49 分贝。对于以前未见过的环境和佩戴者，我们的系统可以聚焦于气泡内最多两个扬声器，以及气泡外一到两个干扰扬声器和噪音。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Nature Electronics Engineering-Electrical and Electronic Engineering

CiteScore

47.50

自引率

2.30%

发文量

159

期刊介绍： Nature Electronics is a comprehensive journal that publishes both fundamental and applied research in the field of electronics. It encompasses a wide range of topics, including the study of new phenomena and devices, the design and construction of electronic circuits, and the practical applications of electronics. In addition, the journal explores the commercial and industrial aspects of electronics research. The primary focus of Nature Electronics is on the development of technology and its potential impact on society. The journal incorporates the contributions of scientists, engineers, and industry professionals, offering a platform for their research findings. Moreover, Nature Electronics provides insightful commentary, thorough reviews, and analysis of the key issues that shape the field, as well as the technologies that are reshaping society. Like all journals within the prestigious Nature brand, Nature Electronics upholds the highest standards of quality. It maintains a dedicated team of professional editors and follows a fair and rigorous peer-review process. The journal also ensures impeccable copy-editing and production, enabling swift publication. Additionally, Nature Electronics prides itself on its editorial independence, ensuring unbiased and impartial reporting. In summary, Nature Electronics is a leading journal that publishes cutting-edge research in electronics. With its multidisciplinary approach and commitment to excellence, the journal serves as a valuable resource for scientists, engineers, and industry professionals seeking to stay at the forefront of advancements in the field.