Single-sensor multispeaker listening with acoustic metamaterials

Proc Natl Acad Sci U S A. 2015 Aug 25;112(34):10595-8. doi: 10.1073/pnas.1502276112. Epub 2015 Aug 10.

Abstract

Designing a "cocktail party listener" that functionally mimics the selective perception of a human auditory system has been pursued over the past decades. By exploiting acoustic metamaterials and compressive sensing, we present here a single-sensor listening device that separates simultaneous overlapping sounds from different sources. The device with a compact array of resonant metamaterials is demonstrated to distinguish three overlapping and independent sources with 96.67% correct audio recognition. Segregation of the audio signals is achieved using physical layer encoding without relying on source characteristics. This hardware approach to multichannel source separation can be applied to robust speech recognition and hearing aids and may be extended to other acoustic imaging and sensing applications.

Keywords: cocktail party problem; compressive sensing; metamaterials.

Publication types

  • Research Support, Non-U.S. Gov't
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Acoustics / instrumentation*
  • Acrylic Resins*
  • Auditory Perception
  • Butadienes*
  • Computer Simulation
  • Equipment Design
  • Feedback, Sensory
  • Hearing Aids*
  • Humans
  • Manufactured Materials
  • Materials Testing
  • Models, Theoretical
  • Phonetics
  • Polystyrenes*
  • Printing, Three-Dimensional
  • Signal Processing, Computer-Assisted*
  • Sound Localization*
  • Speech Recognition Software

Substances

  • Acrylic Resins
  • Butadienes
  • Polystyrenes
  • ABS resin