Body-Coupled-Driven Object-Oriented Natural Interactive Interface

Adv Mater. 2025 Nov;37(45):e07067. doi: 10.1002/adma.202507067. Epub 2025 Aug 21.

Abstract

The metaverse progressively demands heightened sophistication in human-multi-machine collaboration, accelerating development of hybrid immersive 2D tactile and 3D spatial perception interfaces. However, current interfaces struggle with the precision and adaptability in complex human-multi-machine interaction scenarios. This paper presents a transparent stretchable sensing interface synergizing 2D tactile and 3D spatial perception through body-coupled electromagnetic coupling. Its bi-modal coupling (resistive coupling and capacitive coupling) mechanism enables micrometer-scale 2D tactile sensing alongside broad 3D spatial perception (200 mm range). The contact mode achieves calligraphy-grade trajectory reconstruction (200 µm precision) with force tactile sensing, while the non-contact mode recognizes 38 gestures at 97.11% accuracy. The interface's mechanical transparency and elasticity permit seamless integration on curved surfaces (e.g., gloves and clothes) without perceptual interference. An object-oriented human-machine interaction (HMI) framework is developed to enable single-interface control of multiple devices through electromagnetic signature recognition, enhancing collaborative efficiency. This work can inspire designs of smart interfaces in intelligent healthcare monitoring, industrial robotics coordination, and cross-domain augmented reality applications.

Keywords: 3D spatial sensing; body‐coupled electromagnetic coupling; human‐machine interaction; tactile sensing; trajectory reconstruction.