This paper addresses a localization system which is based on a combination of information from two modalities: a Smart Home Person Tracking (SHPT) composed of infrared sensors and an Audio Person Tracking (APT) which uses microphones able to estimate azimuth of acoustic sources. This combination improves precision of localization compared to a standalone or separated module. The localization software facilitates the integration of both SHPT and APT systems, to display the position in real time, to record data and detect some distress situations (some kind of fall). Results on implementation show good adaptation for Smart Home environments and a robust detection.