arXiv Science⌕ Search

arXiv · 2610.22936

AcousticAgent: A Floorplan-Centric Simulation Platform for Distributed Multi-Room Speech Processing

Abstract

Existing acoustic simulation tools either generate room impulse responses (RIRs) efficiently in parameterized rooms or rely on preconstructed three-dimensional scenes, making it difficult to build large numbers of editable residential multi-room environments. We present AcousticAgent, a floorplan-centric acoustic simulation platform that converts structured floorplans into editable, acoustically connected multi-room scenes. AcousticAgent jointly models room geometry and connectivity, furniture, materials, sound sources, and microphone configurations. A scene-oriented Acoustic Materials Database maps semantic elements to acoustic parameters, while a floorplan-aware hybrid geometrical-acoustics solver generates multichannel RIRs and reverberant audio. The platform also supports directional and moving sources, distributed microphones, and VLM-assisted scene construction from floorplan images and text. Using AcousticAgent, we construct FP-RIR, a dataset covering 15,376 residential floorplans with diverse room topologies, propagation conditions, and source--receiver configurations. We validate its acoustic fidelity against real-world measurements and evaluate whole-home source localization, speech enhancement, and far-field speech processing under single-device and distributed microphone settings. The results demonstrate the effectiveness of floorplan-aware modeling for large-scale residential acoustic simulation and the benefits of distributed spatial processing in multi-room environments. AcousticAgent and FP-RIR provide scalable and configurable resources for developing and evaluating residential speech systems.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Zhiqi Ai, Han Cheng, Shiyi Mu, Yongjin Zhou, Shugong Xu. 2026-10-16. AcousticAgent: A Floorplan-Centric Simulation Platform for Distributed Multi-Room Speech Processing. https://arxiv.org/abs/2610.22936

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

SpikeAid: A Streaming Spiking Hearing Aid Framework for Joint Noise Reduction and Wide Dynamic Range Compression

Modern hearing aids combine noise reduction (NR) with wide dynamic range compression (WDRC) to suppress background interference while compensating for the reduced auditory dynamic range associated with hearing loss. Conventional systems typically process NR and WDRC as separate stages, although the output of NR directly affects the signal levels and envelopes that determine subsequent compression. Recent end-to-end neural approaches can jointly optimize these processes, but their dense computation remains challenging for always-on hearing aids. In this work, we propose SpikeAid, a causal end-to-end spiking neural network (SNN) framework for joint NR and WDRC. SpikeAid consists of an NR-Net that constructs complementary speech and noise representations and a WDRC-Net that estimates the corresponding branch gains, with both components jointly optimized according to the final hearing aid objective. To capture the multiscale temporal structures required by joint NR and WDRC in a computationally efficient manner, we further introduce the Delayed Resonate-and-fire Neuron (DRN), which incorporates bio-inspired heterogeneous dendritic delays and resonating dynamics. Experimental results on the hearing aid task show that SpikeAid improves key objective metrics over cascaded processing and outperforms existing spiking speech-processing baselines. Evaluation on the public Intel Neuromorphic Deep Noise Suppression (N-DNS) Challenge further demonstrates state-of-the-art neuromorphic speech-denoising performance with DRN. Finally, we designed an FPGA-based neuromorphic hardware system for efficient deployment of SpikeAid, where it achieves over two orders of magnitude higher energy efficiency than conventional CPU/GPU implementations, demonstrating its potential for energy-efficient hearing aid applications.

eess.AS↗

Textual Echo Cancellation

In this paper, we propose Textual Echo Cancellation (TEC) - a framework for cancelling the text-to-speech (TTS) playback echo from overlapping speech recordings. Such a system can largely improve speech recognition performance and user experience for intelligent devices such as smart speakers, as the user can talk to the device while the device is still playing the TTS signal responding to the previous query. We implement this system by using a novel sequence-to-sequence model with multi-source attention that takes both the microphone mixture signal and source text of the TTS playback as inputs, and predicts the enhanced audio. Experiments show that the textual information of the TTS playback is critical to enhancement performance. Besides, the text sequence is much smaller in size compared with the raw acoustic signal of the TTS playback, and can be immediately transmitted to the device or ASR server even before the playback is synthesized. Therefore, our proposed approach effectively reduces Internet communication and latency compared with alternative approaches such as acoustic echo cancellation (AEC).

eess.AS↗

Towards Prosodically Informed Mizo TTS without Explicit Tone Markings

This paper reports on the development of a text-to-speech (TTS) system for Mizo, a low-resource tonal language of the Tibeto-Burman family, spoken primarily in the Indian state of Mizoram. The TTS was built using only 5.18 hours of data; however, based on subjective and objective evaluations, the outputs were considered perceptually acceptable and intelligible. A baseline Tacotron2 model was built, and then, using the same data, another TTS model was built with VITS. VITS achieved significantly lower Mel-Cepstral Distortion (MCD) and significantly higher subjective ratings than Tacotron2, although the differences in DNSMOS, F0 RMSE, and F0 correlation were not statistically significant. In terms of tone synthesis, the VITS model showed numerically lower tone errors than the Tacotron2 model. The paper demonstrates that a non-autoregressive, end-to-end framework can achieve synthesis of acceptable perceptual quality and intelligibility.

eess.AS↗