Ray-Space constrained multichannel Nonnegative Matrix Factorization for Audio Source Separation

*Abstract* — Non-negative matrix factorization (NMF) has been widely adopted for the blind separation of acoustic sources. In the context of VR and AR applications, when several microphones are available the adoption of sound field representations such as spherical harmonics or ray space is shown to be effective in the NMF context. In this work, we propose a dictionary-based NMF-based model considering ray-space-transformed signals. The novelty of this approach is to account for the explicit modelling of the frequency dependency of the sound propagation from the source positions to the sensors. Spatially-constrained approaches aim at exploiting spatial information to improve the separation performance; however, they may not take advantage of possible priors given by representations of the data. The proposed approach allows us to exploit the source location model of the Ray Space through a predefined frequency-dependent dictionary of Ray Space patterns. Results demonstrate the competitive performance of the proposed method with respect to state-of- the-art NMF-based algorithms using real recordings.

Index Terms — Ray Space, Non-negative matrix factorization (NMF), blind source separation (BSS), microphone array pro- cessing

This work has been funded by “REPERTORIUM project. Grant agreement number 101095065. Horizon Europe. Cluster II. Culture, Creativity and Inclusive Society. Call HORIZON-CL2–2022-HERITAGE-01–02”, by the Universidad de Málaga under project “Ayudas para la movilidad y perfeccionamiento del personal investigador y difusio ́n de la actividad investigadora” and under project “Ayudas para proyectos dirigidos por jo ́venes investigadores” with grant reference “B1–2023 035”, and by the European Union under the Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU, partnership on “Telecommunications of the Future” (PE00000001 — program “RESTART”).

Read the whole article here on Repertorium’s website: https://repertorium.eu/dissemination/?_gl=11vprj3i_up*MQ