SubRoformer: Subband Time-Domain Representation for Music Source Separation
Abstract
Music source separation extracts vocals and instruments from a mixed recording, enabling remixing, content production, and music analysis. Existing systems commonly operate on waveforms or full-band spectrograms. Waveform inputs contain many samples even in short segments, whereas a single spectrogram resolution imposes a shared time-frequency resolution trade-off across frequency ranges. We propose SubRoFormer, a Transformer-based system comprising a subband module and a residual RoFormer module. The subband module decomposes the mixture into frequency-localized, lower-rate signals for separation. It then reconstructs the target waveforms from the estimated subbands. The residual RoFormer module models temporal and cross-band relationships on temporally compressed features. It combines this context with fine-rate features through gated residual fusion to estimate source-specific complex masks. On the MUSDB18-HQ test set, training only on MUSDB18-HQ yields an average signal-to-distortion ratio (SDR) of 10.63 dB across four stems using target-specific models, achieving state-of-the-art performance among the compared systems without extra training data. With 500 additional training songs, a single model jointly separating all four stems achieves an average SDR of 11.59 dB, establishing state-of-the-art performance among the compared single-model multi-stem systems trained with extra data. Code and checkpoints are released at https://github.com/ArchiMickey/SubRoformer.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
SubRoFormer introduces a subband time-domain representation that effectively resolves the time-frequency resolution trade-off in music source separation, achieving state-of-the-art performance on MUSDB18-HQ with improved parameter efficiency. The paper demonstrates a rigorous integration of signal processing principles with Transformer-based architectures, providing a robust and reproducible framework for high-fidelity audio separation.
Methodology
The paper proposes SubRoFormer, a hybrid architecture that combines a fixed subband time-domain frontend with a residual RoFormer separator. The frontend decomposes the mixture into frequency-localized, lower-rate complex baseband signals using a triangular filter bank, demodulation, and decimation. This addresses the resolution trade-off of full-band STFTs by allowing different frequency resolutions. The separator operates on local STFTs of these subbands, using a temporally patched axial RoFormer to model long-range dependencies while retaining fine-rate features via a skip connection. A GEGLU fusion module combines the coarse-rate context with fine-rate features to predict complex masks. The method is mathematically sound, leveraging standard signal processing principles (Nyquist, polyphase implementation) to ensure efficient and near-perfect reconstruction of the subbands before separation. The use of a fixed, non-learned frontend is a deliberate design choice to isolate the separation task from representation learning, which is a valid and rigorous approach.
Results & evaluation
The experiments are conducted on the MUSDB18-HQ dataset, the standard benchmark for music source separation. The paper reports state-of-the-art results, achieving 10.63 dB average SDR with target-specific models and 11.59 dB with a single multi-stem model using extra data. The ablation studies are thorough, examining the impact of the subband frontend, temporal patching, and fusion mechanisms. The paper also provides a detailed analysis of the reconstruction quality of the subband frontend, showing it introduces minimal distortion compared to the STFT. The comparisons are fair, using the same training data and augmentation policies as baselines where possible. The inclusion of parameter efficiency comparisons is a strong point, showing that the method achieves high performance with fewer parameters than some baselines.
Reproducibility
The paper provides high reproducibility. Code and checkpoints are released on GitHub. The implementation details, including filter bank specifications, training hyperparameters, and augmentation policies, are described in detail. The use of standard libraries (SciPy for FIR filters) and common frameworks (PyTorch implied by the architecture) further enhances reproducibility. The paper clearly distinguishes between the fixed frontend and the learned separator, making it easier to replicate the system.
Limitations
The primary limitation is the computational cost of the subband frontend, although the polyphase implementation mitigates this. The method relies on a fixed filter bank, which may not be optimal for all types of music or sources. The paper does not extensively discuss the impact of the subband count and bandwidth on separation performance, only providing a single ablation with 64 subbands. The use of an internal dataset of 500 songs for the extra-data experiments limits the generalizability of those results, as the dataset is not publicly available. The paper also does not provide subjective listening tests, which are important for evaluating the perceptual quality of separated stems.
Broader impact
The proposed method has significant potential for applications in music production, remixing, and audio restoration. The ability to separate stems with high fidelity and efficiency could enable new tools for musicians and producers. The subband approach could be extended to other audio separation tasks, such as speech enhancement or environmental sound separation. The paper contributes to the broader field of audio signal processing by demonstrating the effectiveness of combining classical signal processing techniques with modern deep learning architectures. SubRoFormer introduces a subband time-domain representation that effectively resolves the time-frequency resolution trade-off in music source separation, achieving state-of-the-art performance on MUSDB18-HQ with improved parameter efficiency. The paper demonstrates a rigorous integration of signal processing principles with Transformer-based architectures, providing a robust and reproducible framework for high-fidelity audio separation.
Author of this paper? Send a correction.