Evaluation of Quality of Sound Source Separation Algorithms: Human Perception vs Quantitative Metrics
Venue
2016 24th European Signal Processing Conference (EUSIPCO), pp. 1758–1762
Publication Year
Keywords
Algorithm design and analysis,audio separation algorithms,audio signal processing,blind source separation,BSS_Eval,Correlation,correlation analysis,correlation methods,Distortion,Harmonic analysis,harmonic signals,harmonic-percussive separation algorithms,hearing,human perception,Interference,listening tests,Measurement,PEASS,quantitative metrics,Signal processing algorithms,sound source separation algorithms
Identifiers
Authors
- E. Cano
- D. FitzGerald
- K. Brandenburg
Abstract
In this paper we look into the test methods to evaluate the quality of audio separation algorithms. Specifically we try to correlate the results of listening tests with state-of-the-art objective measures. To this end, the quality of the harmonic signals obtained with two harmonic-percussive separation algorithms was evaluated with BSS\textsubscriptEval, PEASS and via listening tests. A correlation analysis was conducted and results show that for harmonic-percussive separation algorithms, neither BSS\textsubscriptEval nor PEASS show strong correlation with the ratings obtained via listening tests and suggest that existing perceptual objective measures for quality assessment do not generalize well to different separation algorithms.