Evaluation of Quality of Sound Source Separation Algorithms: Human Perception vs Quantitative Metrics
2016 24th European Signal Processing Conference (EUSIPCO), pp. 1758-1762
audio signal processing,blind source separation,Interference,Measurement,Algorithm design and analysis,audio separation algorithms,BSS_Eval,Correlation,correlation analysis,correlation methods,Distortion,Harmonic analysis,harmonic signals,harmonic-percussive separation algorithms,hearing,human perception,listening tests,PEASS,quantitative metrics,Signal processing algorithms,sound source separation algorithms
- E. Cano
- D. FitzGerald
- K. Brandenburg
In this paper we look into the test methods to evaluate the quality of audio separation algorithms. Specifically we try to correlate the results of listening tests with state-of-the-art objective measures. To this end, the quality of the harmonic signals obtained with two harmonic-percussive separation algorithms was evaluated with BSS\textsubscriptEval, PEASS and via listening tests. A correlation analysis was conducted and results show that for harmonic-percussive separation algorithms, neither BSS\textsubscriptEval nor PEASS show strong correlation with the ratings obtained via listening tests and suggest that existing perceptual objective measures for quality assessment do not generalize well to different separation algorithms.