Evaluation of Quality of Sound Source Separation Algorithms: Human Perception vs Quantitative Metrics

Venue

2016 24th European Signal Processing Conference (EUSIPCO), pp. 1758-1762

Publication Year

2016

Keywords

audio signal processing,blind source separation,Interference,Measurement,Algorithm design and analysis,audio separation algorithms,BSS_Eval,Correlation,correlation analysis,correlation methods,Distortion,Harmonic analysis,harmonic signals,harmonic-percussive separation algorithms,hearing,human perception,listening tests,PEASS,quantitative metrics,Signal processing algorithms,sound source separation algorithms

Identifiers

Authors

  • E. Cano
  • D. FitzGerald
  • K. Brandenburg

Abstract

In this paper we look into the test methods to evaluate the quality of audio separation algorithms. Specifically we try to correlate the results of listening tests with state-of-the-art objective measures. To this end, the quality of the harmonic signals obtained with two harmonic-percussive separation algorithms was evaluated with BSS\textsubscriptEval, PEASS and via listening tests. A correlation analysis was conducted and results show that for harmonic-percussive separation algorithms, neither BSS\textsubscriptEval nor PEASS show strong correlation with the ratings obtained via listening tests and suggest that existing perceptual objective measures for quality assessment do not generalize well to different separation algorithms.

Source Materials