Subjective evaluation of speech quality with a crowdsourcing approach Summary

Citations in the corpus

• Impact of the Number of Votes on the Reliability and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach (2020, background): “808 [8], which has been set up with the aim of increasing the reliability and acceptability of crowdsourcing-based speech quality measurements.”
• The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Results (2020, methodology): “808 Subjective Evaluation of Speech Quality with a Crowdsourcing Approach [15] methodology to evaluate and compare SE methods using Absolute Category Ratings (ACR) to estimate a Mean Opinion Score (MOS).”
• The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Speech Quality and Testing Framework (2020, methodology): “Framework ITU-T P.808 We use the ITU-T P.808 Subjective Evaluation of Speech Quality with a Crowdsourcing Approach [14] methodology to evaluate and compare SE methods using Absolute Category Ratings (ACR) to estimate a Mean Opinion Score (MOS).”
• ICASSP 2023 Deep Noise Suppression Challenge (2023, background): “Though, this was not a requirement for this challenge.”