Remixing music using source separation algorithms to improve the musical experience of cochlear implant users.
By Jordi Pons, Jordi Janer, Thilo Rode, Waldo Nogueira. 2016
63 citations recorded by the source corpus.
Music perception remains rather poor for many Cochlear Implant (CI) users due to the users' deficient pitch perception. However, comprehensible vocals and simple music structures are well perceived by many CI users. In previous studies researchers re-mixed songs to make music more enjoyable for them, favoring the preferred music elements (vocals or beat) attenuating the others. However, mixing music requires the individually recorded tracks (multitracks) which are usually not accessible. To overcome this limitation, Source Separation (SS) techniques are proposed to estimate the multitracks. These estimated multitracks are further re-mixed to create more pleasant music for CI users. However, SS may introduce undesirable audible distortions and artifacts. Experiments conducted with CI users (N = 9) and normal hearing listeners (N = 9) show that CI users can have different mixing preferences than normal hearing listeners. Moreover, it is shown that CI users' mixing preferences are user dependent. It is also shown that SS methods can be successfully used to create preferred re-mixes although distortions and artifacts are present. Finally, CI users' preferences are used to propose a benchmark that defines the maximum acceptable levels of SS distortion and artifacts for two different mixes proposed by CI users.
Subfields: Biomedical Engineering, Cognitive Neuroscience, Signal Processing
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Biomedical Engineering
In Signal Processing
- Jordi Pons
- Xavier Serra
- Dario Rethage
- Eduardo Fonseca
- Yossi Adi
- Alexandre D'efossez
- Frederic Font
- Lauri Juvela
Citations in the corpus
- A Wavenet for Speech Denoising (2017, methodology): “We set as baselines: (i) the noisy signal, and (ii) a signal processing method based on Wiener filtering – widely used for speech-denoising [22, 23] or audio source-separation [24].”