Multi-Scale Temporal Frequency Convolutional Network With Axial Attention for Speech Enhancement

By Guochang Zhang, Libiao Yu, Chunliang Wang, Jianqiang Wei. 2022

78 citations recorded by the source corpus.

Speech quality is often degraded by acoustic echoes, background noise, and reverberation. In this paper, we propose a system consisting of deep learning and signal processing to simultaneously suppress echoes, noise, and reverberation. For the deep learning, we design a novel speech dense-prediction backbone. For the signal processing, a linear acoustic echo canceller is used as conditional information for deep learning. To improve the performance of the speech dense-prediction backbone, strategies such as a microphone and reference phase encoder, multi-scale time-frequency processing, and streaming axial attention are designed. The proposed system ranked first in both AEC and DNS Challenge (non-personal track) of ICASSP 2022. In addition, this backbone has also been extended to the multi-channel speech enhancement task, and placed second in ICASSP 2022 L3DAS22 Challenge1.

Subfields: Artificial Intelligence, Computational Mechanics, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Ross Cutler
  2. Vishak Gopal
  3. Sebastian Braun
  4. Chandan K. A. Reddy
  5. Robert Aichner
  6. Harishchandra Dubey
  7. Hannes Gamper
  8. Sriram Srinivasan

In Computational Mechanics

  1. Vishak Gopal
  2. Ross Cutler
  3. Chandan K. A. Reddy
  4. Robert Aichner
  5. Hannes Gamper
  6. Harishchandra Dubey
  7. Sebastian Braun
  8. Sriram Srinivasan

In Signal Processing

  1. Ross Cutler
  2. Vishak Gopal
  3. Chandan K. A. Reddy
  4. Robert Aichner
  5. Hannes Gamper
  6. Sebastian Braun
  7. Harishchandra Dubey
  8. Sriram Srinivasan

Citations in the corpus