BMN: Boundary-Matching Network for Temporal Action Proposal Generation

By Tianwei Lin, Xiao Liu, Xin Li, Errui Ding, Shilei Wen. 2019

726 citations recorded by the source corpus.

Temporal action proposal generation is an challenging and promising task which aims to locate temporal regions in real-world videos where action or event may occur. Current bottom-up proposal generation methods can generate proposals with precise boundary, but cannot efficiently generate adequately reliable confidence scores for retrieving proposals. To address these difficulties, we introduce the Boundary-Matching (BM) mechanism to evaluate confidence scores of densely distributed proposals, which denote a proposal as a matching pair of starting and ending boundaries and combine all densely distributed BM pairs into the BM confidence map. Based on BM mechanism, we propose an effective, efficient and end-to-end proposal generation method, named Boundary-Matching Network (BMN), which generates proposals with precise temporal boundaries as well as reliable confidence scores simultaneously. The two-branches of BMN are jointly trained in an unified framework. We conduct experiments on two challenging datasets: THUMOS-14 and ActivityNet-1.3, where BMN shows significant performance improvement with remarkable efficiency and generalizability. Further, combining with existing action classifier, BMN can achieve state-of-the-art temporal action detection performance.

Subfields: Computer Vision and Pattern Recognition, Time-Series & Forecasting

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Kristen Grauman
  3. Jitendra Malik
  4. Trevor Darrell
  5. Andrew Zisserman
  6. Cordelia Schmid
  7. Dacheng Tao
  8. Ming-Hsuan Yang

In Time-Series & Forecasting

  1. Chen Zhao
  2. Dima Damen
  3. Giovanni Maria Farinella
  4. Antonino Furnari
  5. Kristen Grauman
  6. Ali K. Thabet
  7. Yanghao Li
  8. Cordelia Schmid

Citations in the corpus