Real-World Anomaly Detection in Surveillance Videos

By Waqas Sultani, Mubarak Shah. 2018

2,070 citations recorded by the source corpus.

Surveillance videos are able to capture a variety of realistic anomalies. In this paper, we propose to learn anomalies by exploiting both normal and anomalous videos. To avoid annotating the anomalous segments or clips in training videos, which is very time consuming, we propose to learn anomaly through the deep multiple instance ranking framework by leveraging weakly labeled training videos, i.e. the training labels (anomalous or normal) are at video-level instead of clip-level. In our approach, we consider normal and anomalous videos as bags and video segments as instances in multiple instance learning (MIL), and automatically learn a deep anomaly ranking model that predicts high anomaly scores for anomalous video segments. Furthermore, we introduce sparsity and temporal smoothness constraints in the ranking loss function to better localize anomaly during training. We also introduce a new large-scale first of its kind dataset of 128 hours of videos. It consists of 1900 long and untrimmed real-world surveillance videos, with 13 realistic anomalies such as fighting, road accident, burglary, robbery, etc. as well as normal activities. This dataset can be used for two tasks. First, general anomaly detection considering all anomalies in one group and all normal activities in another group. Second, for recognizing each of 13 anomalous activities. Our experimental results show that our MIL method for anomaly detection achieves significant improvement on anomaly detection performance as compared to the state-of-the-art approaches. We provide the results of several recent deep learning baselines on anomalous activity recognition. The low recognition performance of these baselines reveals that our dataset is very challenging and opens more opportunities for future work. The dataset is available at: http://crcv.ucf.edu/projects/real-world/

Subfields: Artificial Intelligence, Biomedical Engineering, Computer Networks and Communications, Computer Vision and Pattern Recognition, Anomaly & Outlier Detection

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Chunhua Shen
  2. Fahad Shahbaz Khan
  3. Mubarak Shah
  4. Ling Shao
  5. Luc Van Gool
  6. Silvio Savarese
  7. Ian David Reid
  8. Anton van den Hengel

In Biomedical Engineering

  1. Licheng Jiao
  2. Sijie Li
  3. Weishi Zheng
  4. Yingli Tian
  5. Xiaodong Yang
  6. Mubarak Shah
  7. Silvio Savarese
  8. Chunhua Shen

In Computer Networks and Communications

  1. Licheng Jiao
  2. Sijie Li
  3. Guansong Pang
  4. Chunhua Shen
  5. Radu Tudor Ionescu
  6. Fahad Shahbaz Khan
  7. Mariana-Iuliana Georgescu
  8. Jianfeng Feng

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Xiaogang Wang
  5. Andrew Zisserman
  6. Jitendra Malik
  7. Trevor Darrell
  8. Chunhua Shen

In Anomaly & Outlier Detection

  1. Licheng Jiao
  2. Sijie Li
  3. Radu Tudor Ionescu
  4. Fahad Shahbaz Khan
  5. Guansong Pang
  6. Mariana-Iuliana Georgescu
  7. Jianfeng Feng
  8. Weishi Zheng

Citations in the corpus