A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector

By Rayson Laroca, Evair Severo, Luiz Antonio Zanlorensi, Luiz Oliveira, Gabriel Resende Gonçalves, William Robson Schwartz, David Menotti. IEEE International Joint Conference on Neural Network, 2018

512 citations recorded by the source corpus.

Automatic License Plate Recognition (ALPR) has been a frequent topic of research due to many practical applications. However, many of the current solutions are still not robust in real-world situations, commonly depending on many constraints. This paper presents a robust and efficient ALPR system based on the state-of-the-art YOLO object detector. The Convolutional Neural Networks (CNNs) are trained and finetuned for each ALPR stage so that they are robust under different conditions (e.g., variations in camera, lighting, and background). Specially for character segmentation and recognition, we design a two-stage approach employing simple data augmentation tricks such as inverted License Plates (LPs) and flipped characters. The resulting ALPR approach achieved impressive results in two datasets. First, in the SSIG dataset, composed of 2,000 frames from 101 vehicle videos, our system achieved a recognition rate of 93.53% and 47 Frames Per Second (FPS), performing better than both Sighthound and OpenALPR commercial systems (89.80% and 93.03%, respectively) and considerably outperforming previous results (81.80%). Second, targeting a more realistic scenario, we introduce a larger public dataset1 dataset, designed to ALPR. This dataset contains 150 videos and 4,500 frames captured when both camera and vehicles are moving and also contains different types of vehicles (cars, motorcycles, buses and trucks). In our proposed dataset, the trial versions of commercial systems achieved recognition rates below 70%. On the other hand, our system performed better, with recognition rate of 78.33% and 35 FPS.The UFPR-ALPR dataset is publicly available to the research community at https://web.inf.ufpr.br/vri/databases/ufpr-alpr/ subject to privacy restrictions.

Subfields: Computer Vision and Pattern Recognition, Media Technology

View Paper: https://www.semanticscholar.org/paper/7ff51e980e14a2e86a8edab86fe13fd2d70365f9

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. L. Jiao
  2. Wei Yang
  3. Rong Qu
  4. Shuyuan Yang
  5. Zhixi Feng
  6. Liusheng Huang
  7. Huan Huang
  8. Cláudio Rosito Jung

In Media Technology

  1. L. Jiao
  2. Cláudio Rosito Jung
  3. Sergio Montazzolli Silva

Citations in the corpus