Review of License Plate Recognition Techniques with Deep Learning
Abstract
This article reviews vehicle license plate recognition (LPR) using deep learning techniques, which have become essential in intelligent transportation systems, law enforcement, and parking management. Deep learning, particularly Convolutional Neural Networks (CNNs), has replaced traditional methods with more accurate and robust systems capable of handling diverse real-world conditions. The article explores various deep learning approaches in LPR, including fusion, two-stage, end-to-end, multi-branch, and generative methods. Fusion methods combine deep learning with traditional image processing to enhance accuracy. Two-stage methods separate the detection and recognition tasks into different models. End-to-end methods use a single model for both detection and recognition, improving efficiency and reducing errors. Multi-branch methods employ parallel neural network branches to handle different tasks simultaneously, such as plate detection and character recognition. Generative methods use Generative Adversarial Networks (GANs) to create realistic license plate images, boosting recognition performance. The article evaluates these methods on benchmark datasets and identifies challenges, such as improving robustness under extreme weather conditions, developing lightweight models for real-time processing on constrained devices, and addressing privacy and security concerns. This review offers a comprehensive overview of the latest advancements in deep learning-based LPR technology and its potential applications.
References
Chen, Z., Yan, L., Yin, S., & Shi, Y. (2020). Vehicle license plate recognition system based on deep learning in natural scene. *Journal of Artificial Intelligence, 2*(4), 167.
Adytia, N. R., & Kusuma, G. P. (2021). Indonesian license plate detection and identification using deep learning. *International Journal of Emerging Technology and Advanced Engineering, 11*(7), 1–7.
Wang, J., Liu, X., Liu, A., & Xiao, J. (2019). A deep learning-based method for vehicle license plate recognition in natural scene. *APSIPA Transactions on Signal and Information Processing, 8*, e16.
Jørgensen, H. (2017). *Automatic license plate recognition using deep learning techniques* (Master’s thesis, NTNU).
Bhujbal, A., & Mane, D. (2019). A survey on deep learning approaches for vehicle and number plate detection. *International Journal of Scientific & Technology Research, 8*(12), 1378–1383.
Al Awaimri, M., Fageeri, S., Moyaid, A., & ALhasanat, A. (2021). Vehicles number plate recognition systems: A systematic review. In *2020 International Conference on Computer, Control, Electrical, and Electronics Engineering (ICCCEEE)* (pp. 1–6). IEEE.
Alkawsi, G., Baashar, Y., Alkahtani, A. A., Kiong, T. S., Habeeb, D., & Aliubari, A. (2021). Arabic vehicle licence plate recognition using deep learning methods. In *2021 11th IEEE International Conference on Control System, Computing and Engineering (ICCSCE)* (pp. 75–79). IEEE.
Vishwakarma, P. K., & Jain, N. (2023). Deep learning-based methods in image analytics for vehicle detection: A review. In *2023 6th International Conference on Information Systems and Computer Networks (ISCON)* (pp. 1–6). IEEE.
Wu, T., Liao, H., & Lim, Z. (2020). Integration of Deep Learning and Industrial Computer Vision Library for Motorcycle and Vehicle License Plate Recognition. Proceedings of the 2020 3rd International Conference on Image and Graphics Processing.
Arsenovic, M., Sladojević, S., Anderla, A., & Stefanović, D. (2017). Deep Learning Driven Plates Recognition System.
Zibani, R., Sebbak, F., Boudaren, M.E., Mataoui, M., Touabi, M., & Hfaifia, H. (2022). A New Fusion-Based Approach for License Plate Recognition: An Application to the Algerian Context. Communication Systems and Applications.
Rashtehroudi, A.R., Shahbahrami, A., & Akoushideh, A. (2020). Iranian License Plate Recognition using Deep Learning. 2020 International Conference on Machine Vision and Image Processing (MVIP), 1-5.
Zhang, J., Li, Y., Li, T., Xun, L., & Shan, C. (2019). License Plate Localization in Unconstrained Scenes Using a Two-Stage CNN-RNN. IEEE Sensors Journal, 19, 5256-5265.
Lin, C., & Sie, Y. (2019). Two-Stage License Plate Recognition System using Deep learning. 2019 8th International Conference on Innovation, Communication and Engineering (ICICE), 132-135.
Yonetsu, S., Iwamoto, Y., & Chen, Y. (2019). Two-Stage YOLOv2 for Accurate License-Plate Detection in Complex Scenes. 2019 IEEE International Conference on Consumer Electronics (ICCE), 1-4.
Laroca, R., Severo, E., Zanlorensi, L.A., Oliveira, L., Gonçalves, G.R., Schwartz, W.R., & Menotti, D. (2018). A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector. 2018 International Joint Conference on Neural Networks (IJCNN), 1-10.
Chen, S., Yang, C., Ma, J., Chen, F., & Yin, X. (2020). Simultaneous End-to-End Vehicle and License Plate Detection With Multi-Branch Attention Neural Network. IEEE Transactions on Intelligent Transportation Systems, 21, 3686-3695.
Gonçalves, G.R., Diniz, M.A., Laroca, R., Menotti, D., & Schwartz, W.R. (2018). Real-Time Automatic License Plate Recognition through Deep Multi-Task Networks. 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), 110-117.
Guo, P., Lee, C., & Ulbricht, D. (2020). Learning to Branch for Multi-Task Learning. ArXiv, abs/2006.01895.
Khan, K., Imran, A., Rehman, H.Z., Fazil, A., Zakwan, M., & Mahmood, Z. (2021). Performance enhancement method for multiple license plate recognition in challenging environments. EURASIP Journal on Image and Video Processing, 2021.
Björklund, T., Fiandrotti, A., Annarumma, M., Francini, G., & Magli, E. (2017). Automatic license plate recognition with convolutional neural networks trained on synthetic data. 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), 1-6.
Wu, S., Zhai, W., & Cao, Y. (2019). PixTextGAN: structure aware text image synthesis for license plate recognition. IET Image Process., 13, 2744-2752.
Wang, X., Man, Z., You, M., & Shen, C. (2017). Adversarial Generation of Training Examples: Applications to Moving Vehicle License Plate Recognition. arXiv: Computer Vision and Pattern Recognition.
Boby, A., & Brown, D. (2022). Improving Licence Plate Detection Using Generative Adversarial Networks. Iberian Conference on Pattern Recognition and Image Analysis.