CLPR:End to End Chinese License Plate Recognition

中文版readme

A PyTorch implementation of End to End Chinese License Plate Recognition, the whole project is mainly modified from SSD, which is a Single-stage object detector. And I mainly adopted the idea of this article(A Novel Integrated Framework for Learning both Text Detection and Recognition) and designed an OCR ROI pooling operation, so that detection, classification and text recognition can be integrated into one net for training, and using VGG as the backbone network.

Dataset

And i use CCPD: Chinese City Parking Dataset for training, i random choose 70000 sample for training. You can download the whole dataset or just use the images in ./data/test_data

Installation requirement

1. clone the project

git clone https://github.com/chenjun2hao/CLPR.pytorch.git

2. install cupy, for example:

(Binary Package for CUDA 9.0)
$ pip install cupy-cuda90

3. Other dependencies

python 3.6
pytorch 0.4.0

Test

For testing, download the pretrained model from Baidu disk, password:16pk, and put the model in weights folder.

python test.py

here are some examples:

<table> <tr> <td ><center><img src="./output/0.jpg" >图1 </center></td> <td ><center><img src="./output/1.jpg" >图2 </center></td> </tr> <tr> <td ><center><img src="./output/4.jpg" >图3 </center></td> <td ><center><img src="./output/3.jpg" >图4 </center></td> </tr> <tr> <td ><center><img src="./output/5.jpg" >图5 </center></td> <td ><center><img src="./output/6.jpg" >图6 </center></td> </tr> </table>

Train

Coming later

TO DO

• [] For strabismus license plate recognition effect is not good, can add amendments
• [] Character recognition is easy to leak out, and it combines multi-layer features for character recognition.

References

• CCPD: Chinese City Parking Dataset
• Chainer
• ssd.pytorch