With the rapid development of deep learning, automatic lesion detection is used widely in clinical screening. To solve the problem that existing deep learning-based cervical precancerous lesion detection algorithms cannot meet high classification accuracy and fast running speed at the same time, a ShuffleNet-based cervical precancerous lesion classification method is proposed. By adding channel attention to the ShuffleNet, the network performance is improved. In this study, the image dataset is classified into five categories: normal, cervical cancer, LSIL (CIN1), HSIL (CIN2/CIN3), and cervical neoplasm. The colposcopy images are expanded to solve the problems of the lack of colposcopy images and the uneven distribution of images from each category. For the test dataset, the accuracy of the proposed CNN models is 81.23% and 81.38%. Our classifier achieved an AUC score of 0.99. The experimental results show that the colposcopy image classification network based on artificial intelligence has good performance in classification accuracy and model size, and it has high clinical applicability.