As the growth of automated detection technology, traditional manual detection has gradually been replaced. To improve the effectiveness of defect detection, a HPLC/dual mode portable sorting device with deep learning and image processing is raised for apparent defect detection. The product image is segmented using flood filled mean shift method, and defect detection is achieved using Yolo v3 algorithm. An LME2918 chip is the main component of the communication module in the portable device. Based on experimental data, image segmentation accuracy can range from 80% to 100%, and image matching accuracy can range from 85% to 95%. Under the power line carrier mode, the average success rate of apparent defect detection in portable sorting devices can reach 85%, and the change in success rate is not significant, indicating that the detection is relatively stable; Under wireless communication mode, the average success rate can reach 83%, and the change in success rate is relatively obvious, because wireless communication is easily affected by the external environment. The experimental data shows that the defect detection effect of the HPLC/dual mode portable sorting device based on deep learning and image processing meets the design requirements.