In this paper, the design process of cultural and creative product design is first constructed in the context of deep learning and the categories of cultural idea factors are planned. The training of the network for the image extraction classification task is accelerated due to the deep learning model’s fitting ability. Secondly, the 3D virtual intelligence algorithm is applied to use the point cloud as the basis for reconstruction in order to generate a highly reproducible object surface model. Finally, the K-means algorithm is employed to obtain the final extracted color, which constitutes the technical foundation of the product design system. The final results show that the color matching degree reaches 8.91, while the image design level reaches 9.24, which illustrates the effectiveness of the tourism cultural and creative product design system under deep learning.