As an emerging industry with a wide range of prospects and great potential, cultural creative design is receiving attention and research from many scholars. As the first element affecting human vision, color is particularly important in the process of cultural product design and artistic creation. The article proposes an adaptive extraction model for image primary color based on the contour coefficient method and an intelligent color matching algorithm that integrates visual aesthetics. Through experiments, it is found that in the color aesthetics calculation experiments, the color aesthetics of each color scheme is in line with the aesthetics principle, in which the highest color aesthetics values of Scheme 1 and Scheme 5 are 1.24 and 1.03, respectively. From this, it can be concluded that the color matching algorithm proposed in this paper has a good role in the design of cultural and creative products.