The accelerating pace of globalization has led to more and more frequent cultural exchanges, and cultural differences are the biggest obstacle in the process of exchanges. The article starts from a number of cross-cultural factors affecting English and American literary translation, and after establishing a text consistency assessment model based on linguistic features by combining step-by-step regression method, it constructs a theoretical model of cross-cultural factors and text consistency, and conducts a quantitative analysis using structural equation modeling to explore the influence of cross-cultural factors on text consistency in English and American literary translation. Ten linguistic feature indicators were selected through the analysis to predict text consistency in English and American literary translation, with an explanation degree of 58.74%. Meanwhile cross-cultural factors such as geographic location, customs, religious beliefs, ideology, geopolitical and historical development impede text consistency in translation by negatively affecting text comprehension (P < 0.01), revealing the negative influence of cross-cultural factors on text consistency in translation. The most significant factors affecting text consistency are religious beliefs (−0.399), customs (−0.297), and regional politics (−0.251).