This paper considers the supply chain composed of altruistic retailers and selfish manufacturers under risk aversion. We use the mean variance (MV) method to construct two types of behavior models. One is a two-stage supply chain model with a single manufacturer and a single retailer, and the other is a competitive supply chain model with two retailers and two manufacturers. We discuss the decision-making problems under manufacturer Stackelberg (MS) game and retailer Stackelberg (RS) game, respectively. We analyze the role of risk aversion and power structure. Results show that the more risk aversion manufacturers are, the lower the emission reduction levels are. It also find that the prices increase with power shift from retailers to manufacturers. Finally, we point out that the competing can help the firms earn more benefits via numerical studies.