Inconsistencies in the Eocene climates of East Asia have been revealed in both geological studies and simulations. Several earlier reconstructions showed an arid zonal band in mid‐latitude China, but others showed a humid climate in the same region. Moreover, previous Eocene modeling studies have demonstrated that climate models can simulate both scenarios in China. Therefore, it is essential to investigate the cause of this model spread. We conducted a series of experiments using Norwegian Earth System Model 1‐F and examined the impact of mountains in Southern China on the simulated Eocene climate. These mountains, including the Gangdese and Southeast Mountains, are located along the main path of water vapor transport to East Asia. Our results reveal that the Southeast Mountains play the dominant role in controlling the simulated precipitation in Eastern China during the Eocene. When the heights of the Southeast Mountains exceed ∼2,000 m, an arid zonal band appears in mid‐latitude China, whereas humid climates appear in Eastern China when the elevation of the Southeast Mountains is relatively low. Key Points Southeast Mountains control simulated Eocene precipitation in Eastern China When the Southeast Mountains are high, an arid zonal band appears in mid‐latitude China The early Eocene climate in East Asia is not monsoonal climate