Paleo proxy data suggest that the Atlantic meridional overturning circulation (AMOC) was shallower and weaker at the Last Glacial Maximum (LGM) than at present. In this study, we have identified the existence of a thermal threshold of the AMOC which may explain why many coupled climate models fail to simulate the weaker AMOC during the LGM. By using results obtained from a coupled climate model and conducting sensitivity simulations with an ocean general circulation model, we found that the sudden transition from the present‐day AMOC to the weaker glacial AMOC occurs when we gradually change the degree of surface cooling from present‐day to glacial conditions. This result is related to response of deep convection in the northern North Atlantic Ocean; moderate cooling enhances deep convection whereas sufficient cooling results in total covering of sea ice there and suppression of deep convection. The findings indicate the existence of a thermal threshold controlling the AMOC, where the present‐day‐type AMOC suddenly shifts to the weaker glacial AMOC once the surface cooling exceeds this threshold. We also demonstrate that wind stress forcing plays a critical role in controlling the value of the thermal threshold. Our study suggests that slight differences in the degree of surface cooling or wind stress forcing for LGM simulations could lead to the very different response of the AMOC during the LGM as reported in previous LGM simulations. Key Points The existence of thermal threshold of AMOC is identified in this study The wind stress plays a critical role in controlling thermal threshold value Thermal threshold explains different glacial responses of AMOC among models