In this study, we have aimed at outlining the neural systems underlying the expression of contextual fear to social defeat. First, we have developed an experimental procedure, where defeated animals could express, without the presence of a dominant aggressive male, robust and reliable conditioned fear responses to the context associated with social defeat. Next, by examining the pattern of Fos expression, we have been able to outline a brain circuit comprising septal and amygdalar sites, as well as downstream hypothalamic paths, putatively involved in the expression of contextual fear to social threat. Of particular relevance, we have found that exposure to a defeat-associated context results in a striking Fos up-regulation in the dorsomedial part of the dorsal premammillary nucleus (PMDdm). To further understand the role of the PMDdm in the circuit organizing conditioned fear to social threats, we have been able to observe that pharmacological blockade of the PMDdm reduced fear responses to a social defeat-associated context. Next, we observed that pharmacological blockade of the dorsomedial part of the periaqueductal gray, one of the main targets of the PMDdm, produced an even higher reduction of conditioned fear in defeated intruders, and appears as an important node for the expression of contextual defensive responses to social threats. The present results help to elucidate the basic organization of the neural circuits underlying contextual conditioned responses to social defeat, and reveal that they share at least part of the same circuit involved in innate responses to social defeat to an aggressive conspecific.