The association between the tumor microenvironment (TME) and treatment response or survival has been a recent focus in several types of cancer. However, most study materials are resected specimens that were completely modified by prior chemotherapy; therefore, the unmodified host immune condition has not yet been clarified. The aim of the present study was to evaluate the relationship between TME assessed in pre–therapeutic biopsy samples and chemoresistance in esophageal cancer (EC). A total of 86 endoscopic biopsy samples from EC patients who received neoadjuvant chemotherapy (NAC) prior to surgery were evaluated for the number of intratumoral CD4+ lymphocytes (with/without Foxp3 expression), CD8+ lymphocytes (with/without PD‐1 expression), monocytes (CD14+) and macrophages (CD86+, CD163+ and CD206+) by multiplex immunohistochemistry (IHC). The number of tumor‐infiltrating CD206+ macrophages I significantly correlated with cT, cM, cStage and neutrophil/lymphocyte ratio (NLR), whereas the number of lymphocytes (including expression of Foxp3 and PD‐1) was not associated with clinico‐pathological features. The high infiltration of CD163+ or CD206+ macrophages was significantly associated with poor pathological response to NAC (P = 0.0057 and 0.0196, respectively). Expression of arginase‐1 in CD163+ macrophages tended to be higher in non–responders (29.4% vs 18.2%, P = 0.17). In addition, patients with high infiltration of M2 macrophages exhibited unfavorable overall survival compared to those without high infiltration of M2 macrophages (5‐year overall survival 57.2% vs 71.0%, P = 0.0498). Thus, a comprehensive analysis of TME using multiplex IHC revealed that M2 macrophage infiltration would be useful in predicting the response to NAC and long‐term survival in EC patients. The present study confirmed that pre–therapeutic M2 macrophage infiltration would be a useful biomarker in predicting the response to NAC and unfavorable survival among a variety of immune cells in EC patients. Our results support the possibility of using immunotherapy, targeting M2 macrophages, alongside conventional neoadjuvant chemotherapy.