Glioma is one of the most fatal tumors in central nervous system. Previous studies gradually revealed the association between tumor microenvironment and the prognosis of gliomas patients. However, the correlation between tumor-infiltrating immune cell and stromal signatures are unknown. In our study, we obtained gliomas samples from the Chinese Glioma Genome Atlas (CGGA) and The Cancer Genome Atlas (TCGA). The landscape of tumor infiltrating immune cell subtypes in gliomas was calculated by CIBERSORT. As a result, we found high infiltration of macrophages was correlated with poor outcome (P < 0.05). Then functional enrichment analysis of high/low macrophage-infiltrating groups was performed by GSEA. The results showed three gene sets includes 102 core genes about angiogenesis were detected in high macrophage-infiltrating group. Next, we constructed PPI network and analyzed prognostic value of 102 core genes. We found that five stromal signatures indicated poor prognosis which including HSPG2, FOXF1, KDR, COL3A1, SRPX2 (P < 0.05). Five stromal signatures were adopted to construct a classifier. The classifier showed powerful predictive ability (AUC = 0.748). Patients with a high risk score showed poor survival. Finally, we validated this classifier in TCGA and the result was consistent with CGGA. Our investigation of tumor microenvironment in gliomas may stimulate the new strategy in immunotherapy. Five stromal signature correlated with poor prognosis also provide a strong predator of gliomas patient outcome.