The clinical outcomes and therapeutic strategies for infiltrating ductal carcinoma (IDC) and infiltrating lobular carcinoma (ILC) are not uniform. The primary objectives of this study were to identify the differences in the clinical characteristics and prognoses between ILC and IDC, and identify the high-risk population based on the hormone receptor status and metastasis sites. The Surveillance, Epidemiology, and End Results Program database was searched and patients diagnosed with ILC or IDC from 1990 to 2013 were identified. In total,796,335 patients were analyzed, including 85,048 withILC (10.7%) and 711,287 withIDC (89.3%). The ILC group was correlatedwith older age, larger tumor size, later stage, lower grade, metastasis disease(M1) disease, and greater counts ofpositive lymph nodesandestrogen-receptor-positive (ER)/progesterone receptor-positive (PR) positive nodes. The overall survival showed an early advantage for ILC but a worse outcome after 5 years. Regarding the disease-specific survival, the IDC cohort had advantages over the ILC group, both during the early years and long-term. In hormone status and metastasis site subgroup analyses, the ER+/PR+ subgroup had the best survival, while the ER+/PR- subgroup had the worst outcome, especially the ILC cohort. ILC and IDC had different metastasis patterns. The proportion of bone metastasis was higher in the ILC group (91.52%) than that in the IDC (76.04%), and the ILC group was more likely to have multiple metastasis sites. Survival analyses showed patients with ILC had a higher risk of liver metastasis (disease-specific survivalDSS; P = 0.046), but had a better overall survival than the bone metastasis group (P<0.0001). We concluded that the long-term prognosis for ILC was poorer than that for IDC, and the ER+/PR- subgroup had the worst outcome. Therefore, the metastasis pattern and prognosis must be seriously evaluated, and a combination of endocrine therapy and chemotherapy should be considered.