Height loss in aging has been recognized to reflect a decline in musculoskeletal health but not investigated in relation to dietary factors, such as sugar-sweetened beverages (SSBs), the consumption of which may deteriorate musculoskeletal health. This study aimed to evaluate the longitudinal association of habitual consumption of total SSBs and its subtypes with height loss and examine effect-modification by age, sex, and anthropometry. We evaluated 16,230 adults aged 40–79 y in the European Prospective Investigation into Cancer and Nutrition-Norfolk cohort. At baseline (1993–1997), SSB consumption (soft drinks, squashes, sweetened milk beverages, sweetened coffee/tea, and sweetened alcoholic beverages) was assessed using 7-d food diaries. Height was objectively measured at the baseline, second (1997–2000), and third (2004–2011) health checks. Multivariable linear regression was used to examine baseline SSB consumption and the rate of height change over the follow-up. The median (IQR) height change was −1.07 (−2.09 to −0.28) cm/10 y. Adjusted for potential confounders including behavioral factors, medications, and baseline body mass index (BMI), total SSB consumption was associated with height loss (β: −0.024; 95% CI: −0.046, −0.001 cm/10 y per 250 g/d of SSB), and similar results were seen for the individual beverages, except for sweetened milk beverages (β: +0.07; 95% CI: −0.16, 0.30), with wide CIs. No effect-modification by prespecified factors was evident, except for baseline BMI (P-interaction = 0.037). Total SSB consumption was associated with height loss (−0.038; 95% CI: −0.073, −0.004) in participants with BMI ≤ 25 kg/m2 but not apparently in those with BMI > 25 kg/m2. SSB consumption was modestly associated with height loss, particularly in adults with normal weight status.