Compensatory mechanisms, such as a decrease in thoracic spine kyphosis and posterior tilting or rotation of the pelvis, aim to achieve optimal alignment of the spine. However, the effect of muscle strength on these compensatory mechanisms has not been elucidated. This study aimed to investigate the impact of back muscle and lower extremity strength on compensatory mechanisms in elderly people. Overall, 409 community-dwelling elderly participants (164 men, 245 women) were included. Age, disc degeneration, and 2 or more vertebral fractures showed a significant increase of risk for sagittal vertical axis (SVA) deterioration. Conversely, stronger back, hip flexor, and knee extensor muscles reduced the risk for SVA deterioration. To investigate the association of each muscle's strength with compensatory mechanisms, 162 subjects with pelvic incidence-lumbar lordosis > 10° were selected. The linear regression model for thoracic kyphosis demonstrated a negative correlation with back muscle strength and positive correlation with vertebral fracture. The regression analysis for pelvic tilt demonstrated a positive correlation with knee extensor strength. Back, hip flexor, and knee extensor muscle strength were associated with sagittal spinal alignment. Back muscle strength was important for the decrease in thoracic kyphosis, and knee extensor strength was associated with pelvic tilt.