Lack of physical activity is a growing concern among public health advocates and urban planners. Our socio-ecological model incorporates urban planning and World Health Organization actions on physical activity to identify key factors related to leisure-time physical activity at the community level. Our 2019 nationwide US survey of 1312 communities enables examination of the influence of individual, community, and policy levels on physical activity. Individual factors-poverty, aging, minority population, and longer commuting time-result in lower physical activity. Community-level factors have both positive and negative effects. Physical activity is lower in rural and suburban communities, but higher in communities with more transportation services, recreation and social activities, and safety. Communities with mixed-use neighborhoods and complete streets also show higher levels of physical activity. At the policy level, zoning and cross-agency collaboration have an indirect effect on physical activity by increasing these community-level factors. This suggests an alternative approach to promoting physical activity. Local governments can promote transportation, recreation and safety, especially in rural and minority communities lacking active-friendly built environments and facing challenges from aging population, poverty, and longer commuting time. This socio-ecological approach can assess multilevel factors related to physical activity in other countries.