Although sociodemographic factors are one aspect of understanding the effects of neighborhood environments on health, equating neighborhood quality with socioeconomic status ignores the important role of physical neighborhood attributes. Prior work on neighborhood environments and health has relied primarily on level of socioeconomic disadvantage as the indicator of neighborhood quality without attention to physical neighborhood quality. A small but increasing number of studies have assessed neighborhood physical characteristics. Findings generally indicate that there is an association between living in deprived neighborhoods and poor health outcomes, but rigorous evidence linking specific physical neighborhood attributes to particular health outcomes is lacking. This paper discusses the methodological challenges and limitations of measuring physical neighborhood environments relevant to health and concludes with proposed directions for future work.