Introduction White matter hyperintensities (WMHs) and cerebral microbleeds are widespread among aging population and linked with cognitive deficits in mild cognitive impairment (MCI), vascular MCI (V-MCI), and Alzheimer's disease without (AD) or with a vascular component (V-AD). In this study, we aimed to investigate the association between brain age, which reflects global brain health, and cerebrovascular lesion load in the context of pathological aging in diverse forms of clinically-defined neurodegenerative conditions. Methods We computed brain-predicted age difference (brain-PAD: predicted brain age minus chronological age) in the Comprehensive Assessment of Neurodegeneration and Dementia cohort of the Canadian Consortium on Neurodegeneration in Aging including 70 cognitively intact elderly (CIE), 173 MCI, 88 V-MCI, 50 AD, and 47 V-AD using T1-weighted magnetic resonance imaging (MRI) scans. We used a well-established automated methodology that leveraged fluid attenuated inversion recovery MRIs for precise quantification of WMH burden. Additionally, cerebral microbleeds were detected utilizing a validated segmentation tool based on the ResNet50 network, utilizing routine T1-weighted, T2-weighted, and T2 * MRI scans. Results The mean brain-PAD in the CIE cohort was around zero, whereas the four categories showed a significantly higher mean brain-PAD compared to CIE, except MCI group. A notable association trend between brain-PAD and WMH loads was observed in aging and across the spectrum of cognitive impairment due to AD, but not between brain-PAD and microbleed loads. Discussion WMHs were associated with faster brain aging and should be considered as a risk factor which imperils brain health in aging and exacerbate brain abnormalities in the context of neurodegeneration of presumed AD origin. Our findings underscore the significance of novel research endeavors aimed at elucidating the etiology, prevention, and treatment of WMH in the area of brain aging.