Perivascular spaces (PVS) are compartments surrounding cerebral blood vessels that become visible on MRI when enlarged. Enlarged PVS (EPVS) are commonly seen in patients with cerebral small vessel disease (CSVD) and have been suggested to reflect dysfunctional perivascular clearance of soluble waste products from the brain. In this study, we investigated histopathological correlates of EPVS and how they relate to vascular amyloid-β (Aβ) in cerebral amyloid angiopathy (CAA), a form of CSVD that commonly co-exists with Alzheimer’s disease (AD) pathology. We used ex vivo MRI, semi-automatic segmentation and validated deep-learning-based models to quantify EPVS and associated histopathological abnormalities. Severity of MRI-visible PVS during life was significantly associated with severity of MRI-visible PVS on ex vivo MRI in formalin fixed intact hemispheres and corresponded with PVS enlargement on histopathology in the same areas. EPVS were located mainly around the white matter portion of perforating cortical arterioles and their burden was associated with CAA severity in the overlying cortex. Furthermore, we observed markedly reduced smooth muscle cells and increased vascular Aβ accumulation, extending into the WM, in individually affected vessels with an EPVS. Overall, these findings are consistent with the notion that EPVS reflect impaired outward flow along arterioles and have implications for our understanding of perivascular clearance mechanisms, which play an important role in the pathophysiology of CAA and AD.