Animal models of Alzheimer's disease have suggested that tau pathology propagation, facilitated by amyloid pathology, may occur along connected pathways. To investigate these ideas in humans, we combined amyloid scans with longitudinal data on white matter connectivity, hippocampal volume, tau positron emission tomography and memory performance in 256 cognitively healthy older individuals. Lower baseline hippocampal volume was associated with increased mean diffusivity of the connecting hippocampal cingulum bundle (HCB). HCB diffusivity predicted tau accumulation in the downstream-connected posterior cingulate cortex in amyloid-positive but not in amyloid-negative individuals. Furthermore, HCB diffusivity predicted memory decline in amyloid-positive individuals with high posterior cingulate cortex tau binding. Our results provide in vivo evidence that higher amyloid pathology strengthens the association between HCB diffusivity and tau accumulation in the downstream posterior cingulate cortex and facilitates memory decline. This confirms amyloid's crucial role in potentiating neural vulnerability and memory decline marking the onset of preclinical Alzheimer's disease.