Patients with Mild Cognitive Impairment (MCI) have an increased risk of Alzheimer's disease (AD). Early identification of underlying neurodegenerative processes is essential to provide treatment before the disease is well established in the brain. Here we used longitudinal data from the ADNI database to investigate prediction of a trajectory towards AD in a group of patients defined as MCI at a baseline examination. One group remained stable over time (sMCI, n = 357) and one converted to AD (cAD, n = 321). By running two independent classification methods within a machine learning framework, with cognitive function, hippocampal volume and genetic APOE status as features, we obtained a cross-validation classification accuracy of about 70%. This level of accuracy was confirmed across different classification methods and validation procedures. Moreover, the sets of misclassified subjects had a large overlap between the two models. Impaired memory function was consistently found to be one of the core symptoms of MCI patients on a trajectory towards AD. The prediction above chance level shown in the present study should inspire further work to develop tools that can aid clinicians in making prognostic decisions.