Background While several studies have documented fatigue during and after cancer treatment, long-term cancer survivor fatigue is underreported. In this study, we compare fatigue, quality of life (QoL), and anxiety between relapse-free cancer survivors 15 years after diagnosis and healthy controls. Methods Cancer survivors (CS) were randomly selected from three large population-based cancer registries (Bas-Rhin, Calvados, and Doubs, France). Cancer-free controls were randomly selected from electoral lists with stratification on age group, residence area, and gender. All participants completed self-reported fatigue (MFI), QoL (EORTC QLQ-C30), and anxiety (STAI) questionnaires. Univariable and multivariable logistic regression were used to study the association between fatigue and cancer status, in three cancer subgroups: breast cancer (BC), cervical cancer (CC), and colorectal cancer (CRC). Results Two hundred sixty-three CS and 688 controls (125/275, 45/153, 93/260 CS/controls for BC, CC, and CRC respectively) were included. The mean age was 66 years. In multivariable analyses, CS had higher general and mental fatigue than controls p  = 0.04 and p  = 0.02, respectively. No difference in QoL was observed between CS and controls. CS were more anxious than controls ( p  < 0.01). Anxiety was associated with general fatigue ( p  < 0.0001) and mental fatigue ( p  < 0.0001). Conclusion Fifteen years after diagnosis, cancer survivors reported more general and mental fatigue compared with controls. Our results reinforce guidelines, identifying fatigue as a persistent symptom.