Preverbal infants spontaneously represent the number of objects in collections. Is this 'sense of number' (also referred to as Approximate Number System, ANS) part of the cognitive foundations of mathematical skills? Multiple studies reported a correlation between the ANS and mathematical achievement in children. However, some have suggested that such correlation might be mediated by general-purpose inhibitory skills. We addressed the question using a longitudinal approach: we tested the ANS of 60 12 months old infants and, when they were 4 years old (final N = 40), their symbolic math achievement as well as general intelligence and inhibitory skills. Results showed that the ANS at 12 months is a specific predictor of later maths skills independent from general intelligence or inhibitory skills. The correlation between ANS and maths persists when both abilities are measured at four years. These results confirm that the ANS has an early, specific and longstanding relation with mathematical abilities in childhood.