The maintenance of road pavements is an essential task to prevent major deterioration and to reduce accident rates. In this task, the detection and classification of different types of cracks on the roads is usually considered. However, in most cases, these tasks are not fully automated and they need to be supervised by an expert to make repair decisions. This work focuses on the automatic classification of the most common types of cracks: longitudinal cracks, transverse cracks, and alligator cracks. Our proposal combines, first, computer vision techniques for crack segmentation and second, an ensemble model (composed of different rule‐based algorithms) for the classification. This approach achieves an average precision and recall values greater than 94% for three analyzed data sets improving the results in comparison to other approaches.