All living birds are toothless, constituting by far the most diverse toothless vertebrate clade, and are striking examples of evolutionary success following tooth loss. In recent years, an unprecedented number of Mesozoic birds have been described, illustrating the evolution of dentition reductions. Simultaneously, major advances in experimental embryology have yielded new results concerning avian edentulism. Reviewing these lines of evidence, we propose hypotheses for its causes, with a prominent role for the horny beak during development. A horny beak and a muscular gizzard functionally ‘replaced’ dentition for food acquisition and processing, respectively. Together with edentulism itself, these features and others contributed to the later success of birds, as a result of their high performance or additional functionality working in concert in these complex organisms.