We present the development and evaluation of a gamified rhythmic dictation application for music theory learning. The application was developed as a web application in the existing Troubadour platform for music ear training. The focus of the developed application was on user experience and engagement. With regards to the former, we developed a responsive and intuitive user interface; for the latter, we included several gamification elements and assessed the impact on the students’ engagement. We report on students’ experience analysis done through questionnaires and background data collected through the platform. We evaluated the rhythmic dictation application with the conservatory-level music theory students through A/B testing in order to independently evaluate the application’s impact. The results show a significant impact of the application on the students’ exam scores.