•Standardized exams are commonly used to predict likelihood of passing NCLEX-RN®.•This formative evaluation method uses standardized exams to identify areas of concern following curricular change.•Formative evaluation findings can be used to support attainment of program learning outcomes. Systematic program evaluation is important for assessing nursing program quality and achievement of outcomes. Both summative and formative program evaluation have unique value and purpose, but most program evaluation literature to date has focused on summative methods. The purpose of this article is to describe a formative program evaluation method using standardized exam data that was established by an assessment and evaluation committee in a pre-licensure baccalaureate nursing program during the COVID-19 pandemic. Suggestions for how to use the results to support student achievement of program learning outcomes and program-level attainment of benchmarks are discussed.