Spermatogonial stem cells (SSCs) have the dual capacity to self-renew and differentiate into progenitor spermatogonia that develop into mature spermatozoa. Here, we document that preferentially expressed antigen of melanoma family member 12 (PRAMEF12) plays a key role in maintenance of the spermatogenic lineage. In male mice, genetic ablation of Pramef12 arrests spermatogenesis and results in sterility which can be rescued by transgenic expression of Pramef12. Pramef12 deficiency globally decreases expression of spermatogenic-related genes, and single-cell transcriptional analysis of post-natal male germline cells identifies four spermatogonial states. In the absence of Pramef12 expression, there are fewer spermatogonial stem cells which exhibit lower expression of SSC maintenance-related genes and are defective in their ability to differentiate. The disruption of the first wave of spermatogenesis in juvenile mice results in agametic seminiferous tubules. These observations mimic a Sertoli cell-only syndrome in humans and may have translational implications for reproductive medicine.