Gonadal steroids modulate growth hormone (GH) secretion and the pubertal growth spurt via undefined central pathways. GH-releasing hormone (GHRH) neurons express estrogen receptor α (ERα) and androgen receptor (AR), suggesting changing levels of gonadal steroids during puberty directly modulate the somatotropic axis. We generated mice with deletion of ERα in GHRH cells (GHRH ), which displayed reduced body length in both sexes. Timing of puberty onset was similar in both groups, but puberty completion was delayed in GHRH females. Lack of AR in GHRH cells (GHRH mice) induced no changes in body length, but puberty completion was also delayed in females. Using a mouse model with two reporter genes, we observed that, while GHRH neurons minimally colocalize with Kiss1 in prepubertal mice, ∼30% of GHRH neurons coexpressed both reporter genes in adult females, but not in males. Developmental analysis of and expression suggested that a subpopulation of ERα neurons in the arcuate nucleus of female mice undergoes a shift in phenotype, from GHRH to Kiss1, during pubertal transition. Our findings demonstrate that direct actions of gonadal steroids in GHRH neurons modulate growth and puberty and indicate that GHRH/Kiss1 dual-phenotype neurons play a sex-specific role in the crosstalk between the somatotropic and gonadotropic axes during pubertal transition. Late maturing adolescents usually show delayed growth and bone age. At puberty, gonadal steroids have stimulatory effects on the activation of growth and reproductive axes, but the existence of gonadal steroid-sensitive neuronal crosstalk remains undefined. Moreover, the neural basis for the sex differences observed in the clinical arena is unknown. Lack of ERα in GHRH neurons disrupts growth in both sexes and causes pubertal delay in females. Deletion of androgen receptor in GHRH neurons only delayed female puberty. In adult females, not males, a subset of GHRH neurons shift phenotype to start producing Kiss1. Thus, direct estrogen action in GHRH/Kiss1 dual-phenotype neurons modulates growth and puberty and may orchestrate the sex differences in endocrine function observed during pubertal transition.