Estrogen signaling in the central nervous system promotes weight loss by increasing thermogenesis and physical activity in the ventromedial hypothalamus (VMH), but the precise neuronal populations regulating these aspects of energy expenditure remain unclear. Here we define the molecular and functional heterogeneity of the VMH using single cell RNA sequencing, in situ hybridization, chemogenetic activation, and targeted gene knockdown. We describe six molecularly distinct neuron clusters in the VMH. In females, estrogen receptor alpha (ERα) is restricted to neurons expressing tachykinin-1 (Tac1) or reprimo (Rprm). Further, Tac1 and Rprm expression is enriched in females, a sex difference that is established by permanent effects of gonadal hormones early in life. Finally, while Tac1 ablation selectively impairs movement, here we show that silencing Rprm selectively dysregulates temperature without affecting physical activity. Together this work provides a novel architectural framework whereby distinct and sexually differentiated neuron populations within the VMH mediate sex-specific aspects of metabolic homeostasis.