NK cell maturation is a continuous process, which initiates in the bone marrow and proceeds in peripheral tissues, where NK cells follow distinct differentiation routes. Drastic phenotypic changes are observed during progression from precursors to mature NK cells, including changes of expression and functionalities of several chemoattractant receptors. Upon differentiation, mature NK cells migrate outside the bone marrow; as well, peculiar subsets of NK cells can also home back to or localize in this anatomic compartment to play specific functions. In humans, NK cells with a tissue resident phenotype have been identified in bone marrow, sharing similarities with tissue resident memory CD8 T cells; while in mouse, long-lived NK cells undergo homeostatic proliferation in this site during viral infections. The mechanisms underlying NK cell subset localization in the bone marrow have only recently started to be investigated, especially in pathological settings such as tumors or infections. In this review, we discuss the phenotype and function of NK cells as well as their requirements for bone marrow maintenance and/or homing.