A subpopulation of cancer stem cells (CSCs) plays a critical role of cancer progression, recurrence, and therapeutic resistance. Many studies have indicated that castration-resistant prostate cancer (CRPC) is associated with stem cell phenotypes, which could further promote neuroendocrine transdifferentiation. Although only a small subset of genetically pre-programmed cells in each organ has stem cell capability, CSCs appear to be inducible among a heterogeneous cancer cell population. However, the inductive mechanism(s) leading to the emergence of these CSCs are not fully understood in CRPC. Tumor cells actively produce, release, and utilize exosomes to promote cancer development and metastasis, cancer immune evasion as well as chemotherapeutic resistance; the impact of tumor-derived exosomes (TDE) and its cargo on prostate cancer (PCa) development is still unclear. In this study, we demonstrate that the presence of Cav-1 in TDE acts as a potent driver to induce CSC phenotypes and epithelial-mesenchymal transition in PCa undergoing neuroendocrine differentiation through NFκB signaling pathway. Furthermore, Cav-1 in mCRPC-derived exosomes is capable of inducing radio- and chemo-resistance in recipient cells. Collectively, these data support Cav-1 as a critical driver for mCRPC progression.