Purpose Despite growing evidence supporting the benefits of yoga for cancer-related symptom management, yoga usage among cancer survivors is low. To translate the evidence of yoga benefits into community practice, it is critical to understand interest in yoga as well as barriers and preferences that influence yoga usage among cancer survivors. Method We conducted a cross-sectional survey study among cancer survivors, 18 years or older, with a primary diagnosis of cancer, and receiving treatment or follow-up care at outpatient clinics at five regional academic cancer center sites. We collected data and performed bivariate and multivariable analyses on self-reported yoga usage and interest in and barriers to practicing yoga, as well as preferred location and time for yoga practice. Results Of 857 participants, 70.0% had never practiced yoga and 52.3% were interested in practicing yoga. Among those interested, 52.5% had never practiced yoga. Lower interest was independently associated with being male (odds ratio OR = 0.30, 95% confidence interval CI = 0.20–0.44, p < 0.001), unemployed (OR = 0.60, 95% CI = 0.39–0.91, p = 0.016), and white (OR = 0.42, 95% CI = 0.23–0.78, p = 0.005). Commonly cited barriers among those who were interested but had never practiced were not aware of yoga benefits (36.3%), difficulty motivating (28.7%), experiencing symptoms (22.9%), and not enough time (22.0%). Participants indicated “on-site and at a studio near home” (41.5%) as preferred location and evenings (3–8 pm, 34.0%) as preferred time for yoga practice. Conclusion Although more than 50% of patients indicated interest in practicing yoga, use of yoga is low among cancer survivors. Barriers and patient preferences for yoga practice need to be addressed to design effective yoga programs for this population.