There were limited studies specifically evaluating whether the difference of the prevalence of sarcopenia exists in men and women in older adults from rural areas in China. The aim of this study was to compare the prevalence of sarcopenia between men and women in a rural area in eastern China and to explore the underlying causes. This study included 1,105 participants aged 60-89 years. Muscle mass was measured by bio-electrical impedance analysis. Hand grip strength was measured by Jamar Hydraulic Hand Dynamometer. Sarcopenia was diagnosed according to the Asian Working Group for Sarcopenia-2019 Consensus. Data were analyzed using log-binomial and linear regression. The prevalence of sarcopenia was 21.7% in women and 12.9% in men among the study cohort. After adjusting for age, education level, number of diseases, income level, smoking, drinking, and eating habits, proportion of people with sarcopenia was 1.49-fold greater in women than in men (PR = 1.49, 95% CI 1.01-2.26,  = 0.055). The prevalence of sarcopenia in elderly women in this rural area of eastern China is higher than in men, suggesting that women in rural areas in China seem to be more vulnerable for sarcopenia, thus early screening and prevention need to be provided for them to address such gender disparity in health.