B cells constitute a major component of tumor-infiltrating leukocytes. However, the influence of these cells on malignancy is currently under debate, reflecting the heterogeneity of B cell subsets in tumors. With recent advances, it becomes apparent that this debate includes not only the evaluation of B cells themselves, but also the underlying immune microenvironment network, which scripts the highly heterogeneous B cell populations in tumors and directs the roles of those sub-populations in disease progression and clinical treatment. In this review, we summarize recent findings on the heterogeneous subset composition of B cells in both human and mouse tumor models and their different impacts on disease progression. We further describe the multidimensional interplays between B cells and other immune cells in the tumor microenvironment, which account for the regulation of B cell differentiation and function in situ. We also assess the potential influences of distinct sub-tumor locations on B cell function in primary tumors during development and those under immunotherapy treatment. Illuminating the heterogeneous nature of B cell subset composition, generation, localization, and related immune network in tumor is of immense significance for comprehensively understanding B cell response in tumor and designing more efficacious cancer immunotherapies.