Summary The study of islands has made substantial contributions to the development of evolutionary and ecological theory. However, we know little about microbial community assembly on islands. Using soil microbial data collected from 29 lake islands and nearby mainland, we examined the assembly mechanisms of soil bacterial and fungal communities among and within islands. We found that deterministic processes, especially homogeneous selection, tended to be more important in shaping the assembly of soil bacterial communities among islands, while stochastic processes tended to be more important within islands. Moreover, increasing island area increased the importance of homogeneous selection, but reduced the importance of variable selection, for soil bacterial community assembly within islands. By contrast, stochastic processes tended to dominate soil fungal community assembly both among and within islands, with dispersal limitation playing a more important role within than among islands. Our results highlight the scale‐ and taxon‐dependence of insular soil microbial community assembly, suggesting that spatial scale should be explicitly considered when evaluating the influences of habitat fragmentation on soil microbial communities.