Ulam’s spiral reveals patterns in the prime numbers by presenting positive integers in a right-angled whorl. The classic spatial prisoner’s dilemma (PD) reveals pathways to cooperation by presenting a model of agents interacting on a grid. This paper brings these tools together via a deterministic spatial PD model that distributes cooperators at the prime-numbered locations of Ulam’s spiral. The model focuses on a narrow boundary game variant of the PD for ease of comparison with early studies of the spatial PD. Despite constituting an initially small portion of the population, cooperators arranged in Ulam’s spiral always grow to dominance when (i) the payoff to free-riding is less than or equal to 8/6 (≈1.33) times the payoff to mutual cooperation and (ii) grid size equals or exceeds 23 × 23. As in any spatial PD model, particular formations of cooperators spur this growth and here these formations draw attention to rare configurations in Ulam’s spiral.