Developing novel materials and device architectures to further enhance the efficiency of polymer solar cells requires a fundamental understanding of the impact of chemical structures on photovoltaic properties. Given that device characteristics depend on many parameters, deriving structure–property relationships has been very challenging. Here we report that a single parameter, hole mobility, determines the fill factor of several hundred nanometer thick bulk heterojunction photovoltaic devices based on a series of copolymers with varying amount of fluorine substitution. We attribute the steady increase of hole mobility with fluorine content to changes in polymer molecular ordering. Importantly, all other parameters, including the efficiency of free charge generation and the coefficient of nongeminate recombination, are nearly identical. Our work emphasizes the need to achieve high mobility in combination with strongly suppressed charge recombination for the thick devices required by mass production technologies.