We have synthesized a series of cyclopentadithiophene–benzochalcogenodiazole donor–acceptor (D–A) copolymers, wherein a single atom in the benzochalcogenodiazole unit is varied from sulfur to selenium to tellurium, which allows us to explicitly study sulfur to selenium to tellurium substitution in D–A copolymers for the first time. The synthesis of S- and Se-containing polymers is straightforward; however, Te-containing polymers must be prepared by postpolymerization single atom substitution. All of the polymers have the representative dual-band optical absorption profile, consisting of both a low- and high-energy optical transition. Optical spectroscopy reveals that heavy atom substitution leads to a red-shift in the low-energy transition, while the high-energy band remains relatively constant in energy. The red-shift in the low-energy transition leads to optical band gap values of 1.59, 1.46, and 1.06 eV for the S-, Se-, and Te-containing polymers, respectively. Additionally, the strength of the low-energy band decreases, while the high-energy band remains constant. These trends cannot be explained by the present D and A theory where optical properties are governed exclusively by the strength of D and A units. A series of optical spectroscopy experiments, solvatochromism studies, density functional theory (DFT) calculations, and time-dependent DFT calculations are used to understand these trends. The red-shift in low-energy absorption is likely due to both a decrease in ionization potential and an increase in bond length and decrease in acceptor aromaticity. The loss of intensity of the low-energy band is likely the result of a loss of electronegativity and the acceptor unit’s ability to separate charge. Overall, in addition to the established theory that difference in electron density of the D and A units controls the band gap, single atom substitution at key positions can be used to control the band gap of D–A copolymers.