A major issue for the implementation of large-scale superconducting quantum circuits is the interaction with interfacial two-level system (TLS) defects that lead to qubit parameter fluctuations and relaxation. Another major challenge comes from nonequilibrium quasiparticles (QPs) that result in qubit relaxation and dephasing. Here, we reveal a previously unexplored decoherence mechanism in the form of a new type of TLS originating from trapped QPs, which can induce qubit relaxation. Using spectral, temporal, thermal, and magnetic field mapping of TLS-induced fluctuations in frequency tunable resonators, we identify a highly coherent subset of the general TLS population with a low reconfiguration temperature ∼300 mK and a nonuniform density of states. These properties can be understood if the TLS are formed by QPs trapped in shallow subgap states formed by spatial fluctutations of the superconducting order parameter. This implies that even very rare QP bursts will affect coherence over exponentially long time scales.