The inerter-based systems have proven to be effective for vibration control of adjacent structures. The interaction through the soil medium between adjacent structures in urban areas is generally accepted. However, existing studies concerning the inerter-based adjacent structures are primarily based on the assumption of a fixed base, without considering the inevitable interaction. To address this issue, this study incorporated the soil effects into the theoretical analysis of adjacent structures interconnected by an inerter system, and correspondingly develops an optimal design framework for such system. Employing a classic discrete model for structures and soil, the interaction behavior between inerter-based adjacent structures and soil was extensively studied in a comparative analysis. Based on the revealed interaction phenomena, the need for considering the soil condition in the design of an inerter system for adjacent structures was addressed, and a performance-demand-based optimal design framework was developed. The results indicated that for inerter-based adjacent structures spaced closely, the coupled interaction effect of soil and structure requires careful consideration, especially in soft soil conditions. Owing to the soil effects, the inerter system exhibited a weakened effectiveness for displacement reduction. A larger inner deformation of the inerter system is required to meet the demand for energy dissipation. With consideration of the soil condition, the proposed design method can satisfy the pre-specified target displacement demands for adjacent structures, simultaneously optimizing the control cost as an economical solution.