There is an ongoing dispute in the community about the absence of a magnetic quantum critical point (QCP) in the noncentrosymmetric heavy fermion compound CeRhSi3. In order to explore this question we prepared single crystals of CeRh(Si1−xGex)3 with x = 0.05 and 0.15 and determined the temperature-pressure (T-p) phase diagram by means of measurements of the electrical resistivity. The substitution of isoelectronic but large Ge enforces a lattice volume increase resulting in a weakening of the Kondo interaction. As a result, the x = 0.05 and x = 0.15 compound exhibit a transition into the antiferromagnetic (AFM) at higher temperatures being TN = 4.7 K and TN1 = 19.7 K, respectively. Application of pressure suppresses TN (TN1) monotonically and pressure induced superconductivity is observed in both Ge-substituted compounds above p ⩾ 2.16 GPa (x = 0.05) and p ⩾ 2.93 GPa (x = 0.15). Extrapolation of TN(p) → 0 of CeRh(Si0.95Ge0.05)3 yields a critical pressure of pc ≈ 3.4 GPa (in CeRh(Si0.85Ge0.15)3  pc ≈ 3.5 GPa) pointing to the presence of an AFM QCP located deep inside the superconducting state.