The quasi-exactly solvable Rabi model is investigated within the framework of the Bargmann Hilbert space of analytic functions B. On applying the theory of orthogonal polynomials, the eigenvalue equation and eigenfunctions are shown to be determined in terms of three systems of monic orthogonal polynomials. The formal Schweber quantization criterion for an energy variable x, originally expressed in terms of infinite continued fractions, can be recast in terms of a meromorphic function F(z)=a0+∑k=1∞Mk/(z−ξk) in the complex plane C with real simple poles ξk and positive residues Mk. The zeros of F(x) on the real axis determine the spectrum of the Rabi model. One obtains at once that, on the real axis, (i) F(x) monotonically decreases from +∞ to −∞ between any two of its subsequent poles ξk and ξk+1, (ii) there is exactly one zero of F(x) for x∈(ξk,ξk+1), and (iii) the spectrum corresponding to the zeros of F(x) does not have any accumulation point. Additionally, one can provide a much simpler proof that the spectrum in each parity eigenspace B± is necessarily nondegenerate. Thereby the calculation of spectra is greatly facilitated. Our results allow us to critically examine recent claims regarding solvability and integrability of the Rabi model. •Schweber’s criterion shown equivalent to a meromorphic function F with real simple poles and positive residues.•Calculation of spectra determined as zeros of F greatly facilitated: one has exactly one zero between subsequent poles of F.•Spectrum in a given parity eigenspace is necessarily nondegenerate.•Recent claims regarding solvability and integrability of the Rabi model found to be largely unsubstantiated.