In order to study the laser plasma instabilities (LPIs) in the context of some novel six-side laser-driven indirect designs like the six-cylinder-port hohlraum and the three-axis cylindrical hohlraum, where the laser beams inject in hohlraum with a large angle. LPI experiments in cylindrical hohlraum with only outer beams were designed and performed based on the current laser arrangement condition of SGIII laser facility for the first time. Stimulated Brillouin backscatter (SBS) was found to be the dominant instability with high instantaneous reflectivity in experiments. A typical feature was obtained in the time-resolved spectra of SBS, which maintained similar for different laser intensities of the interaction beam. The experimental data are analyzed by the hydrodynamic simulations combined with HLIP code, which is based on the ray-tracing model. By analysis of experimental data, it is argued that the mixture of gas and Au in the region of their interface is important to SBS, which indicates the need for the mixture model between the filled gas and the high Z plasma from hohlraum wall in the hydrodynamic simulations. Nonlinear saturation of SBS as well as the smoothed beam are also discussed here. Our effective considerations of the ions pervasion effect and the smoothed beam provide utilitarian ways for improvement of the current ray-tracing method.