The dynamic uncertain environment and complex tasks determine that the unmanned aerial vehicle (UAV) system is bound to develop towards clustering, autonomy，and intelligence. In this paper, we present a comprehensive survey of UAV swarm intelligence from the hierarchical framework perspective. Firstly, we review the basics and advances of UAV swarm intelligent technology. Then we look inside to investigate the research work by classifying UAV swarm intelligence research into five layers, i.e., decision-making layer, path planning layer, control layer, communication layer, and application layer. Furthermore, the relationship between each level is explicitly illustrated, and the research trends of each layer are given. Finally, limitations and possible technology trends of swarm intelligence are also covered to enable further research interests. Through this in-depth literature review, we intend to provide novel insights into the latest technologies in UAV swarm intelligence.