As one of the three elements of language, the study of grammar plays an important role in the field of linguistics and teaching Chinese as a foreign language. In the process of overseas teaching, the problem that Chinese learners think grammar is very difficult to learn, some teachers ignore grammar teaching or lack of effective teaching methods. Based on the practical problem, the authors try to explore a concise and clear Chinese grammar framework to help students build a knowledge structure that is easier to recognize and memorize, and improve the teaching quality of teachers of Chinese as a foreign language. This paper mainly tries to find out the principles of establishing the grammatical framework through the definition and research of the grammatical framework, and introduces the regularity, systematization and inspiration of scientific thinking into teaching, so as to open up a new way of thinking for Chinese grammar teaching. Using chart data analysis, understand students’ background, learning difficulties and reasons. Through the comparison of teaching effects between the experimental group and the control group, it is found that students have a deeper understanding and improvement of Chinese cognition and learning after the construction of the grammar framework. However, how to construct a Chinese grammar framework that is more conducive to teachers and students should be created and developed in the long-term exploration and practice.