This open access book describes the Reading Success project, in which a 5-step, assessment-to- intervention process, based on the Simple View of Reading, was used within a primary school setting in ...Australia to better support those students who struggle with reading. It provides an easily accessible overview of each step of the process involved in implementing this approach and highlights the crucial importance of collaboration between professionals involved in the teaching of reading within a school setting. It focuses on the decision-making processes used, such as rich dialogue with the leadership team and teachers, and shares participants’ perspectives gathered throughout the project. Using case studies, the book describes how the 5-step approach assists in creating detailed profiles of students’ strengths and weaknesses in spoken and written language skills that can be used to guide targeted intervention This book offers valuable insights for educators, speech pathologists, researchers, and pre-service teacher education students interested in the teaching of reading
Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural ...language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers.
The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.
Despite developments in research and practice on using examinee response process data in assessment design, the use of such data in test validation is rare. Validation of Score Meaning in the Next ...Generation of Assessments Using Response Processes highlights the importance of validity evidence based on response processes and provides guidance to measurement researchers and practitioners in creating and using such evidence as a regular part of the assessment validation process. Response processes refer to approaches and behaviors of examinees when they interpret assessment situations and formulate and generate solutions as revealed through verbalizations, eye movements, response times, or computer clicks. Such response process data can provide information about the extent to which items and tasks engage examinees in the intended ways. With contributions from the top researchers in the field of assessment, this volume includes chapters that focus on methodological issues and on applications across multiple contexts of assessment interpretation and use. In Part I of this book, contributors discuss the framing of validity as an evidence-based argument for the interpretation of the meaning of test scores, the specifics of different methods of response process data collection and analysis, and the use of response process data relative to issues of validation as highlighted in the joint standards on testing. In Part II, chapter authors offer examples that illustrate the use of response process data in assessment validation. These cases are provided specifically to address issues related to the analysis and interpretation of performance on assessments of complex cognition, assessments designed to inform classroom learning and instruction, and assessments intended for students with varying cultural and linguistic backgrounds.
This book explores issues regarding student assessment in university-level physics education. With a firm emphasis on practical experience and numerous examples of current assessments, the book ...serves as a guide to academics new to assessment, as a refresher to more experienced academics who wish to think more deeply about what they are trying to achieve, and as a challenge to senior figures working on higher education infrastructure.
This open access book provides a comprehensive and informative overview of the current state of research about student perceptions of and student feedback on teaching. After presentation of a new ...student feedback process model, evidence concerning the validity and reliability of student perceptions of teaching quality is discussed. This is followed by an overview of empirical research on the effects of student feedback on teachers and instruction in different contexts, as well as on factors promoting the successful implementation of feedback in schools. In summary, the findings emphasize that student perceptions of teaching quality can be a valid and reliable source of feedback for teachers. The effectiveness of student feedback on teaching is significantly related to its use in formative settings and to a positive feedback culture within schools. In addition, it is argued that the effectiveness of student feedback depends very much on the support for teachers when making use of the feedback. As this literature review impressively documents, teachers in their work - and ultimately students in their learning - can benefit substantially from student feedback on teaching in schools. “This book reviews what we know about student feedback to teachers. It is detailed and it is a pleasure to read. To have these chapters in one place – and from those most up to date with the research literature and doing the research - is a gift.” John Hattie
This Open Access book presents an international group of scholars seeking to understand how youth from different cultures relate to modern multidimensional concepts of citizenship, and the roles that ...education and society have in shaping the views of the world’s future citizens. The book also explores how different aspects of citizenship, such as attitudes towards diverse population groups and concerns for social issues, relate to classical definitions of norm-based citizenship from the political sciences. Authors from Asia, Europe, and Latin America provide a series of in-depth investigations into how concepts of “good citizenship” are shaped in different regions of the globe, using the rich comparative data from the IEA’s International Civic and Citizenship Study (ICCS) 2016. In twelve chapters, the authors review the concept of “good citizenship”; how citizenship norms adherence is configured into profiles across countries; and what country, school, and background factors are related to how students adhere to citizenship norms. Recognizing contingent social and political situations in specific regions of the world, the present books offer six chapters where authors apply their expertise to offer locally relevant and pertinent observations on how young people from diverse cultures understand and relate to different dimensions of citizenship in countries of Asia, Europe, and Latin America. The present book is of relevance for different audiences interested in civic education and political socialization, including social sciences and education, integrating topics from political science, sociology, political psychology, and law.
This open access book discusses challenges in school improvement research and different methodological approaches that have the potential to foster school improvement research. Research on school ...improvement and accountability analysis places high demands on a study’s design and method. The potential of combining the depth of case studies with the breath of quantitative measures and analyses in a mixed-methods design seems very promising. Consequently, the focus of the book lies on innovative methodological approaches. The book chapters address design, measurement, and analysis developments as well as theoretical and conceptual developments. The relevance of the research presented in the chapters for educational accountability is discussed in the book’s discussion chapter. More specifically, authors present one specific innovative methodological approach and clarify that approach with a concrete example in the context of school improvement, based on empirical data when possible. In this way, this book helps researchers designing complex useful studies.
This open access report presents findings from the five Latin American countries that participated in the second cycle of the IEA International Civic and Citizenship Education Study (ICCS 2016). ICCS ...2016 investigated the ways in which a range of countries are preparing their young people to undertake their roles as citizens during the second decade of the 21st century. The study also responded to new challenges in civic and citizenship education, and its findings allow robust comparisons of lower-secondary students’ attitudes to and perceptions of a wide range of aspects related to civics and citizenship. The results presented in this report come mainly from data collected via a regional Latin American student questionnaire. The findings provide insights into Latin American lower-secondary students’ thoughts on government practices (e.g., corruption and authoritarian government), their attitudes toward peaceful coexistence (e.g., use of violence, disobedience to the law, empathy), and their perceptions of diversity in society (e.g., tolerance of and discrimination against minorities and homosexuals). Four of the five participating Latin American countries also participated in the previous cycle of this study (ICCS 2009), making it possible to explore changes in young people’s civic-related perceptions and attitudes between 2009 and 2016. Data from the international part of the study (test and questionnaire) were used to review the extent to which region-specific perceptions relate to other factors such as students’ level of civic knowledge and students’ socioeconomic and educational contexts.
Integrating Timing Considerations to Improve Testing Practices synthesizes a wealth of theory and research on time issues in assessment into actionable advice for test development, administration, ...and scoring. One of the major advantages of computer-based testing is the capability to passively record test-taking metadata—including how examinees use time and how time affects testing outcomes. This has opened many questions for testing administrators. Is there a trade-off between speed and accuracy in test taking? What considerations should influence equitable decisions about extended-time accommodations? How can test administrators use timing data to balance the costs and resulting validity of tests administered at commercial testing centers? In this comprehensive volume, experts in the field discuss the impact of timing considerations, constraints, and policies on valid score interpretations; administrative accommodations, test construction, and examinees’ experiences and behaviors; and how to implement the findings into practice. These 12 chapters provide invaluable resources for testing professionals to better understand the inextricable links between effective time allocation and the purposes of high-stakes testing.
