Migration is now a major component of globalization. The combination of better economic opportunities and lower fertility rates in developed nations suggests that the current migratory wave will last ...for many decades to come (United Nations Population Fund, 2007). In the U.S., immigration over the last thirty years has significantly changed the face of the workforce and the classroom. At the state level, Massachusetts has been one of the top immigrant-receiving states in the Union. Since the 1990's, Massachusetts has been implementing a policy of standardized testing for accountability and graduation. The Massachusetts Comprehensive Assessment System (MCAS) is a set of standardized, norm-referenced tests administered to comply with the test-based accountability provisions of the 1993 No Child Left Behind federal legislation (NCLB). Used today for high-stakes decisions such as NCLB accountability as well as high school graduation requirements, MCAS has raised a number of validity concerns. Differential item functioning analysis, a technique to statistically identify potentially biased in tests, has not been used to challenge the validity of the tests, although it can provide new insights into test bias that were not previously available. This dissertation investigates the presence of differential item functioning in MCAS between native students and immigrant students. It identifies one test, the 2008 Grade 3 MCAS Mathematics test, as having a significant number of items exhibiting differential functioning and compares the original test version to a purified test version with these items removed. The purified test version results in larger test score improvements for immigrants as well as other non-mainstream students. These alternative test scores are sufficiently large to affect the determination of NCLB-based performance status for many schools and districts that are comparatively poorer and more diverse than the average. While the lack of more precise data on immigrants and other characteristics of the data set reduce the definiteness of the results, there is ample cause for concern about the presence of differential item functioning-based bias on MCAS and the need to further study this phenomenon as NCLB -based accountability determinations impact a growing number of schools, districts and communities.
Thesis advisor: Walt Haney
Migration is now a major component of globalization. The combination of better economic opportunities and lower fertility rates in developed nations suggests that the ...current migratory wave will last for many decades to come (United Nations Population Fund, 2007). In the U.S., immigration over the last thirty years has significantly changed the face of the workforce and the classroom. At the state level, Massachusetts has been one of the top immigrant-receiving states in the Union. Since the 1990's, Massachusetts has been implementing a policy of standardized testing for accountability and graduation. The Massachusetts Comprehensive Assessment System (MCAS) is a set of standardized, norm-referenced tests administered to comply with the test-based accountability provisions of the 1993 No Child Left Behind federal legislation (NCLB). Used today for high-stakes decisions such as NCLB accountability as well as high school graduation requirements, MCAS has raised a number of validity concerns. Differential item functioning analysis, a technique to statistically identify potentially biased in tests, has not been used to challenge the validity of the tests, although it can provide new insights into test bias that were not previously available. This dissertation investigates the presence of differential item functioning in MCAS between native students and immigrant students. It identifies one test, the 2008 Grade 3 MCAS Mathematics test, as having a significant number of items exhibiting differential functioning and compares the original test version to a purified test version with these items removed. The purified test version results in larger test score improvements for immigrants as well as other non-mainstream students. These alternative test scores are sufficiently large to affect the determination of NCLB-based performance status for many schools and districts that are comparatively poorer and more diverse than the average. While the lack of more precise data on immigrants and other characteristics of the data set reduce the definiteness of the results, there is ample cause for concern about the presence of differential item functioning-based bias on MCAS and the need to further study this phenomenon as NCLB-based accountability determinations impact a growing number of schools, districts and communities.
Thesis (EdD) — Boston College, 2011.
Submitted to: Boston College. Lynch School of Education.
Discipline: Educational Research, Measurement, and Evaluation.
MEME II: An Environment for Managing Meaning Suarez-Munist, Octavio; Hole, William T.; Irons, Robert J. ...
Proceedings - Symposium on Computer Application in Medical Care,
01/1995
Journal Article
Explaining Your Terminology to a Computer Olson, Nels E.; Sherertz, David D.; Erlbaum, Mark S. ...
Proceedings - Symposium on Computer Application in Medical Care,
01/1995
Journal Article
