Every day we read about people asking, “At what grade level does my child read?” “Is it true that 54% of adults in the U.S. read below a sixth-grade level?” “Have reading scores dropped an entire grade level since the pandemic?”
The assumption behind these questions is test scores are precise indicators of reading ability, like scientific laboratory measurements. But like blood pressure levels — in which there is agreement about what’s being measured — they are variable and open to interpretation.
Despite the subjectivity and lack of agreement in defining reading, grade level and ability, grade-level reading ability is often mistakenly viewed as determined by a precise, stable test score, one that does not take into account factors such as students’ health and hunger in their testing performance. Not everyone agrees on what is salient at a particular grade level, leading to subjectivity in weighting phonics knowledge, vocabulary, comprehension, the ability to synthesize a theme and recognize an author’s point of view in a given passage, or some combination of such things.
Standardized tests are typically the basis for establishing grade level. But test scores themselves don’t indicate grade level, which is a creation of an interpreter. That’s why different tests don’t always produce the same grade level. A student who tests at fourth grade in one state may test at the third or fifth grade when moving to another state using a different test. In short, different tests or standards can produce different grade levels.
Credit: Contributed
Credit: Contributed
The National Assessment of Educational Progress calls itself “the nation’s report card” even to the point of using the phrase on its website and then having it repeated as if it is an established fact. It is often invoked in commentaries on grade levels. But it wasn’t designed for that purpose. NAEP itself states that “NAEP Proficient achievement level does not represent grade level proficiency as determined by other assessment standards (e.g., state or district assessments). NAEP achievement levels are to be used on a trial basis and should be interpreted and used with caution.”
But that hasn’t stopped many policy makers and journalists from trying to connect a NAEP test score to a grade level. Giving in to political pressure and rejecting recommendations from authorities in developing tests, in 1990 NAEP officials did introduce four tiers of reading achievement: Below Basic, Basic, Proficient and Advanced. These levels were established solely using subjective judgment about what’s expected of children tested at a specific grade level.
Credit: Peter Smagorinsky
Credit: Peter Smagorinsky
Then, they set equally subjective cut scores to establish boundaries between these four levels. States often use a parallel model for their own tests. In Virginia, student performance is measured on a 0–600 scale, with proficiency set at 400-499 and advanced at 500 or above. It’s hard to imagine that a meaningful difference exists between a student scoring 499 (proficient) and 500 (advanced).
Much confusion is also centered in interpreting whether “basic” is acceptably normal or if it is reasonable to expect all students to be “proficient.” Many commentators, some of whom have a vested interest in arguing that there is a reading crisis, argue the latter. Some have promoted the false idea that “proficient” is grade-level reading, which it absolutely is not. Then, they wrongly argue that two-thirds of American students are reading below grade level by counting “basic” scores as below grade level.
Another way to illustrate the problem is to simply rename NAEP’s subjective categories as “below average,” “average,” “above average” and “far above average.” Then, approximately 60% of students are reading at or above an average score, and only 40% (instead of the usually expected 50%) of students are below average. Presto, much of the reading crisis disappears. As further evidence against a crisis, there has been relatively little variation in NAEP reading scores since 1992, even if an upward trend began retreating around 2015 with many plausible but unconfirmed explanations.
A number of educators have debunked the conclusions of NAEP misinterpreters. Yet, the dogged belief persists that everything can be reduced to subjective interpretations of test scores divided into hierarchical categories that can be falsely, if conveniently, converted to grade levels.
We are concerned whenever we encounter all-too-common misinformation about grade-level reading ability. When misinformation becomes disinformation offered by those who use grade-level reading ability to advance political, polemical or ideological agendas, we become concerned about how faith in test scores lends them to manipulation and deception to help create the crisis that critics have historically claimed is engulfing schools, only to be saved by their favorite solutions.
David Reinking is a retired professor at Clemson and the University of Georgia, an inductee in the Reading Hall of Fame, and a former co-editor of Reading Research Quarterly and Journal of Literacy Research. Peter Smagorinsky is a retired professor at UGA, an inductee in the Reading Hall of Fame, and a former co-editor of Research in the Teaching of English.
If you have any thoughts about this item, or if you’re interested in writing an op-ed for the AJC’s education page, drop us a note at education@ajc.com.
Keep Reading
The Latest
Featured
