Naomi Chudowsky and Victor Chudowsky
- Date Posted:
- Is Database:
- Database
New study by @NaomiChudowsky finds state test results often overstate educational gains compared to NAEP, with median average annual gains in grade 4 math proficiency at 1.3% on state tests vs 0.5% on NAEP.
CEP research looks at the disconnect between state testing and NAEP results and finds that while NAEP generally aligns with state trends, they move in the same direction the magnitudes of the state trends are significantly overstated versus the NAEP results. For example the median average annual gain in the percentage proficient on state tests was larger then on NAEP - for grade 4 math, state test showed a median average annual gain of 1.3, where NAEP showed a.5. For 8th grade math those numbers were 1.8, and 1 respectively. (Table 6).
They speculate that several factors might be causing the spread, 1) state test are more aligned with state educational standards. 2) score inflation due to narrow test preparation. 3) Motivation, neither students or parents get individual NAEP results so the test are lower stakes for teachers and students alike versus state exams.4) Y/Y changes in test difficultly.
"...Since 2005, test scores have increased in most states with sufficient data. States with test score gains between 2005 and 2009 far outnumbered those with declines on two different assessments (state tests and NAEP) and two different indicators (percentages scoring proficient/basic and mean scores)..... Within the same state, trends on NAEP usually moved in the same direction as trends on state tests.States with positive trends between 2005 and 2009 on their own tests tended to show positive trends on NAEP. This pattern was apparent in percentages proficient/basic and, to an even greater extent, in mean scores.....Gains on state tests tended to be larger in size than gains on NAEP.This was not always the case, however. In a limited number of states, gains on NAEP were larger than gains on state tests, especially in grade 4 reading...."
Naomi Chudowsky and Victor Chudowsky, "Rising Scores on State Tests and NAEP," Center of Education Policy, September 2010, https://www.cep-dc.org/displayDocument.cfm



