The Elite Illusion: Achievement Effects At Boston And New York Exam Schools
- Date Posted:
- Is Database:
- Database
Attending elite exam schools in Boston & New York yields only scattered academic gains, with most students likely achieving similar success without attending.
Atila Abdulkadiroglu, Joshua Angrist and Parag Pathak, “The Elite Illusion: Achievement Effects At Boston And New York Exam Schools,” Econometrica, January 2014, https://economics.mit.edu/files/9518
“…The results reported here suggest that an exam school education produces only scattered gains for applicants, even among students with baseline scores close to or above the mean in the target school. Because the exam school experience is associated with sharp increases in peer achievement, these results weigh against the importance of peer effects in the education production function. Our results also fail to uncover systematic evidence of racial composition effects. The outcome most strengthened by exam school attendance appears to be the 10th grade English score, a result driven partly by gains for minorities.Given the history of racial preferences (and their more recent elimination) in Boston’s exam schools, this finding seems worth further exploration. Overall, however,while the exam school students in our samples typically have good outcomes, most of these students would likely have done well without the benefit of an exam school education. Of course, test scores and peer effects are only part of the exam school story. It may be that preparation for exam school entrance is itself worthwhile.The RD design captures the impact of peer composition and possibly other changes at admissions cutoffs, while ignoring effects common to applicants on both sides. Likewise, unique features of an exam school education may boost achievement in specific subject areas. Students who attend Boston Latin School almost certainly learn more Latin than they would have otherwise. The many clubs and activities found at some exam schools may expose students to ideas and concepts not easily captured by achievement tests or our post-secondary outcomes. It is also possible that exam school graduates earn higher wages…Still, the estimates reported here suggest that any labor market gains are likely to come through channels other than peer composition and increased cognitive achievement. Can these results be reconciled with those of other studies reporting a strong association between group averages and individual outcomes? Every context is different, and the absence of peer effects in one setting does not prove that such effects are unimportant elsewhere.At the same time, it is worth emphasizing the high risk of specification error in peer analysis….the relationship between an individual-level variable and any group average of this variable is essentially mechanical. Likewise, any regression of one outcome variable on the group average of another outcome variable is biased toward a finding of peer effects due to the presence of common shocks. Random assignment to groups fails to solve either of these problems. Finally, any regression of an individual outcome on a combination of observationally varying individual- and group-level treatments is almost sure to produce something that looks like a peer effect for reasons related to the information content of the average (see, e.g., Acemoglu and Angrist (2000) and Moffitt (2001)). It is perhaps unsurprising, therefore, that experimental or quasi-experimental manipulation of predetermined peercharacteristics is less likely to uncover a peer effect than are other study designs. Estimates from the Moving to Opportunity demonstration, for example, which manipulated peer composition by randomly assigning housing vouchers, are consistent with the results reported here in offering little evidence of causal peer effects…”
Not surprising to me that school doesn’t change cognitive outcomes (remember all these kids were motivated enough to take the entrance exam in the first place) but hard to believe it doesn’t have an impact.




Ed Comment:I’d also like to see his papers on the no elite effect and the one that says the last student admitted to Stuyvesant isn’t hurt by it, although the latter seems less interesting because it’s a we didn’t find any statistically significant effect rather than we found a statistically significant effect, which seems much more reliable to me. I think the benefit of being with elite peers is that the classes can move faster and reach further. When you are with non-elite peers, the instruction is held back. My kid’s schools splits the classes so the smart kids can move faster and dig deeper. If the amount of instruction matters as he claims is the benefit of no excuses characters then, it’s hard to see how this wouldn’t be true.
Steve Comment: The “Elite Illusion” By Atila (Duke) and Josh and Parag (MIT). Underwhelming to me, he isn’t capturing is the counterfactual, what happens to the laststudent admitted to Stuyvesant if he/she doesn’t go over the long term. The expectation at Stuy is to go to an elite school, because that gets you in the door at an institution that provides training (The Bain Consultings or JMP of the world) the expectation at other schools isn’t that. Note:“…he many clubs and activities found at some exam schools may expose students to ideas and concepts not easily captured by achievement tests or our post-secondary outcomes. It is also possible that exam school graduates earn higher wages….”
Steve Comment: The “Elite Illusion” By Atila (Duke) and Josh and Parag (MIT). Underwhelming to me, he isn’t capturing is the counterfactual, what happens to the laststudent admitted to Stuyvesant if he/she doesn’t go over the long term. The expectation at Stuy is to go to an elite school, because that gets you in the door at an institution that provides training (The Bain Consultings or JMP of the world) the expectation at other schools isn’t that. Note:“…he many clubs and activities found at some exam schools may expose students to ideas and concepts not easily captured by achievement tests or our post-secondary outcomes. It is also possible that exam school graduates earn higher wages….”