Normally, I would analyze an article like this in this commentary. However, I agree with nearly everything this article says.
From the article:
Think of it this way: If a golf pro gives Tiger Woods a lesson, and a different golf pro gives me a lesson, can we conclude that Tiger's teacher is better than mine because Tiger beats me by three shots in a match after our lessons?
That's usually how newspapers and real estate agents pick the "best schools." The true measure of quality -- with golf pros or elementary schools -- is how much value they add. In education, that turns out to be extremely difficult to calculate.
Indeed, as this Country struggles with the reauthorization of the No Child Left Behind Act, and Texas struggles with transforming the current accountability system, this article provides sage and sound advice.
______________________________________________
What 'Good' and 'Bad' Really Mean
More than a decade ago, I wrote a magazine story on a very famous high school located in an affluent Chicago suburb. I remember an education researcher telling me at the time, "If you took these kids and put them in a closet in their freshman year, and then let them out three years later, they'd still do well on the SAT."
(Just to be clear, this was a hypothetical example. No students were actually put in a closet. Their parents would have gone ballistic.)
Sadly, the opposite is true in other communities: Students begin kindergarten woefully unprepared to learn, and they receive little support while they're in school. Because American communities tend to be highly segregated by income, we have a lot of schools with a disproportionate number of privileged or disadvantaged students.
We all know that -- and yet we routinely describe schools as "good" or "bad" based on things that have more to do with who walks in the front door than with what happens inside the building.
Measuring with a Broken Yardstick
Think of it this way: If a golf pro gives Tiger Woods a lesson, and a different golf pro gives me a lesson, can we conclude that Tiger's teacher is better than mine because Tiger beats me by three shots in a match after our lessons?
That's usually how newspapers and real estate agents pick the "best schools." The true measure of quality -- with golf pros or elementary schools -- is how much value they add. In education, that turns out to be extremely difficult to calculate.
You may be thinking that we could probably fix this with a simple pre- and post-test -- let's measure what kids know when they walk in the school door, and then measure how much they know when they leave, one or four or eight years later. The best schools will be the ones with the students who show the most improvement.
Not exactly. Gifted students don't merely begin at a higher level, they also learn at a faster rate. So, to stick with our athletic example, suppose that neither Tiger Woods nor Michael Moore has ever played tennis before. If we give them each a tennis coach, can we evaluate the quality of those coaches based on the subsequent outcome of a tennis match between Tiger Woods and Michael Moore? (Pause for a moment and consider what a great pay-per-view event that would be.)
Evaluate the Evaluation
So schools with high test scores may or may not be doing a great job; perhaps their students are capable of much more. And conversely, some schools with middling or poor test scores may be doing a terrific job educating students who would otherwise be failing abjectly.
Obviously, we can spot the outliers -- the school in the middle of Detroit that manages to send 95 percent of its students to college, say. If we give researchers enough time and enough data, they can try to answer the school-quality question using statistical techniques that take account of what kind of students are walking through the front door.
But even then the results are often equivocal. The bottom line is that it's hard to evaluate school quality, which is why it's even harder to make schools better.
The First Challenge
We're trying to encourage and replicate success without being able to tell with any degree of certainty which schools are succeeding, then. Imagine a pharmaceutical company trying to evaluate new cancer treatments without being able to determine which patients are getting better.
So that's the first big education challenge -- developing a more sophisticated way to identify "good schools." Only then will we be able to create more of them.
Comments