Join the conversation

...about what is working in our public schools.

Charters: To Skim or Not to Skim?

vonzastrowc's picture

A new study finds that children who enrolled in the Harlem Success Academy (HSA) charter school did better than those who tried to enroll but were not selected in the school lottery. This type of study, which compares the fate of students who won the lottery with that of those who lost, challenges the notion that the best charters do well merely because they select students who would do just as well in any other environment.

But the study also suggests that there might be limits to the charter model. 

For one, the study reveals a few differences between students at HSA and their peers in traditional public schools. Students who entered the lottery but lost did substantially worse than those who won. But those who never entered did worst of all. This finding suggests that the lotteries might attract students who are more likely to succeed. Perhaps they or their families are more motivated, savvier, or able to draw on resources the other students lack.

One group that is noticeably absent from the HSA lottery: students who are still learning English. A full 21 percent of third graders who had never enrolled in the lottery were English Language Learners. Compare that to the four percent of those who had enrolled and the zero percent who won. HSA is apparently not yet reaching a critical population.

None of this diminishes the finding that HSA seems to have made a big difference for those who won the lottery. None of it allows us to wave aside the triumphs of the school, its staff and its students. HSA should prompt us to understand what the school is doing well and see if we can transfer those practices to other schools.

But the study should also prompt us to pay closer attention to so-called "peer effects" in charter schools. Do these schools concentrate students from the most motivated or savviest families in one place? Do the students benefit, at least in part, from the company they keep? Do students in regular public schools lack that advantage? Will regular public schools suffer if charters draw students who, for one reason or another, are most likely to succeed?

Some strong charter supporters openly acknowledge the role of peer effects in the success of the best charter schools. They argue that motivated families deserve the best possible choice for their children, full stop.

But the grander claims offered by some in the media--that charters show us "what works" for all kids, or that the best charter schools don't cream--aren't yet ironclad. Reporters should at least think twice before they use the triumphs of a wonderful charter school as a stick with which to flog regular public schools in the same area.

If we truly believe in our rhetoric of "all kids" and "every child," then I'm not sure we can put so many of our eggs into the charter basket. We still need to help those families who, for whatever reason, aren't enrolling their children in the lotteries. And we must do even more to help those children who have no advocates at all.

(Hat tip to Debra Viadero.)


The creaming argument is

The creaming argument is getting very shopworn. This new study, like Hoxby's study in new York, show that charters do a much better job than public schools. The lottery makes all the difference for those kids who do or don't make it in. You don't have the evidence to prove that charters are creaming, and the study proves that they aren't.

Regardless of whether this is

Regardless of whether this is "legal" or not (and considering some of the heinous things that are legal, I can't see why this wouldn't be), it's an unethical collection of "data." It's nobody's business how children score on a test relative to whether they got into this or that school or program, and they sure shouldn't be "tracking" children like this. I don't care if the names are redacted.

Who do these people think they are?? Do the schools own the children and their scores now that they are used so? I'm kinda doubting each parent involved gave such a blanket permission.

Very maddening, Claus.

I understand where you're

I understand where you're coming from, but this view is incompatible with the entire concept of "data-driven accountability" that is the rallying cry of school reform.

If it's unethical to compare scores of lottery-entering students who attend different schools, why is it okay to use any test scores to compare schools? Or for that matter to use student test scores to compare teacher effectiveness?

PS "Gifted" programs are also

PS "Gifted" programs are also a form of creaming... all kinds of things like this happen in public education and much of it is even self-selected by more affluent parents when they purchase real estate to begin with! That part shouldn't bother us unless we're committed to making all public schools and programs exactly equal... :)

What I have never seen, and

What I have never seen, and would expect to see, if it were true that charter schools are siphoning off the motivated or talented students, is a drop in the scores of the schools these students would otherwise have attended. I assume that if the evidence showed such drops, charter opponents would point out that evidence, but I've never heard of it. If there isn't such an effect, then it's not a zero sum game, as some like to suggest.

Count me in the unrepetant

Count me in the unrepetant creamer camp. I believe, as Claus put it, "motivated families deserve the best possible choice for their children, full stop." I also tend to think that it's not the creaming, per se, but the tight control that's the real difference maker. The cancer in inner city schools is disruption. Charter schools have the ability to counsel out students who are persistent behavior problems or otherwise interfere with teaching and learning (and I don't have a problem with that either). The argument is often made that high achieving charters don't expel many students. This too misses the point. The real threat of expulsion (combined with parents who want their kid to remain in the school) helps create a more serious academic environment. To use an inelegant analogy, you don't call the man with the gun "sir" after he shoots you. You call him "sir" so he won't shoot you in the first place.

Anonymous--I concede the

Anonymous--I concede the points you offer, but you don't address my point. Excellent charter schools may concentrate students from motivated families in one place. Those who don't win in the lottery remain dispersed through regular public schools. The data from this most recent study suggest (and I use that word advisedly) that the students in the lottery might be more predisposed to succeed. Get students like that together, and they can benefit from one another--according the theories about peer effects. Please note that I do not mean to suggest that the school itself isn't contributing a great deal to their success, or that other schools wouldn't do well to pay close attention to what HSA is doing.

Mrs. C--As I'm sure you know, I just don't agree with you about the use of test scores in that way. If we're not going to follow students' progress and compare progress among different schools and students from different groups, then we're basically crossing our fingers and hoping everything will be OK. That's education policy on a wing and a prayer, which won't stand us in very good stead in a much more competitive international environment.

As for your argument about gifted/talented--That's similar to the argument of choice advocates who say it's OK to cream. That's one argument for choice. But that argument is distinctly different from the argument that a broad and expansive charter approach can close all of our gaps. I'm just arguing that we shouldn't forget the students who don't go into the lotteries.

James--I really don't think the kind of study you envision has been conducted. (Please correct me if I'm wrong.) I imagine that such a study would be extraordinarily difficult to do. The children attending charters represent relatively small numbers drawn away from the traditional public schools, so effects would, I imagine, be hard to measure. If test scores in those schools go up or down, moreover, it would be very, very hard to control for all the variables that could cause those changes. So I'm not terribly surprised that no one has cited the data you imagine to prove or shake the case for creaming or peer effects.

My own posting is very speculative, by the way. I don't mean to suggest that the data I offer here--small numbers from one relatively small study--are in anyway ironclad. I just think it makes sense to acknowledge the possibility.

I'm in the unrepentant

I'm in the unrepentant creamer camp, too--if only for the reason that it's honest. Of course, parents with the means (and I don't mean financial resources) to locate a better publicly funded charter school for their child, and the willingness to agree to whatever conditions and expectations the school demands, should do so. No parent should ever sacrifice their child's education on principle.

Do I worry that siphoning off intellectual and community resources into charters weakens public schools? Yes. And I think the results of this study are pretty predictable: take kids out of a demonstrably dysfunctional school and put them in a school their parents believe in, and have chosen to support, and individual outcomes are likely to be better. Research on peer effects supports this prediction.

For parents, this is a question of what to do now, with their precious children. For society, the question is what to do about the most impoverished and underserved children in the nation, and the nearly-defunct concept of the American common school. I've seen too many thriving public schools in the midst of utter poverty and chaos to give up on that idea--but I would never blame parents for making the best possible choices for their kids.

Robert P - Of course, it's

Robert P - Of course, it's hard to argue that motivated and well-behaved children should not have the benefit of being in classrooms with others like themselves. But what above the unmotivated and ill-behaved? If we follow this line to the end, public schools are turning into one big tracking system, with charters taking the high track and, backstopping the charters, traditional public schools taking the low -- and somehow that's OK.

And I guess in the gritty real world where the best must somehow be made of a bad situation, I suppose it is. But let's not fool ourselves into thinking the situation is not bad.

Wouldn't be great if every

Wouldn't be great if every kid could find a comparable school, especially with a poverty rate of 70% that has done just the right amount of creaming? If all magnets could tithe by just taking 10% of of the most challenging kids, we could reduce the critical mass of extreme challenges faced by neighborhood schools.

@Melody "But what above the

@Melody "But what above the unmotivated and ill-behaved? If we follow this line to the end, public schools are turning into one big tracking system..."

This is where research and philosophy yield to personal experience. Every year in my school, I saw capable, hard-working children of diligent parents damaged by close and persistent exposure to the unmotivated and ill-behaved. Peer effects work both ways. Look, I don't like the idea of school as a sorting mechanism either, but surely no one wins when our good intentions insure that no one wins.

I remember being amused -- and then upset -- when a colleague of mine was upset that we had to vacate the fifth floor of our school to make room for a charter. She was opposed to charters, period, and said "Unless we can do it for every child, we shouldn't do it for any child." This is like the captain of the the Titanic saying, "Unless there are lifeboats for every passenger, no one is getting in one."

We have to start somewhere folks. Let's not make the perfect the enemy of the good.

I think the major finding of

I think the major finding of this study is being overlooked by those who seek to make this a "charter or not to charter" argument.

The bottom line is that HSA got significantly better results from kids with similar backgrounds and motivations.

Claus makes argument that there may be some "peer effect" that caused this.

Apply Occam's Razor.

HSA used a KIPP-like approach that had kids put in tons of extra time, provided them tons of additional supports, and held unwaveringly high expectations.

The answer is right in front of us. Disadvantaged kids need more resources and expectations to succeed. HSA got them more resources and expectations.

Rather than try and deflect and distract from what this study means, why aren't we going about the business of providing this approach to the students who could benefit from it?

Jason Glass
Eagle, CO

Jason, I agree that this

Jason, I agree that this should not be a "charter or not to charter" argument. One of my fears is that some people use the HSA study to support the notion that charters are always the better way to go--and I'm not sure that's really the lesson-

As I mentioned in the posting, I also agree that we should look carefully at schools like HSA--both charters and non-charters--that do very well. Without a doubt, disadvantaged students need high expectations and high support to succeed. (Ron Ferguson has wonderful research on this.) That, in fact, is a major theme running through the mini case studies of schools we feature on this site.

But I do think we should keep issues like "creaming" (a word I hate) in mind. How do we engage and empower those families and children who aren't already engaged and empowered? How do we address the needs of children who have few adults fighting for them? Too many of these children aren't really being reached by charter schools or traditional public schools, I fear.

Disadvantaged kids need more

Disadvantaged kids need more resources and expectations to succeed. HSA got them more resources and expectations. Rather than try and deflect and distract from what this study means, why aren't we going about the business of providing this approach to the students who could benefit from it?

But couldn't ALL student benefit from more resources and high expectations? Do we have any evidence that that's not true?

My problem with charter schools a policy center pieces (rather than charter schools as a parent choice) is that it seems to suggest that triage is okay: as a society we're not willing to do what it takes to educate all kids so we should just concentrate resources on the ones who's families care.

Fifty years ago educators made that argument openly and honestly with tracking -- and public policy rebelled. But with charters it the argument returns in a more veiled way. Private philanthropy can be channeled in a way that it isn't "wasted" on children who "can't benefit" from it, and resources can be diverted from "regular" schools because they are failures, and their students a lost cause. But the failure of "regular" schools won't be blamed on lack of private philanthropy, or lower parent engagement -- because "good" teachers do "whatever it takes" (though somehow in charters "what ever it takes" can include expelling students).

I think charters have a valuable role to play as test beds of innovation -- but PLEASE take the lessons they teach seriously and stop playing the Catch-22 game of "charters don't cream, but creaming is fine, and if really all charters is concentrate motivated students and families that's enough, but "regular" schools don't fail because their student are unmotivated (all students can learn!), but because their teachers don't care enough.

This study has not been peer

This study has not been peer reviewed. Neither was the Hoxby study. When the latter eventually peer reviewed by Sean Reardon of Stanford, it was faulted for methodological errors. And Hoxby is also a known advocate of vouchers and charters.
The Harlem Success Academy has resources that regular public schools can only dream of. It has small classes, unlike the regular public schools. The kids who lost the lottery were not in schools with the resources of HSA.
Maybe it was those resources that made a difference, not the program of HSA.
The NY Times said (March 9) that Moskowitz has a marketing budget of $325,000, compared to the public school budget of $500 or less.
Why not do a real experiment where the kids who lost the lottery go to public schools with the same resources as HSA?

Ah, the "we can't do anything

Ah, the "we can't do anything because we aren't funded well enough" argument.

There is absolutely nothing that would keep any public school from reallocating funds to reduce class sizes (read Achilles study on this, advocating for the reassignment of "specialists" like Title 1 and Reading teachers to reduce class sizes), freezing step and lane increases and instead using the money to hire more staff and reduce class sizes (yes, this is an option), or eliminating any number of programs or approaches to reduce class size and increase the length of the school day. All of these could be done cost neutral.

Its much more a matter of priorities, and much less a matter of cash. Make a decision do do something different rather than marching, zombie-like, into the future.

Further, there is absolutely nothing that would prohibit any public school from either raising the money through a foundation, or going after any number of philanthropic or government grant programs to get additional cash to pull off what HSA or KIPP does. This is the old "swim out to your ship, instead of waiting for it to come in" thing.

I work in a public school system that is doing these things and we compete with private and charter school options. It can be done - its a matter of will and commitment.

We've got to stop the whining and start thinking about what we can do instead of all the reasons why we can't.

Charter schools aren't the enemy. Fear of doing something tremendous because its hard or its different is the enemy.

Charter schools aren't the

Charter schools aren't the enemy. Charter schools have one thing that every school should have - the power to enforce their policies. They can because they have alternative slots, known as neighborhood schools. Neighborhood schools need the same alternative backup, but that would cost money. The alternative slots must be of high enough quality to reduce stigma and end any hint of warehousing.

But it will take more than money. We need to first recognize reality and make policies accordingly, not through ideology.

Claus von Zastrow says, “My

Claus von Zastrow says, “My posting is very speculative. I just think it makes sense to acknowledge the possibility.” Just cool it. It’s speculation. It was speculation when I began teaching a few decades ago. The only difference, it was not educators accusing charter schools of creaming; it was Catholic schools that were creaming. I heard it over and over. The Catholic schools creamed off the better students; they can kick out the students who do not behave; and they do not take special ed students. Years later, I heard the same excuse when pilot schools (remember them), magnet schools, small schools, Montessori and Waldorf Schools, pull-out schools, gifted schools, alternative schools, and virtual schools came along. And other renditions of schools will come along in the future and the same people will whine about them too of creaming.

The point is that the people in some public schools keep pointing their fingers at what others are doing “wrong” – the victim mentality - and I never hear a word about what they are doing “right” to their schools to improve student learning and achieving. I want to read posts of people who are doing things to help children learn and improve so that I can learn from them, not a bunch of people whining about other people and their schools so that the status quo can be maintained.

The word “creaming” no longer exists in the real world. Milk no longer comes with cream at the top. Milk is homogenized. Our schools are homogenized. Some charter schools succeed; others fail. Some public schools succeed; others fail. We are all the same. Excellent teachers do well no matter what kind of school they teach in. Don’t degrade the good teachers and the good schools by implying that charter schools are creaming off our better students. We don’t need your speculation and excuses.

Ryan, I'm a bit surprised by

Ryan, I'm a bit surprised by your comment. First, this posting is not meant to "point fingers" at anyone for doing things "wrong," and it certainly doesn't "degrade the good teachers and good schools." Here and elsewhere, I've had high praise for HSA and other schools like it--I don't use the word "triumph" lightly. The post also explicitly notes that we should learn from what HSA is doing right--just as you say we should.

As for your concern that you're "never hearing a word about what [schools] are doing 'right,'" that's a major goal of this site. The schools we profile here--some 120--are certainly not protecting the "status quo."

It's not mean-spirited to have a look at the populations that are--or are not--being served by excellent schools. The NYT released an analysis last week that suggested NYC charters were serving fewer English Language Learners on average than are the traditional public schools. The charters are surely not keeping these students out, but their networks haven't yet fully connected with the Latino community. This is surely a concern for charter leaders.

A major point of this post is that charters and traditional public schools across the country face similar challenges. One of the biggest challenges is how we best serve those children who aren't yet in the networks or--worse--who are least likely to have advocates. That's not an "excuse." It's a call for serious thought and action.

When rich families flee urban

When rich families flee urban public schools for private schools or the suburbs, no one blinks an eye. But give low-income families a way to get their kids out of failing schools by offering charters like HSA, KIPP, or MATCH in Boston and all of a sudden here come the cries of "creaming!"

Why should the lifeboats only be made available to students from wealthy families?

Crimson wife, if people cry

Crimson wife, if people cry "creaming!" it doesn't necessarily mean they're criticizing the school or the families who do all they can to enroll their children. In the case of a number of people who advance the argument, quite the contrary.

But it does suggest that we need to have quite a few different reforms in our bag of tricks. Those in the media who suggest that charters are "what works" for all kids under all conditions are overstating the case. Charters can be a vital reform strategy, and great charters are a critical resource for families, but let's not forget to keep the big picture in mind.

I just signed up to your

I just signed up to your blogs rss feed. Will you post more on this subject?

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.
  • Web page addresses and e-mail addresses turn into links automatically.

More information about formatting options