• Revisiting The Effect Of Teachers' Unions On Student Test Scores

    The Wisconsin protests have predictably spurred a great deal of information-seeking, with union supporters and opponents alike searching for evidence that supports their cases. One of the most prevalent topics over the past week or so is the effect of teacher collective bargaining on student test scores. As a result, a couple of our previous posts have been shared widely. The first (also republished here) compares NAEP scores in states that allow binding teacher contracts with those in states that do not (or have only one or two); the second, follow-up post offers some additional, multivariate analysis.

    Although it is true that the first post (which was at least partially satirical - see the last few sentences) shows that states without binding contracts are among the lowest-performing in the nation, I want to clear something up: As I noted in both posts, neither the data nor my argument offer any conclusive proof that teacher contracts act to increase student test scores. The intention of those posts was to address the age-old counter claim – that teacher contracts are somehow injurious to student achievement – and to provide very tentative evidence that the contracts appear to have little discernible impact either way (which is what the follow-up post, using state-level models that controlled for basic student characteristics, indicated, along with the requisite caveats).

    This speaks directly to those who seek to blame unions for poor achievement in the U.S. - if union contracts were in fact a major contributing cause of low test performance, it might be reasonable to expect to find at least some clear differences between states that did and did not allow them. Although my analysis was extremely limited, I found no such evidence.

    But this also applies to those who have been claiming recently – many in the Wisconsin context – that teacher bargaining clearly improves these outcomes.

  • Value-Added: Theory Versus Practice

    ** Also posted here on “Valerie Strauss’ Answer Sheet” in the Washington Post

    About two weeks ago, the National Education Policy Center (NEPC) released a review of last year’s Los Angeles Times (LAT) value-added analysis – with a specific focus on the technical report upon which the paper’s articles were based (done by RAND’s Richard Buddin). In line with prior research, the critique’s authors – Derek Briggs and Ben Domingue – redid the LAT analysis, and found that teachers’ scores vary widely, but that the LAT estimates would be different under different model specifications; are error-prone; and conceal systematic bias from non-random classroom assignments.  They were also, for reasons yet unknown, unable to replicate the results.

    Since then, the Times has issued two responses. The first was a quickly-published article, which claimed (including in the headline) that the LAT results were confirmed by Briggs/Domingue – even though the review reached the opposite conclusions. The basis for this claim, according to the piece, was that both analyses showed wide variation in teachers’ effects on test scores (see NEPC’s reply to this article). Then, a couple of days ago, there was another response, this time on the Times’ ombudsman-style blog. This piece quotes the paper’s Assistant Managing Editor, David Lauter, who stands by the paper’s findings and the earlier article, arguing that the biggest question is:

    ...whether teachers have a significant impact on what their students learn or whether student achievement is all about ... factors outside of teachers’ control. ... The Colorado study comes down on our side of that debate. ... For parents and others concerned about this issue, that’s the most significant finding: the quality of teachers matters.
    Saying “teachers matter” is roughly equivalent to saying that teacher effects vary widely - the more teachers vary in their effectiveness, controlling for other relevant factors, the more they can be said to “matter” as a factor explaining student outcomes. Since both analyses found such variation, the Times claims that the NEPC review confirms their “most significant finding."

    The review’s authors had a much different interpretation (see their second reply). This may seem frustrating. All the back and forth has mostly focused on somewhat technical issues, such as model selection, sample comparability, and research protocol (with some ethical charges thrown in for good measure). These are essential matters, but there is also an even simpler reason for the divergent interpretations, one that is critically important and arises constantly in our debates about value-added.

  • The Legend Of Last Fall

    The subject of Michelle Rhee’s teaching record has recently received a lot of attention. While the controversy has been interesting, it could also be argued that it’s relatively unimportant. The evidence that she exaggerated her teaching prowess is, after all, inconclusive (though highly suggestive). A little resume inflation from a job 20 years ago might be overlooked, so long as Rhee’s current claims about her more recent record are accurate. But are they?

    On Rhee’s new website, her official bio - in effect, her resume today (or at least her cover letter) - contains a few sentences about her record as chancellor of D.C Public Schools (DCPS), under the header "Driving Unprecedented Growth in the D.C. Public Schools." There, her test-based accomplishments are characterized as follows:

    Under her leadership, the worst performing school district in the country became the only major city system to see double-digit growth in both their state reading and state math scores in seventh, eighth and tenth grades over three years.
    This time, we can presume that the statement has been vetted thoroughly, using all the tools of data collection and analysis available to Rhee during her tenure at the helm of DCPS.

    But the statement is false.

  • A Very Happy Egyptian-American

    Our guest author today is Heba F. El-Shazli, regional program director for the Middle East and North Africa at the AFL-CIO’s American Center for International Labor Solidarity.  Currently she is a visiting professor of international studies and modern languages at the Virginia Military Institute. The views expressed here are her own.

    Today is a great day! A Glorious Day! A day of rejoicing, of celebration, of jubilation, and of so much more than words can describe! Today, Mubarak resigned and Egypt is now in the hands of the Constitutional Court and the Supreme Council of the Egyptian Armed Forces  under the leadership of the Field Marshall Tanatawy. This is a new dawn for a New Democratic Egypt.  This is a revolution that began peacefully on 25 January, and which galvanized all Egyptians from all social classes, men and women. What a message is being sent to everyone all over the world and especially in the Middle East – a message that political change can be achieved by the people and peacefully.

  • Unions = Jobs

    America needs stronger unions… This piquant idea recently occurred to a New York Times business writer as he contemplated the economic question of the day: Where are all the jobs? It’s the question on everyone’s minds. Most economic reports indicate that the economy—at least the corporate profit and Wall Street side of it—is recovering slowly. Profits are soaring and U.S. GDP is up, but job creation remains sluggish, at best.

    So what do unions have to do with it? Before exploring that issue, let’s review why job creation—or it’s lack—is worrying people who are paid to worry about the economy. According to a recent National Journal article, "The Great Recession wiped out what amounts to every U.S. job created in the 21st Century. But even if the recession had never happened the United States would have entered 2010 with 15 million fewer jobs than economists say it should have."

    The article adds that, while the period 2001-2008 witnessed "solid growth" in GDP and corporate profits and a low unemployment rate, job creation was far lower than at any time since World War II.

    What happened?

  • Are Public Employee Unions To Blame For States' Budget Crises?

    A disturbing number of people are blaming public sector unions for states’ current budget crises (also here, here and here). Their basic argument is that unions have seriously exacerbated budget shortfalls because a significant proportion of state spending is tied up in employee compensation, and unions, via collective bargaining, increase salaries and benefits.  As a result, so the line goes, unions have created unsustainable expenses for state governments in a time of declining or still-recovering revenues.

    Needless to say, the relationship between unions and state revenue/spending is complex.  The claim that unions are responsible for state budget gaps (or at least for larger gaps) is therefore extremely difficult to examine, especially during a fiscal crisis. Nevertheless, we can take a quick, modestly rigorous look. 

    There are 30 states that provide collective bargaining rights for state employees, virtually all of them via state laws. One way to evaluate the merit of the accusations above is to see whether states that allow collective bargaining have more severe budget problems than those that do not.

  • Name: Egyptian ... Address: Tahrir Square

    Our guest author today, writing from Cairo, is Kamal Abbas, general coordinator of Egypt’s Center for Trade Unions and Workers Services (CTUWS), who last year accepted the AFL-CIO’s 2009 George Meany-Lane Kirkland Human Rights Award on behalf of Egypt’s independent labor movement. The article is reprinted, with permission.

    Now, I am proud to be Egyptian. I can sit in the evening among my children and grandchildren and tell them the story of the revolution; the story of boys and girls who refused the injustice and tyranny under which we have lived for years and years. I will tell them the story of Mohamed and Boulis [Peter]: the two boys who stood one against the other, each of whom hates and wants to destroy the other ... I will tell them how Boulis and Mohamed stood shoulder to shoulder confronting tyranny. I will tell them how Muslims protected churches against the violence of the regime’s thugs and how Christians guarded Muslims while they performed their prayers in Tahrir [Liberation] Square.

    I will tell them that I have no explanation except that this infamous regime made us reveal our worst part. I will tell my children and grandchildren how thousands, or rather tens of thousands, including young and very beautiful girls demonstrated and that those beautiful girls were not harassed. I will tell them that young males used to listen to the speeches of young females and received orders from them to keep order during the sit-in.

  • Egypt In Crisis: Independent Unions Emerge As Leaders

    Our guest author today is Heba F. El-Shazli, regional program director for the Middle East and North Africa at the AFL-CIO’s American Center for International Labor Solidarity.  Currently she is a visiting professor of international studies and modern languages at the Virginia Military Institute. The views expressed here are her own. This is the first of several posts on events in Egypt.

    January 25, 2011 was the beginning of a peoples’ revolt in Egypt, a revolt whose outcome is still unclear. What is clear is that, after a smothering 30-year rule, Egyptians have broken the stifling collar of oppression to demonstrate for democracy and freedom. Also at issue are the corruption, high unemployment rates, inflation, and low minimum wages that impoverish even the hardest working, most educated people.

    All of this has become fairly well known to Americans over recent days. What is far less known is the role of the small, repressed independent Egyptian labor movement in keeping Egyptian hopes and spirits alive. On January 30, in the middle of Tahrir Square, those workers and their representatives announced the formation of the new "Independent Egyptian Trade Union Federation."

  • A Quality-Based Look At Seniority-Based Layoffs

    ** Also posted here on “Valerie Strauss’ Answer Sheet” in the Washington Post

    Eliminating seniority-based layoffs is a policy idea that is making the rounds these days, with proponents making special appeals to cash-strapped states and districts desperately looking for ways to save money while minimizing decreases in the quality of services.  Mayors, editorial boards, and others have joined in the chorus.

    There’s a few existing high-quality simulations that compare seniority-based layoffs with one alternative – laying off based on teachers’ value-added scores (most recently, one analysis of Washington State and another using data from New York City; both are worth reading).  Unsurprisingly, the simulations show that the two policies would not lay off the same teachers, and that the seniority-based layoffs would save less money for the same number of dismissals (since the least experienced teachers are paid less).  In addition, the teachers laid off based on seniority have lower average value-added scores than those laid off based on those value-added scores (as would inevitably be the case).

    Based in part on these and other analyses, critics have a pretty solid argument on the surface: Seniority makes us “fire good teachers” simply because they don’t have enough experience, and we can fire fewer teachers if we use “quality” instead of seniority. 

    To be clear: I think that there is a sound case for exploring alternatives to seniority-based layoffs, but many of the recent arguments for so-called “quality-based” layoffs have been so simplistic and reactionary that they may actually serve to deter serious conversations about how to change these practices.