Revisiting The Effect Of Teachers' Unions On Student Test Scores

The Wisconsin protests have predictably spurred a great deal of information-seeking, with union supporters and opponents alike searching for evidence that supports their cases. One of the most prevalent topics over the past week or so is the effect of teacher collective bargaining on student test scores. As a result, a couple of our previous posts have been shared widely. The first (also republished here) compares NAEP scores in states that allow binding teacher contracts with those in states that do not (or have only one or two); the second, follow-up post offers some additional, multivariate analysis.

Although it is true that the first post (which was at least partially satirical - see the last few sentences) shows that states without binding contracts are among the lowest-performing in the nation, I want to clear something up: As I noted in both posts, neither the data nor my argument offer any conclusive proof that teacher contracts act to increase student test scores. The intention of those posts was to address the age-old counter claim – that teacher contracts are somehow injurious to student achievement – and to provide very tentative evidence that the contracts appear to have little discernible impact either way (which is what the follow-up post, using state-level models that controlled for basic student characteristics, indicated, along with the requisite caveats).

This speaks directly to those who seek to blame unions for poor achievement in the U.S. - if union contracts were in fact a major contributing cause of low test performance, it might be reasonable to expect to find at least some clear differences between states that did and did not allow them. Although my analysis was extremely limited, I found no such evidence.

But this also applies to those who have been claiming recently – many in the Wisconsin context – that teacher bargaining clearly improves these outcomes.

Unions = Jobs

America needs stronger unions… This piquant idea recently occurred to a New York Times business writer as he contemplated the economic question of the day: Where are all the jobs? It’s the question on everyone’s minds. Most economic reports indicate that the economy—at least the corporate profit and Wall Street side of it—is recovering slowly. Profits are soaring and U.S. GDP is up, but job creation remains sluggish, at best.

So what do unions have to do with it? Before exploring that issue, let’s review why job creation—or it’s lack—is worrying people who are paid to worry about the economy. According to a recent National Journal article, "The Great Recession wiped out what amounts to every U.S. job created in the 21st Century. But even if the recession had never happened the United States would have entered 2010 with 15 million fewer jobs than economists say it should have."

The article adds that, while the period 2001-2008 witnessed "solid growth" in GDP and corporate profits and a low unemployment rate, job creation was far lower than at any time since World War II.

What happened?

Are Public Employee Unions To Blame For States' Budget Crises?

A disturbing number of people are blaming public sector unions for states’ current budget crises (also here, here and here). Their basic argument is that unions have seriously exacerbated budget shortfalls because a significant proportion of state spending is tied up in employee compensation, and unions, via collective bargaining, increase salaries and benefits.  As a result, so the line goes, unions have created unsustainable expenses for state governments in a time of declining or still-recovering revenues.

Needless to say, the relationship between unions and state revenue/spending is complex.  The claim that unions are responsible for state budget gaps (or at least for larger gaps) is therefore extremely difficult to examine, especially during a fiscal crisis. Nevertheless, we can take a quick, modestly rigorous look. 

There are 30 states that provide collective bargaining rights for state employees, virtually all of them via state laws. One way to evaluate the merit of the accusations above is to see whether states that allow collective bargaining have more severe budget problems than those that do not.

Teacher Contracts: The Phantom Menace

In a previous post, I presented a simple tabulation of NAEP scores by whether or not states had binding teacher contracts.  The averages indicate that states without such contracts (which are therefore free of many of the “ill effects” of teachers’ unions) are among the lowest performers in the nation on all four NAEP exams. 

The post was largely a response to the constant comparisons of U.S. test scores with those of other nations (usually in the form of rankings), which make absolutely no reference to critical cross-national differences, most notably in terms of poverty/inequality (nor to the methodological issues surrounding test score comparisons). Using the same standard by which these comparisons show poor U.S. performance versus other nations, I “proved” that teacher contracts have a positive effect on states’ NAEP scores.

As I indicated at the end of that post, however, the picture is of course far more complicated. Dozens of factors – many of them unmeasurable – influence test scores, and simple averages mask them all. Still, given the fact that NAEP is arguably the best exam in the U.S. – and is the only one administered to a representative sample of all students across all states (without the selection bias of the SAT/ACT/AP) – it is worth revisiting this issue briefly, using tools that are a bit more sophisticated. If teachers’ contracts are to blame for low performance in the U.S., then when we control for core student characteristics, we should find that the contracts’ presence is associated with lower performance.  Let’s take a quick look.

A Hypocritical World Bows A Little More Deeply to Workers' Rights

What to think? The UN Human Rights Council (UNHCR) last week approved by "consensus" the creation of a "Special Rapporteur" on freedom of association and assembly. Special Rapporteurs are empowered to investigate, monitor and recommend solutions to human rights problems. In this instance, the Rapporteur will review members’ compliance with a UN resolution on these fundamental rights.

The first reaction to this development, of course, must be skepticism, leavened with deep suspicion. The UNHRC’s membership is usually heavily weighted toward nondemocratic states which routinely infringe on citizens’ right to freedom of association and assembly, including many nations with a majority Muslim population. As a result, the Council, formerly the UN Commission on Human Rights, has a long record of pursuing any and all human rights allegations against Israel with single-minded fury. So, when such a body, with such a disgraceful record, creates a Special Rapporteur on any subject, it necessarily sends a shiver down the spine.

Still, it is interesting. What makes the resolution intriguing is that Russia, China, Cuba, and Libya – who love to grandstand at the Council – opposed the Special Rapporteur and "disassociated themselves" from it, though they chose not to upset the "consensus" applecart by calling for a vote. Their objections make interesting reading. To sum up, they are all for freedom of assembly and association (sort of). They just don’t need some UN guy snooping around, raising questions, talking to people, and writing reports. Even worse, if they don't cooperate with the snooper, he’ll write a report about that.

Well.

Performance-Enhancing Teacher Contracts?

** Also posted here on “Valerie Strauss’ Answer Sheet” in the Washington Post.

Please check out our two other posts (here and here), which present summaries and discussions of the actual evidence on the relationship between unions and test scores.

For years, some people have been determined to blame teachers’ unions for all that ails public education in America. This issue has been around a long time (see here and here), but, given the tenor of the current debate, it seems to bear rehashing.  According to this view, teachers unions negatively affect student achievement primarily through the mechanism of the collective bargaining agreement, or contract. These contracts are thought to include “harmful” provisions, such as seniority-based layoffs and unified salary schedules that give raises based on experience and education rather than performance.

But a fairly large proportion of public school teachers are not covered under legally-binding contracts.  In fact, there are ten states in which there are no legally binding K-12 teacher contracts at all (AL, AZ, AR, GA, LA, MS, NC, SC, TX, and VA). Districts in a few of these states have entered into what are called “meet and confer” agreements about salary, benefits, and other working conditions, but administrators have the right to break these agreements at will. For all intents and purposes, these states are free of many of the alleged “negative union effects."

Here’s a simple proposition: If teacher union contracts are the problem, then we should expect to see higher achievement outcomes in the ten states where there are no binding teacher contracts.

So, let’s take a quick look at how states with no contracts compare with the states that have them.

Do Americans Think Unions Help Everyone?

The question in the headline is fundamental when trying to understand attitudes towards organized labor, as well as the relatively low union presence in the U.S. The "if I can't have it, nobody can" attitude that anti-labor advocates try to promote among non-members packs far less punch if people understand that many of the conditions they take for granted - trivial things like sick days, minimum wages, and yes, weekends - are in no small part thanks to past and current efforts of the U.S. labor movement. Awareness of these efforts, and of the positive union effect on everyone's wages and benefits, is also, no doubt, partially dependent on one's experience with unions (e.g., coming from a "union family").

So, it might be instructive to take a quick look at attitudes towards labor's effects in the U.S. compared with those in other nations, and whether this appears to be related to the degree of unionization. Basically - do Americans think unions help all workers, and how do our attitudes stack up against other nations?