• Select Your Conclusions, Apply Data

    The recent release of the National Assessment of Educational Progress (NAEP) and the companion Trial Urban District Assessment (TUDA) was predictably exploited by advocates to argue for their policy preferences. This is a blatant misuse of the data for many reasons that I have discussed here many times before, and I will not repeat them.

    I do, however, want to very quickly illustrate the emptiness of this pseudo-empirical approach – finding cross-sectional cohort increases in states/districts that have recently acted policies you support, and then using the increases as evidence that the policies “work." For example, the recent TUDA results for the District of Columbia Public Schools (DCPS), where scores increased in all four grade/subject combinations, were immediately seized upon supporters of the reforms that have been enacted by DCPS as clear-cut evidence of the policy triumph. The celebrators included the usual advocates, but also DCPS Chancellor Kaya Henderson and the U.S. Secretary of Education Arne Duncan (there was even a brief mention by President Obama in his State of The Union speech).

    My immediate reaction to this bad evidence was simple (though perhaps slightly juvenile) – find a district that had similar results under a different policy environment. It was, as usual, pretty easy: Los Angeles Unified School District (LAUSD).

  • Recovering One Of The Midwest’s Best Ideas

    * Reprinted here in the Washington Post

    Our guest author today is Dr. Conor P. Williams, a proud product of Michigan’s public schools, and currently a Senior Researcher in the New America Foundation’s Early Education Initiative. Follow him on Twitter: @conorpwilliams

    President Obama sent a veritable drawerful of his cabinet to Detroit last fall (and Vice President Joe Biden led a similar visit last month). While the Tigers were headed for the postseason, the big shots weren’t in town for a glimpse of quality baseball. Attorney General Eric Holder, National Economic Council Director Gene Sperling, HUD Secretary Shaun Donovan, and Transportation Secretary Anthony Foxx were in the Motor City to brainstorm with state and local leaders on ways to use federal resources to spark -- and hopefully speed -- Detroit’s economic recovery.

    While there are flickers of economic revival in the city, it’s hard to imagine that this conversation was wide-ranging enough to break the spiral. Is there an easy long-term recovery to be found in Detroit—or are its considerable problems the product of a fatally flawed economic development plan? There’s ample evidence for the latter.

    Changing the city’s course will require much more than budgetary tweaks. It’s going to take a comprehensive rethinking of the area’s approach to education and economic opportunities. It’s going to require starting with the youngest Detroiters—and building a lasting foundation for economic growth.

  • Matching Up Teacher Value-Added Between Different Tests

    The U.S. Department of Education has released a very short, readable report on the comparability of value-added estimates using two different tests in Indiana – one of them norm-referenced (the Measures of Academic Progress test, or MAP), and the other criterion-referenced (the Indiana Statewide Testing for Educational Progress Plus, or ISTEP+, which is also the state’s official test for NCLB purposes).

    The research design here is straightforward – fourth and fifth grade students in 46 schools across 10 districts in Indiana took both tests, their teachers’ value-added scores were calculated, and the scores were compared. Since both sets of scores were based on the same students and teachers, this is allows a direct comparison of how teachers’ value-added estimates compare between these two tests. The results are not surprising, and they square with similar prior studies (see here, here, here, for example): The estimates based on the two tests are moderately correlated. Depending on the grade/subject, they are between 0.4 and 0.7. If you’re not used to interpreting correlation coefficients, consider that only around one-third of teachers were in the same quintile (fifth) on both tests, and another 40 or so percent were one quintile higher or lower. So, most teachers were within a quartile, about a quarter of teachers moved two or more quintiles, and a small percentage moved from top to bottom or vice-versa.

    Although, as mentioned above, these findings are in line with prior research, it is worth remembering why this “instability” occurs (and what can be done about it).

  • Teacher Retention In An Era Of Rapid Reform

    The Center for American Progress (CAP) recently released a short report on whether teachers were leaving the profession due to reforms implemented during the Obama Administration, as some commentators predicted.

    The authors use data from the Schools and Staffing Survey (SASS), a wonderful national survey of U.S. teachers, and they report that 70 percent of first-year teachers in 2007-08 were still teaching in 2011-12. They claim that this high retention of beginning teachers, along with the fact that most teachers in 2011-12 had five or more years of experience, show that “the teacher retention concerns were unfounded."

    This report raises a couple of important points about the debate over teacher retention during this time of sweeping reform.

  • Opportunity To Churn: Teacher Assignments Within New York City Schools

    Virtually all discussions of teacher turnover focuses on teachers leaving schools and/or the profession. However, a recent working paper by Allison Atteberry, Susanna Loeb and James Wyckoff, which was presented at this month’s CALDER conference, reaches a very interesting conclusion using data from New York City: There is actually more movement within NYC schools than between them.*

    Specifically, the authors show that, during the years for which they had data (1997-2002 and 2004-2010), over 50 percent of teachers in any given year exhibited some form of movement (including leaving the profession or switching schools), but two-thirds of these moves were within schools – i.e., teachers changing grades or subjects. Moreover, they find that these within-school moves, like those between-schools/professions, appear to have a negative impact on testing outcomes, one which is very modest but statistically discernible in both math and reading.

    There are a couple of interesting points related to these main findings.

  • Democracy’s Champion: Albert Shanker

    Our guest author today is Richard D. Kahlenberg, senior fellow at The Century Foundation, is author of Tough Liberal: Albert Shanker and the Battles Over Schools, Unions, Race, and Democracy (Columbia University Press, 20007). 

    Freedom House recently released the significant – and sobering -- results of its report, “Freedom in the World 2014."  The survey is the latest in an annual assessment of political and civil liberties around the globe.  For the eighth year in a row, the overall level of freedom declined, as 54 nations saw erosion of political and civil rights, including Egypt, Turkey and Russia.  (A smaller number, 40, saw gains.)  Despite the early hopes of the Arab Spring, democracy promotion has proven a long and difficult fight.

    None of this would surprise Albert Shanker, who devoted his life to championing democracy, yet always recognized the considerable difficulty of doing so.  Around 1989, when the world was celebrating the fall of the Berlin Wall, Shanker took the long view:  “What we’ve seen are the beginnings of democracy.  We haven’t really seen democracy yet.  We’ve seen the overthrow of dictatorship.  Democracy is going to take generations to build and we have to be a part of that building because they won’t be able to do it alone."

  • An Attempt To Decapitate: Turkey's Trade Unions On Trial

    Our guest today is Eric Lee, founding editor of LabourStart, the international labor news and campaigning site.

    On a chilly Thursday morning in late January I found myself standing at the entrance to an ultra-modern building that looked exactly like a shopping center or hotel.  An immense atrium, mirror-like glass everywhere, it was certainly designed by architects with ambitions.  The building was the main courthouse in downtown Istanbul — the largest courthouse, we were told, in all of Europe.

    I was there in order to attend the opening of the trial of 56 members of KESK, the Turkish trade union for public sector workers.  The KESK members are accused of membership in an illegal organization, and making propaganda for that organization.  A handful of them were accused of being leaders of the organization.

    The organization they are accused of joining is the Devrimci Halk Kurtuluş Partisi-Cephesi (DHKP-C) — the Revolutionary People’s Liberation Party–Front — which for more than three decades has conducted an armed struggle against the Turkish state.  The DHKP-C is considered a terrorist organization not only by the Turkish government but also by the European Union and the United States.

  • Unionization And Working Poverty

    Our guest author today is Ian Robinson, Lecturer in the Department of Sociology and in the Residential College’s interdisciplinary Social Theory and Practice program at the University of Michigan.

    Poverty is (by definition) a function of inadequate income relative to family or household size. Low income has two possible proximate causes: insufficient hours of employment and/or insufficient hourly wages.  In 2001, there were four times more poor U.S. households in which someone had a job than there were in households in which no one did.  The same is still true today.  In other words, despite levels of unemployment far above post-World War Two norms, low wage jobs are by far the most important proximate cause of poverty in America today.

    Perversely, despite this reality, the academic literature on U.S. poverty pays less attention to such jobs than it does to unemployment. A recent article, published in the journal American Sociological Review, both identifies and makes up for that shortcoming. In the process, its authors arrive at some striking conclusions. In particular, they find that unions are a major force for reducing poverty rates among households with at least one employed person.

  • Is Selective Admission A School Improvement Plan?

    The Washington Post reports that parents and alumni of D.C.’s Dunbar High School have quietly been putting together a proposal to revitalize what the article calls "one of the District's worst performing schools."

    Those behind the proposal are not ready to speak about it publicly, and details are still very thin, but the Post article reports that it calls for greater flexibility in hiring, spending and other core policies. Moreover, the core of the plan – or at least its most drastic element - is to make Dunbar a selective high school, to which students must apply and be accepted, presumably based on testing results and other performance indicators (the story characterizes the proposal as a whole with the term “autonomy”). I will offer no opinion as to whether this conversion, if it is indeed submitted to the District for consideration, is a good idea. That will be up to administrators, teachers, parents, and other stakeholders.

    I am, however, a bit struck by two interrelated aspects of this story. The first is the unquestioned characterization of Dunbar as a “low performing” or “struggling” school. This fateful label appears to be based mostly on the school’s proficiency rates, which are indeed dismally low – 20 percent in math and 29 percent in reading.

  • Extended School Time Proposals And Charter Schools

    One of the (many) education reform proposals that has received national attention over the past few years is “extended learning time” – that is, expanding the day and/or year to give students more time in school.

    Although how schools use the time they have with students, of course, is not necessarily more or less important than how much time they have with those students, the proposal to expand the school day/year may have merit, particularly for schools and districts serving larger proportions of students who need to catch up. I have noticed that one of the motivations for the extended time push is the (correct) observation that the charter school models that have proven effective (at least by the standard of test score gains) utilize extended time.

    On the one hand, this is a good example of what many (including myself) have long advocated – that the handful of successful charter school models can potentially provide a great deal of guidance for all schools, regardless of their governance structure. On the other hand, it is also important to bear in mind that many of the high-profile charter chains that receive national attention don’t just expand their school years by a few days or even a few weeks, as has been proposed in several states. In many cases, they extend it by months.