• Schools' Effectiveness Varies By What They Do, Not What They Are

    There may be a mini-trend emerging in certain types of charter school analyses, one that seems a bit trivial but has interesting implications that bear on the debate about charter schools in general. It pertains to how charter effects are presented.

    Usually, when researchers estimate the effect of some intervention, the main finding is the overall impact, perhaps accompanied by a breakdown by subgroups and supplemental analyses. In the case of charter schools, this would be the estimated overall difference in performance (usually testing gains) between students attending charters versus their counterparts in comparable regular public schools.

    Two relatively recent charter school reports, however – both generally well-done given their scope and available data – have taken a somewhat different approach, at least in the “public roll-out” of their results.

  • Getting Ready For The Common Core

    Our guest author today, Susan B. Neuman, is a professor in Educational Studies at the University of Michigan specializing in early literacy development and a former U.S. Secretary of Education for Elementary and Secondary Education. She and her colleagues at the University of Michigan have also partnered with the Albert Shanker Institute in sponsoring a summer institute for early childhood educators, focusing specifically on oral language development and the ways it can support and help build strong content knowledge. For more information, see here.

    States are now working intently on developing plans that will make new, common standards a reality. A recent report from Education First and the Editorial Projects in Education Research Center concludes that that all but one of the 47 states adopting the Common Core State Standards is now in the implementation phase. Seven states have fully upgraded professional development, curriculum materials, and evaluation systems in preparation for the 2014-2015 school year.

    Nary a word has been spoken about how to prepare teachers to implement common standards appropriately in the early childhood years. Although the emphasis on content-rich instruction in ways that builds knowledge is an important one, standards groups have virtually ignored the early years when these critical skills first begin to develop.

    Young children are eager to learn about the sciences, arts, and the world around them. And, as many early childhood teachers recognize, we need to provide content-rich instruction that is both developmentally appropriate and highly engaging to support students' learning.

  • The Indiana Model

    Indiana is well on its way to becoming a ‘right-to-work’ state this week, with the state’s Republican-controlled House of Representatives approving new legislation and the Senate poised to follow suit. The legislation weakens union protections and enables individual workers to refuse to pay their share of union representation costs, even if a majority of their coworkers have voted for union representation and the union is legally obligated to pay to bargain for and protect their rights on the job. It is the first Midwestern manufacturing state to pass such a bill, though other Republican-dominated state legislatures are considering similar legislation.

    One of the most interesting things about this move is just how unpopular it is. According to the AFL-CIO, only one-third of Indiana voters favor the legislation and more than 70 percent of them want the question submitted to a vote, via a state referendum. So why, in an election year, have Republican politicians decided to push forward?

  • A Dark Day For Educational Measurement In The Sunshine State

    Just this week, Florida announced its new district grading system. These systems have been popping up all over the nation, and given the fact that designing one is a requirement of states applying for No Child Left Behind waivers, we are sure to see more.

    I acknowledge that the designers of these schemes have the difficult job of balancing accessibility and accuracy. Moreover, the latter requirement – accuracy – cannot be directly tested, since we cannot know “true” school quality. As a result, to whatever degree it can be partially approximated using test scores, disagreements over what specific measures to include and how to include them are inevitable (see these brief analyses of Ohio and California).

    As I’ve discussed before, there are two general types of test-based measures that typically comprise these systems: absolute performance and growth. Each has its strengths and weaknesses. Florida’s attempt to balance these components is a near total failure, and it shows in the results.

  • Performance And Chance In New York's Competitive District Grant Program

    New York State recently announced a new $75 million competitive grant program, which is part of its Race to the Top plan. In order to receive some of the money, districts must apply, and their applications receive a score between zero and 115. Almost a third of the points (35) are based on proposals for programs geared toward boosting student achievement, 10 points are based on need, and there are 20 possible points awarded for a description of how the proposal fits into districts’ budgets.

    The remaining 50 points – almost half – of the application is based on “academic performance” over the prior year. Four measures are used to produce the 0-50 point score: One is the year-to-year change (between 2010 and 2011) in the district’s graduation rate, and the other three are changes in the state “performance index” in math, English Language Arts (ELA) and science. The “performance index” in these three subjects is calculated using a simple weighting formula that accounts for the proportion of students scoring at levels 2 (basic), 3 (proficient) and 4 (advanced).

    The idea of using testing results as a criterion in the awarding of grants is to reward those districts that are performing well. Unfortunately, due to the choice of measures and how they are used, the 50 points will be biased and to no small extent based on chance.

  • Burden Of Proof, Benefit Of Assumption

    ** Also posted here on "Valerie Strauss' Answer Sheet" in the Washington Post

    Michelle Rhee, the controversial former chancellor of D.C. public schools, is a lightning rod. Her confrontational style has made her many friends as well as enemies. As is usually the case, people’s reaction to her approach in no small part depends on whether or not they support her policy positions.

    I try to be open-minded toward people with whom I don’t often agree, and I can certainly accept that people operate in different ways. Honestly, I have no doubt as to Ms. Rhee’s sincere belief in what she’s doing; and, even if I think she could go about it differently, I respect her willingness to absorb so much negative reaction in order to try to get it done.

    What I find disturbing is how she continues to try to build her reputation and advance her goals based on interpretations of testing results that are insulting to the public’s intelligence.

  • Income And Educational Outcomes

    The role of poverty in shaping educational outcomes is one of the most common debates going on today. It can also be one of the most shallow.

    The debate tends to focus on income. For example (and I’m generalizing a bit here), one “side” argues that income and test scores are strongly correlated; the other “side” points to the fact that many low-income students do very well and cautions against making excuses for schools’ failure to help poor kids.

    Both arguments have merit, but it bears quickly mentioning that the focus on the relationship between income and achievement is a rather crude conceptualization of the importance of family background (and non-schooling factors in general) for education outcomes. Income is probably among the best widely available proxies for these factors, insofar as it is correlated with many of the conditions that can hinder learning, especially during a child’s earliest years. This includes (but is not at all limited to): peer effects; parental education; access to print and background knowledge; parental involvement; family stressors; access to healthcare; and, of course, the quality of neighborhood schools and their teachers.

    And that is why, when researchers try to examine school performance – while holding constant the effect of factors outside of schools’ control – income or some kind of income-based proxy (usually free/reduced price lunch) can be a useful variable. It is, however, quite limited.

  • Trial And Error Is Fine, So Long As You Know The Difference

    It’s fair to say that improved teacher evaluation is the cornerstone of most current education reform efforts. Although very few people have disagreed on the need to design and implement new evaluation systems, there has been a great deal of disagreement over how best to do so – specifically with regard to the incorporation of test-based measures of teacher productivity (i.e., value-added and other growth model estimates).

    The use of these measures has become a polarizing issue. Opponents tend to adamantly object to any degree of incorporation, while many proponents do not consider new evaluations meaningful unless they include test-based measures as a major element (say, at least 40-50 percent). Despite the air of certainty on both sides, this debate has mostly been proceeding based on speculation. The new evaluations are just getting up and running, and there is virtually no evidence as to their effects under actual high-stakes implementation.

    For my part, I’ve said many times that I'm receptive to trying value-added as a component in evaluations (see here and here), though I disagree strongly with the details of how it’s being done in most places. But there’s nothing necessarily wrong with divergent opinions over an untested policy intervention, or with trying one. There is, however, something wrong with fully implementing such a policy without adequate field testing, or at least ensuring that the costs and effects will be carefully evaluated post-implementation. To date, virtually no states/districts of which I'm aware have mandated large-scale, independent evaluations of their new systems.*

    If this is indeed the case, the breathless, speculative debate happening now will only continue in perpetuity.

  • Beyond Anecdotes: The Evidence About Financial Incentives And Teacher Retention

    ** Also posted here on "Valerie Strauss' Answer Sheet" in the Washington Post

    Our guest author today is Eleanor Fulbeck, who earned her Ph.D. in education policy from the University of Colorado at Boulder in 2011, and is currently a post-doctoral fellow at the University of Pennsylvania.

    A couple of weeks ago, an article in the New York Times, written by reporter Sam Dillon, took a look at the new incentive program being used by the District of Columbia Public Schools (DCPS). Under this plan (called “Impact Plus”), teachers rated “highly effective” by the district’s new evaluation system are eligible for large cash bonuses and/or permanent salary increases.

    Dillon notes that, “The profession is notorious for losing thousands of its brightest young teachers within a few years, which many experts attribute to low starting salaries and a traditional step-raise structure that rewards years of service and academic degrees rather than success in the classroom." He also profiles several teachers who received the bonuses, most of whom say it played a role in their decision to remain in the classroom.

    Putting aside these anecdotes and characterizations of “experts’” views, the idea that financial incentives – such as bonuses for performance or teaching in hard-to-staff schools – is a key to boosting teacher retention is a complex empirical question, and an open one at that.

  • Are Americans Exceptional In Their Attitudes Toward Government's Role In Reducing Inequality?

    As discussed in a previous post, roughly half of Americans believe that government should take some active role in reducing income differences between rich and poor, though, as one would expect, this view is less prevalent among Republicans, more educated and higher earning survey respondents.

    These data, however, lack a frame of reference. That is, they don’t tell us whether American support for government redistribution is “high” or “low” compared with that in other nations. The conventional wisdom in this area is that Americans generally prefer a more limited government, especially when it comes to things like income redistribution.

    It might therefore be interesting to take a quick look at how the U.S. stacks up against other nations in terms of these redistributive preferences.