Skip to:

Teacher Quality

  • Evidence From A Teacher Evaluation Pilot Program In Chicago

    Written on December 4, 2015

    The majority of U.S. states have adopted new teacher evaluation systems over the past 5-10 years. Although these new systems remain among the most contentious issues in education policy today, there is still only minimal evidence on their impact on student performance or other outcomes. This is largely because good research takes time.

    A new article, published in the journal Education Finance and Policy, is among the handful of analyses examining the preliminary impact of teacher evaluation systems. The researchers, Matthew Steinberg and Lauren Sartain, take a look at the Excellence in Teaching Project (EITP), a pilot program carried out in Chicago Public Schools starting in the 2008-09 school year. A total of 44 elementary schools participated in EITP in the first year (cohort 1), while an additional 49 schools (cohort 2) implemented the new evaluation systems the following year (2009-10). Participating schools were randomly selected, which permits researchers to gauge the impact of the evaluations experimentally.

    The results of this study are important in themselves, and they also suggest some more general points about new teacher evaluations and the building body of evidence surrounding them.

    READ MORE

  • Who Are (And Should Be) The Teaching Experts?

    Written on November 19, 2015

    Our guest author today is Bryan Mascio, who taught for over ten years in New Hampshire, primarily working with students who had been unsuccessful in traditional school settings. Bryan is now a doctoral student at the Harvard Graduate School of Education, where he conducts research on the cognitive aspects of teaching, and works with schools to support teachers in improving relationships with their students.

    How do we fix teaching?  This question is on the mind of many reformers, researchers, politicians, and parents.  Every expert has their own view of the problem, their own perspective on what success should look like, and their own solutions to offer.  The plethora of op-eds, reports, articles, and memoranda, can be mindboggling.  It is important to take a step back and see whether we all even consider teaching expertise to be the same thing.  Just as importantly, where does, and should, it reside?

    In a New York Times op-ed, “Teachers Aren’t Dumb”, Dr. Daniel Willingham explains that teachers aren’t the problem – it’s just how they are trained. As a teacher, I appreciate a respected person from outside of the profession coming to our defense, and I do agree that we need to take a hard look at teacher preparation programs.  I worry, though, that a call to focus more on the “nuts and bolts” of teaching – in contrast to the current emphasis on educational philosophy and theories of development – could create an alarming pendulum swing.

    This recommendation is a common message, promoted both by those in academic research as well as fast-tracked teacher preparation programs.  It sees academics and researchers as the generators and holders of the most important expertise and asks them to then give direction to teachers.  By mistaking different kinds of expertise, it inadvertently lays a path towards teachers as technicians, rather than true professionals.

    READ MORE

  • Recent Evidence On Teacher Experience And Productivity

    Written on August 12, 2015

    The idea that teachers’ test-based productivity does not improve after their first few years in the classroom is, it is fair to say, the “conventional wisdom” among many in the education reform arena. It has been repeated endlessly, and used to advocate forcefully for recent changes in teacher personnel policies, such as those regarding compensation, transfers, and layoffs. 

    Following a few other, recent analyses (e.g., Harris and Sass 2011; Wiswall 2013; Ladd and Sorensen 2013), a new working paper by researchers John Papay and Matthew Kraft examines this claim about the relationship between experience and (test-based) performance. In this case, the authors compare the various approaches with which the productivity returns to experience have been estimated in the literature, and put forth a new one. The paper did receive some attention, and will hopefully have some impact on the policy debate, as well as on the production of future work on this topic.

    It might nevertheless be worthwhile to take a closer look at the “nuts and bolts” of this study, both because it is interesting (at least in my opinion) and policy relevant, and also because it illustrates some important lessons regarding the relationship between research and policy, specifically the fact that what we think we know is not always as straightforward as it appears.

    READ MORE

  • The Magic Of Multiple Measures

    Written on August 6, 2015

    Our guest author today is Cara Jackson, Assistant Director of Research and Evaluation at the Urban Teacher Center.

    Teacher evaluation has become a contentious issue in U.S.  Some observers see the primary purpose of these reforms as the identification and removal of ineffective teachers; the popular media as well as politicians and education reform advocates have all played a role in the framing of teacher evaluation as such.  But, while removal of ineffective teachers was a criterion under Race to the Top, so too was the creation of evaluation systems to be used for teacher development and support.

    I think most people would agree that teacher development and improvement should be the primary purpose, as argued here.  Some empirical evidence supports the efficacy of evaluation for this purpose (see here).  And given the sheer number of teachers we need, declining enrollment in teacher preparation programs, and the difficulty disadvantaged schools have retaining teachers, school principals are probably none too enthusiastic about dismissing teachers, as discussed here.

    Of course, to achieve the ambitious goal of improving teaching practice, an evaluation system must be implemented well.  Fans of Harry Potter might remember when Dolores Umbridge from the Ministry of Magic takes over as High Inquisitor at Hogwarts and conducted “inspections” of Hogwart’s teachers in Book 5 of J.K. Rowling’s series.  These inspections pretty much demonstrate how not to approach classroom observations: she dictates the timing, fails to provide any of indication of what aspects of teaching practice she will be evaluating, interrupts lessons with pointed questions and comments, and evidently does no pre- or post-conferencing with the teachers. 

    READ MORE

  • Research On Teacher Evaluation Metrics: The Weaponization Of Correlations

    Written on July 21, 2015

    Our guest author today is Cara Jackson, Assistant Director of Research and Evaluation at the Urban Teacher Center.

    In recent years, many districts have implemented multiple-measure teacher evaluation systems, partly in response to federal pressure from No Child Left Behind waivers and incentives from the Race to the Top grant program. These systems have not been without controversy, largely owing to the perception – not entirely unfounded - that such systems might be used to penalize teachers.  One ongoing controversy in the field of teacher evaluation is whether these measures are sufficiently reliable and valid to be used for high-stakes decisions, such as dismissal or tenure.  That is a topic that deserves considerably more attention than a single post; here, I discuss just one of the issues that arises when investigating validity.

     The diagram below is a visualization of a multiple-measure evaluation system, one that combines information on teaching practice (e.g. ratings from a classroom observation rubric) with student achievement-based measures (e.g. value-added or student growth percentiles) and student surveys.  The system need not be limited to three components; the point is simply that classroom observations are not the sole means of evaluating teachers.   

    In validating the various components of an evaluation system, researchers often examine their correlation with other components.  To the extent that each component is an attempt to capture something about the teacher’s underlying effectiveness, it’s reasonable to expect that different measurements taken of the same teacher will be positively related.  For example, we might examine whether ratings from a classroom observation rubric are positively correlated with value-added.

    READ MORE

  • Recruiting And Retaining Educators Of Color

    Written on July 14, 2015

    Our guest authors today are Audra Watson, Travis Bristol, Terrenda White and Jose Vilson. Watson is Program Officer and Director of Mentoring and Induction Strategy at the Woodrow Wilson National Fellowship Foundation. Bristol is a Research and Policy Fellow at Stanford Center for Opportunity Policy in Education. White is Assistant Professor at the University of Colorado-Boulder. Vilson is a math educator, blogger, speaker, and activist in New York City, NY

    On Thursday, May 7, the White House Initiative on Educational Excellence for African Americans and the Stanford Center for Opportunity Policy in Education (SCOPE) co-sponsored an hour-long webinar, in which researchers, policy makers, and practitioners shared best practices and strategies for increasing the racial/ethnic diversity of the country’s teaching force.

    As discussed during the webinar, a racially and ethnically diverse teaching force is important for several reasons. First, in this flat, or interconnected, world, our children need a diverse teaching force to prepare them to be global citizens. Second, teachers of color are positioned to serve as role models and cultural brokers for children of color, who account for 50.2 percent of all U.S. public school students (NCES, 2015). Despite this diverse student population, Latino, Black, Asian, and Native American teachers comprise only 17.3% of all teachers (Ingersoll, Merrill & Stuckey, 2014). Third, several large-scale studies point to increased learning -- as measured by a standardized exam -- for students when they have a teacher of the same race (Dee, 2001; Egalite, Kisida,& Winters, 2015); Not discussed at the time, but equally important, is the fact that a diverse teaching force challenges the assumption that some of the qualities needed most by high-quality, effective teachers -- intelligence, intellectual curiosity, and deep content knowledge -- are difficult to find in large supply amongst individuals of color seeking to enter the teaching profession.

    READ MORE

  • Empower Teachers To Lead, Encourage Students To Be Curious

    Written on July 9, 2015

    Our guest author today is Ashim Shanker, a former English Language Arts teacher in public schools in Tokyo, Japan. Ashim has a Master’s Degree in International Education Policy from Harvard University and is the author of three books, including Don’t Forget to Breathe. Follow him on Twitter at @ashimshanker.

    In the 11 years that I was a public school teacher in Japan, I came to view education as a holistic enterprise. Schools in Japan not only imbued students with relevant skills, but also nurtured within them the wherewithal to experience a sense of connection with the larger world, and the exploratory capacity to discover their place within it.

    In my language arts classes, I encouraged students to read about current events and human rights issues around the world. I asked them to make lists of the electronics they used, the garments they wore, and the food products they consumed on a daily basis. I then had them research where these products were made and under what labor conditions.

    The students gave presentations on child laborers and about modern-day slavery. They debated about government secrecy laws in Japan and cover-ups in the aftermath of the Fukushima nuclear disaster. They read an essay on self-reliance by Emerson and excerpts on civil disobedience by Thoreau, and I asked them how these two activists might have felt about the actions of groups like Anonymous, or about whistleblowers like Edward Snowden. We discussed the Milgram Experiment and the Stanford Prison experiment, exploring how obedience and situational role conformity might tip even those with the best of intentions toward acts of cruelty. We talked about bullying, and shared anecdotes of instances in which we might unintentionally have hurt others. There were opportunities for self-reflection, engagement, and character building—attributes that I would like to think foster the empathic foundations for better civic engagement and global citizenship.

    READ MORE

  • Do We Know How To Hold Teacher Preparation Programs Accountable?

    Written on June 30, 2015

    This piece is co-authored by Cory Koedel and Matthew Di Carlo. Koedel is an Associate Professor of Economics and Public Policy at the University of Missouri, Columbia.

    The United States Department of Education (USED) has proposed regulations requiring states to hold teacher preparation programs accountable for the performance of their graduates. According to the proposal, states must begin assigning ratings to each program within the next 2-3 years, based on outcomes such as graduates’ “value-added” to student test scores, their classroom observation scores, how long they stay in teaching, whether they teach in high-needs schools, and surveys of their principals’ satisfaction.

    In the long term, we are very receptive to, and indeed optimistic about, the idea of outcomes-based accountability for teacher preparation programs (TPPs). In the short to medium term, however, we contend that the evidence base underlying the USED regulations is nowhere near sufficient to guide a national effort toward high-stakes TPP accountability.

    This is a situation in which the familiar refrain of “it’s imperfect but better than nothing” is false, and rushing into nationwide design and implementation could be quite harmful.

    READ MORE

  • Will Value-Added Reinforce The Walls Of The Egg-Crate School?

    Written on June 25, 2015

    Our guest author today is Susan Moore Johnson, Jerome T. Murphy Research Professor in Education at Harvard Graduate School of Education. Johnson directs the Project on the Next Generation of Teachers, which examines how best to recruit, develop, and retain a strong teaching force.

    Academic scholars are often dismayed when policymakers pass laws that disregard or misinterpret their research findings. The use of value-added methods (VAMS) in education policy is a case in point.

    About a decade ago, researchers reported that teachers are the most important school-level factor in students’ learning, and that that their effectiveness varies widely within schools (McCaffrey, Koretz, Lockwood, & Hamilton 2004; Rivkin, Hanushek, & Kain 2005; Rockoff 2004). Many policymakers interpreted these findings to mean that teacher quality rests with the individual rather than the school and that, because some teachers are more effective than others, schools should concentrate on increasing their number of effective teachers.

    Based on these assumptions, proponents of VAMS began to argue that schools could be improved substantially if they would only dismiss teachers with low VAMS ratings and replace them with teachers who have average or higher ratings (Hanushek 2009). Although panels of scholars warned against using VAMS to make high-stakes decisions because of their statistical limitations (American Statistical Association, 2014; National Research Council & National Academy of Education, 2010), policymakers in many states and districts moved quickly to do just that, requiring that VAMS scores be used as a substantial component in teacher evaluation.

    READ MORE

  • Starting Closest To Home: The Importance Of Developing Teachers’ Understanding Of The Social Contexts Of Their Classrooms

    Written on June 11, 2015

    Our guest author today is John Lane, a former teacher and instructional coach who is now working as a post-doctoral researcher at Michigan State University on a project that investigates the impact of social networks and mentorship on the mathematics instructional practices of beginning teachers. 

    It may seem foolish now, but there was a time in this country when policymakers believed that reforms were self-executing. Legislatures and educational bureaucrats would articulate the terms of the policies and their vision for improving schools, and teachers and others close to schools would translate these visions into practice. In the meantime, over the past fifty years or so, researchers have been able to better understand the vast gulf between reformers’ ideals and teachers’ practice. In short, we have come to understand that improving teacher’s practice is more difficult than anyone imagined.

    Policymakers, however, seem not to have gotten this message, or to have gotten it only partially. For the most part, they still follow a familiar script that reads that teachers either lack the skill or the will to enact reforms, or both. Consequently, reforms typically ratchet up accountability while also including some provision for teacher learning.

    In what follows, I focus on the content of this learning and what it might take to achieve it. First, I discuss why teacher learning is complex and often challenging. Next, I discuss how teacher learning is typically organized, and the substance of what teachers currently learn. Specifically, I contend that in teachers’ typical learning opportunities, reforms are reduced to a set of strategies that “work” across settings, and in which the contexts of teaching become an unwanted entanglement. In this post, I argue that teachers would benefit from opportunities to learn about the social dynamics of classrooms -- it is those dynamics, after all, that affect their own reform efforts and teacher practice more broadly. I then offer some ideas about how teachers might be able to accomplish this.

    READ MORE

Pages

Subscribe to Teacher Quality