K-12 Education

  • Recent Evidence On The New Orleans School Reforms

    A new study of New Orleans (NOLA) schools since Katrina, published by the Education Research Alliance (ERA), has caused a predictable stir in education circles (the results are discussed in broader strokes in this EdNext article, while the full paper is forthcoming). The study’s authors, Doug Harris and Matthew Larsen, compare testing outcomes before and after the hurricanes that hit the Gulf Coast in 2005, in districts that were affected by those storms. The basic idea, put simply, is to compare NOLA schools to those in other storm-affected districts, in order to assess the general impact of the drastic educational change undertaken in NOLA, using the other schools/districts as a kind of control group.

    The results, in brief, indicate that: 1) aggregate testing results after the storms rose more quickly in NOLA vis-à-vis the comparison districts, with the difference in 2012 being equivalent to roughly 15 percentile points ; 2) there was, however, little discernible difference in the trajectories of NOLA students who returned after the storm and their peers in other storm-affected districts (though this latter group could only be followed for a short period, all of which occurred during these cohorts' middle school years). Harris and Larsen also address potential confounding factors, including population change and trauma, finding little or no evidence that these factors generate bias in their results.

    The response to this study included the typical of mix of thoughtful, measured commentary and reactionary advocacy (from both “sides”). And, at this point, so much has been said and written about the study, and about New Orleans schools in general, that I am hesitant to join the chorus (I would recommend in particular this op-ed by Doug Harris, as well as his presentation at our recent event on New Orleans).

  • Where Al Shanker Stood: Union-District Partnerships

    In this New York Times piece, which was published on March 9, 1986, Al Shanker discusses a study suggesting that union-district partnership, not confrontation, is the best way to enact and implement reforms that will improve schools.

    In the last 25 years, teachers' unions have grown in size and influence. In the minds of many they represent an establishment just as much as the local board of education and the superintendent of schools. Many critics of our schools have been eager to portray teacher unions as supporters of educationally undesirable rules and procedures, such as seniority, which were borrowed from the industrial sector. They view teacher unions as fighting for these rules at any cost and using their bargaining powers to shoot down constructive change whenever it threatens to infringe on teachers' vested interests.

    But an interesting new study gives us quite a different picture of the impact that teacher unions and collective bargaining have on the reform process. In preparing Teacher Unions, School Staffing and Reform, a Harvard Graduate School of Education research team led by Susan Moore Johnson analyzed 155 contracts chosen at random from a variety of school districts around the country. And, from June of 1984 to February, 1985, they did extensive, in-depth field work in 5 of the districts, where they examined documents, sat in on meetings and interviewed 187 teachers, principals, union leaders and central office administrators.

    What emerges is a valuable insight into the dynamics and complexity of the reform process, why some proposals work and why others fall flat. Though new programs tend to be formulated in legislative chambers or in governors' mansions, the key to success, the authors conclude, is what happens on the district level, within the individual collective bargaining unit. And some interesting patterns emerge.

  • The Story Behind The Story: Social Capital And The Vista Unified School District

    Our guest author today is Devin Vodicka, superintendent of Vista Unified, a California school district serving over 22,000 students that was recently accepted into the League of Innovative Schools. Dr. Vodicka participates in numerous state and national leadership groups, including the Superintendents Technical Working Group of the U.S. Education Department .

    Transforming a school district is challenging and complex work, often requiring shifts in paradigms, historical perspective, and maintaining or improving performance. Here, I’d like to share how we approached change at Vista Unified School District (VUSD) and to describe the significant transformation we’ve been undergoing, driven by data, focused on relationships, and based in deep partnerships. Although Vista has been hard at work over many years, this particular chapter starts in July of 2012 when I was hired.  

    When I became superintendent, the district was facing numerous challenges: Declining enrollment, financial difficulties, strained labor relations, significant turnover in the management ranks, and unresolved lawsuits were all areas in need of attention. The school board charged me and my team with transforming the district, which serves large numbers of linguistically, culturally, and economically diverse students. While there is still significant room for improvement, much has changed in the past three years, generally trending in a positive direction. Below is the story of how we did it.

  • Recent Evidence On Teacher Experience And Productivity

    The idea that teachers’ test-based productivity does not improve after their first few years in the classroom is, it is fair to say, the “conventional wisdom” among many in the education reform arena. It has been repeated endlessly, and used to advocate forcefully for recent changes in teacher personnel policies, such as those regarding compensation, transfers, and layoffs. 

    Following a few other, recent analyses (e.g., Harris and Sass 2011Wiswall 2013; Ladd and Sorensen 2013), a new working paper by researchers John Papay and Matthew Kraft examines this claim about the relationship between experience and (test-based) performance. In this case, the authors compare the various approaches with which the productivity returns to experience have been estimated in the literature, and put forth a new one. The paper did receive some attention, and will hopefully have some impact on the policy debate, as well as on the production of future work on this topic.

    It might nevertheless be worthwhile to take a closer look at the “nuts and bolts” of this study, both because it is interesting (at least in my opinion) and policy relevant, and also because it illustrates some important lessons regarding the relationship between research and policy, specifically the fact that what we think we know is not always as straightforward as it appears.

  • The Magic Of Multiple Measures

    Our guest author today is Cara Jackson, Assistant Director of Research and Evaluation at the Urban Teacher Center.

    Teacher evaluation has become a contentious issue in U.S.  Some observers see the primary purpose of these reforms as the identification and removal of ineffective teachers; the popular media as well as politicians and education reform advocates have all played a role in the framing of teacher evaluation as such.  But, while removal of ineffective teachers was a criterion under Race to the Top, so too was the creation of evaluation systems to be used for teacher development and support.

    I think most people would agree that teacher development and improvement should be the primary purpose, as argued here.  Some empirical evidence supports the efficacy of evaluation for this purpose (see here).  And given the sheer number of teachers we need, declining enrollment in teacher preparation programs, and the difficulty disadvantaged schools have retaining teachers, school principals are probably none too enthusiastic about dismissing teachers, as discussed here.

    Of course, to achieve the ambitious goal of improving teaching practice, an evaluation system must be implemented well.  Fans of Harry Potter might remember when Dolores Umbridge from the Ministry of Magic takes over as High Inquisitor at Hogwarts and conducted “inspections” of Hogwart’s teachers in Book 5 of J.K. Rowling’s series.  These inspections pretty much demonstrate how not to approach classroom observations: she dictates the timing, fails to provide any of indication of what aspects of teaching practice she will be evaluating, interrupts lessons with pointed questions and comments, and evidently does no pre- or post-conferencing with the teachers. 

  • Where Al Shanker Stood: Policymaking And Innovation

    In this piece, which was published in the New York Times on December 24, 1995, Al Shanker uses a creative analogy to argue that policies require experimentation and refinement before they are brought to scale, and that some reformers mistake this process for rigidity and "stifling innovation."

    A couple of weeks ago, the New York Times food section ran an article about a French bread that you can make with a food processor (November 22, 1995). The article claimed that the baguette was as delicious as the kind you buy in a good bakery. I was skeptical. I have made bread for my family and friends for a number of years, and I know that a good French loaf is a real accomplishment. I had no trouble believing that the bread would be quick and easy. But delicious? Nevertheless, I tried the recipe for Thanksgiving. It was terrific!

    Though making the bread was as painless as the article said, the process by which Charles van Over, a chef and restaurateur, arrived at the recipe was anything but simple. Van Over experimented over a period of several years in order to get a bread with the best possible texture, flavor, and crust - and a recipe that could be made with predictable results by other cooks. It occurred to me as I read the article that there might be some lessons for school reformers in van Over's systematic efforts to perfect his recipe for a food processor baguette.

  • Research On Teacher Evaluation Metrics: The Weaponization Of Correlations

    Our guest author today is Cara Jackson, Assistant Director of Research and Evaluation at the Urban Teacher Center.

    In recent years, many districts have implemented multiple-measure teacher evaluation systems, partly in response to federal pressure from No Child Left Behind waivers and incentives from the Race to the Top grant program. These systems have not been without controversy, largely owing to the perception – not entirely unfounded - that such systems might be used to penalize teachers.  One ongoing controversy in the field of teacher evaluation is whether these measures are sufficiently reliable and valid to be used for high-stakes decisions, such as dismissal or tenure.  That is a topic that deserves considerably more attention than a single post; here, I discuss just one of the issues that arises when investigating validity.

     The diagram below is a visualization of a multiple-measure evaluation system, one that combines information on teaching practice (e.g. ratings from a classroom observation rubric) with student achievement-based measures (e.g. value-added or student growth percentiles) and student surveys.  The system need not be limited to three components; the point is simply that classroom observations are not the sole means of evaluating teachers.   

    In validating the various components of an evaluation system, researchers often examine their correlation with other components.  To the extent that each component is an attempt to capture something about the teacher’s underlying effectiveness, it’s reasonable to expect that different measurements taken of the same teacher will be positively related.  For example, we might examine whether ratings from a classroom observation rubric are positively correlated with value-added.

  • Recruiting And Retaining Educators Of Color

    Our guest authors today are Audra Watson, Travis Bristol, Terrenda White and Jose Vilson. Watson is Program Officer and Director of Mentoring and Induction Strategy at the Woodrow Wilson National Fellowship Foundation. Bristol is a Research and Policy Fellow at Stanford Center for Opportunity Policy in Education. White is Assistant Professor at the University of Colorado-Boulder. Vilson is a math educator, blogger, speaker, and activist in New York City, NY

    On Thursday, May 7, the White House Initiative on Educational Excellence for African Americans and the Stanford Center for Opportunity Policy in Education (SCOPE) co-sponsored an hour-long webinar, in which researchers, policy makers, and practitioners shared best practices and strategies for increasing the racial/ethnic diversity of the country’s teaching force.

    As discussed during the webinar, a racially and ethnically diverse teaching force is important for several reasons. First, in this flat, or interconnected, world, our children need a diverse teaching force to prepare them to be global citizens. Second, teachers of color are positioned to serve as role models and cultural brokers for children of color, who account for 50.2 percent of all U.S. public school students (NCES, 2015). Despite this diverse student population, Latino, Black, Asian, and Native American teachers comprise only 17.3% of all teachers (Ingersoll, Merrill & Stuckey, 2014). Third, several large-scale studies point to increased learning -- as measured by a standardized exam -- for students when they have a teacher of the same race (Dee, 2001; Egalite, Kisida,& Winters, 2015); Not discussed at the time, but equally important, is the fact that a diverse teaching force challenges the assumption that some of the qualities needed most by high-quality, effective teachers -- intelligence, intellectual curiosity, and deep content knowledge -- are difficult to find in large supply amongst individuals of color seeking to enter the teaching profession.

  • Empower Teachers To Lead, Encourage Students To Be Curious

    Our guest author today is Ashim Shanker, a former English Language Arts teacher in public schools in Tokyo, Japan. Ashim has a Master’s Degree in International Education Policy from Harvard University and is the author of three books, including Don’t Forget to Breathe. Follow him on Twitter at @ashimshanker.

    In the 11 years that I was a public school teacher in Japan, I came to view education as a holistic enterprise. Schools in Japan not only imbued students with relevant skills, but also nurtured within them the wherewithal to experience a sense of connection with the larger world, and the exploratory capacity to discover their place within it.

    In my language arts classes, I encouraged students to read about current events and human rights issues around the world. I asked them to make lists of the electronics they used, the garments they wore, and the food products they consumed on a daily basis. I then had them research where these products were made and under what labor conditions.

    The students gave presentations on child laborers and about modern-day slavery. They debated about government secrecy laws in Japan and cover-ups in the aftermath of the Fukushima nuclear disaster. They read an essay on self-reliance by Emerson and excerpts on civil disobedience by Thoreau, and I asked them how these two activists might have felt about the actions of groups like Anonymous, or about whistleblowers like Edward Snowden. We discussed the Milgram Experiment and the Stanford Prison experiment, exploring how obedience and situational role conformity might tip even those with the best of intentions toward acts of cruelty. We talked about bullying, and shared anecdotes of instances in which we might unintentionally have hurt others. There were opportunities for self-reflection, engagement, and character building—attributes that I would like to think foster the empathic foundations for better civic engagement and global citizenship.

  • Measuring The Success Of Informal STEM Programs For Girls

    Despite substantial improvement over the past half decade, the gender pay gap still persists in the U.S. When the Equal Pay Act was passed in 1963, women made 59 cents for every dollar earned by men. Fifty years later, in 2014, women earned 81 cents on the male dollar. One area on which educators and policymakers have focused to rectify the gender pay differential is encouraging young girls to go into the fields of science, technology, engineering and math, or STEM.

    According to the U.S. Department of Commerce, women account for half of the workforce in the U.S., but they are employed in less than 25 percent of STEM positions. Women in STEM fields earn 33 percent more than comparable women in non-STEM occupations, but women hold far fewer STEM undergraduate degrees than men, especially in engineering. And, perplexingly, even women with a STEM degree seem less inclined to work in STEM jobs; they are more likely than STEM-educated men to choose education or healthcare. The main explanations for these discrepancies include lack of female role models, discrimination against females at school and in the work place, and gender stereotypes (Hill et al. 2010).

    Informal STEM programs offer one potential means of improving female participation in these fields, with the “informal” meaning that the learning occurs in an out-of-school environment (Krishnamurthi and Rennie 2013). A program called Girls Inc. Operation SMART, for example, runs an initiative called Eureka!, which seeks to provide eighth grade girls with internship opportunities in math, science, and technology. The organization Techbridge offers Girls Go Techbridge, which holds learning activities, and a role model training program, which connects girls with volunteers who are passionate about motivating them to get involved in science, technology and engineering. Other initiatives include the National Science Partnership for Girl Scouts and Science Museums (NSP), Women in Natural Sciences (WINS), and Rural Girls in Science.