Education

College Isn't Quite The (Self-Perceived) Middle Class Ticket It Used To Be

In a previous post, I presented some simple data on “subjective class identification," which is the practice of asking people to place themselves within a class structure. The data show that, despite constant political rhetoric appealing the U.S. “middle class," more people actually consider themselves to be working class than middle class, and that this hasn’t changed much over the past thirty years.

I also noted that there is even a fairly significant “working class presence” – about 25 percent – among the highly educated (those with a bachelor's or higher). This struck me as interesting, given the fact that having a college degree is sometimes called “the ticket to the middle class," and also given that the income advantage for college graduates – the “college wage premium” – is substantial (and it's actually increased over the long term). I found myself wondering whether the relationship between having a college degree and “gaining entrance” to the middle class (at least by one’s own judgment of his or her class position) had changed over time. In other words, when it comes to subjective class identification, is college less of a middle class “ticket” than it used to be?

I couldn’t resist taking a quick look.

Student Surveys of Teachers: Be Careful What You Ask For

Many believe that current teacher evaluation systems are a formality, a bureaucratic process that tells us little about how to improve classroom instruction. In New York, for example, 40 percent of all teacher evaluations must consist of student achievement data by 2013. Additionally, some are proposing the inclusion of alternative measures, such as “independent outside observations” or “student surveys” among others. Here, I focus on the latter.

Educators for Excellence (E4E), an “organization of education professionals who seek to provide an independent voice for educators in the debate surrounding education reform”, recently released a teacher evaluation white paper proposing that student surveys account for 10 percent of teacher evaluations.

The paper quotes a teacher saying: “for a system that aims to serve students, young people’s interests are far too often pushed aside. Students’ voices should be at the forefront of the education debate today, especially when it comes to determining the effectiveness of their teacher." The authors argue that “the presence of effective teachers […] can be determined, in part, by the perceptions of the students that interact with them." Also, “student surveys offer teachers immediate and qualitative feedback, recognize the importance of student voice […]". In rare cases, the paper concedes, “students could skew their responses to retaliate against teachers or give high marks to teachers who they like, regardless of whether those teachers are helping them learn."

But student evaluations are not new.

Q: Do We Need Teachers' Unions? A: It's Not Up To Us.

I sometimes hear people – often very smart and reasonable people – talk about whether “we need teachers’ unions." These statements frequently take the form of, “We wouldn’t need teachers’ unions if…," followed by some counterfactual situation such as “teachers were better-paid." In most cases, these kinds of musings reflect “pro-teacher” sentiments – they point out the things that are wrong with public education, and that without these things unions would be unnecessary.

I’d just like to make a very quick comment about this line of reasoning, one that is intended to be entirely non-hostile. The question of whether or not “we need teachers’ unions," though often well-intentioned, is inappropriate.

It’s not up to “us." The choice belongs to teachers.

Teacher Quality Only Matters If Students Come To School

The “no excuses” mantra in education started with an irrefutable premise: Nobody should use poverty as an excuse to tolerate dysfunctional pubic schools. For some (but not all) people, it eventually became an accusation as well, hurled at those who brought up the fact – often in a perfectly reasonable manner – that there is a strong, demonstrated relationship between income and achievement. But in its most virulent form, “no excuses” fosters the colonization of additional problems for which schools and teachers can be “held accountable."

Former DCPS Chancellor Michelle Rhee and her fiancée, Sacramento Mayor Kevin Johnson, were hosted by the University of Arkansas’ Clinton School of Public Service for a discussion on education that aired on C-Span a few weeks ago. The moderator asked the panelists for their views on the dismal conditions in many cities, and how that relates to efforts to improve neighborhood schools.

Rhee recounted a story from the final year of her chancellorship, in which she visited a school unannounced, arriving early in the morning. Many of the classrooms were mostly empty. When she inquired, she was told that attendance was low because it was Friday and raining. Rhee said that she was horrified, but continued to tour the school. She finally found a classroom that was full, and asked one of the students about the class. The student told Rhee that this was her favorite teacher.

Investment Counselors

NOTE: With this post, we are starting a new “feature” here at Shanker Blog – periodically summarizing research papers that carry interesting and/or important implications for the education policy debates. We intend to focus on papers that are either published in peer-reviewed journals or are still in working paper form, and are unlikely to get significant notice. Here is the first:

Are School Counselors a Cost-Effective Education Input?

Scott E. Carrell and Mark Hoekstra, Working paper (link to PDF), September 2010

Most teachers and principals will tell you that non-instructional school staff can make a big difference in school performance. Although we may all know this, it’s always useful to have empirical research to confirm it, and to examine the size and nature of the effects. In this paper, economists Scott Carrell and Mark Hoekstra put forth one of the first rigorous tests of how one particular group of employees – school counselors – affect both discipline and achievement outcomes. The authors use a unique administrative dataset of third, fourth, and fifth graders in Alachua County, Florida, a diverse district that serves over 30,000 students.  Their approach exploits year-to-year variation in the number of counselors in each school – i.e., whether the outcomes of a given school change from the previous year when a counselor is added to the staff.

Their results are pretty striking: The addition of a single full-time counselor is associated with a 0.04 standard deviation increase in boys’ achievement (about 1.2 percentile points). These effects are robust across different specifications (including sibling and student fixed effects). The disciplinary effects are, as expected, even more impressive. A single additional counselor helps to decrease boys’ disciplinary infractions between 15 to 26 percent.

Great Expectations

A couple of years ago, Eat Pray Love author Elizabeth Gilbert explored the negative side of our unrealistically high expectations for artists and, more generally, for those who rely on their creativity to make a living. In ancient Rome, Gilbert recounts, creativity was associated with a sort of divine spirit that came to human beings from some distant and unknowable source, for distant and unfathomable reasons. The Romans referred to this intangible spirit as a genius. An individual was not a genius, but rather had a genius - a magical entity who was believed to live in the walls of an artist's studio and who would come out and invisibly assist the artist with his/her work. The lesson Gilbert draws is one of humility (i.e., successes are not entirely ours – don’t be such a narcissist) and emancipatory relief (i.e., failures are not completely our fault either – can’t hurt to try).

What does all this have to do with education and teachers? It seems to me that our expectations for both teachers and artists are sometimes unrealistic and unproductive, if not detrimental. Great teachers are often portrayed as superheroes, unencumbered by anything that might distract them from their teaching crusade – "refusing to surrender to the combined menaces of poverty, bureaucracy, and budgetary shortfalls." As a recent article in The Atlantic explained, Teach for America now asks applicants to talk about how they have overcome the challenges in their lives and uses these answers to rate their perseverance.

Yet the meaning of "Great Teacher" rarely gets analyzed. Instead, our definition of greatness – or even competence – remains a convenient black box, leading some to suggest that the question of what makes a teacher great is less important than separating the wheat from the chaff. In turn, this reveals a simplistic and, in my view, negative assumption that greatness, unlike Gilbert’s genius, is a stable, static, innate, and independent attribute. You either have it or you don’t.

No Excuses In Anti-Poverty Policy As Well

Much of the current education debate consists of a constant, ongoing argument about the role of poverty. One “side” is accused of using poverty as an excuse for not improving schools, and of saying that poverty is destiny in regard to educational outcomes. The other “side” is accused of completely ignoring the detrimental effects of poverty, and of arguing that market-based reforms can by themselves transform our public education system.

Both portrayals are inaccurate, and both “sides” know it, yet the accusations continue. Of course there is a core of truth in the characterizations, but the differences are far more nuanced than the opponents usually communicate. It’s really a matter of degree. In addition to differences in the specifics of what should be done, a lot boils down to variations in how much improvement we believe can be gained by teacher-focused education reform (or by education reform in general) by itself. In other words, some people have higher expectations than others.

I have previously argued that the reasonable expectation for teacher quality-based reforms is that, if everything goes perfectly (which is far from certain), they will generate very slow, gradual improvement over a period of years and decades. This means we should make these changes, but be very careful to design them sensibly, monitor their effects, and maintain realistic expectations (for the record, I think we are, in many respects, falling short on all three counts).

But the thing that I find a little frustrating about the whole poverty/education thing is that, while nobody should use poverty as an excuse in education policy, it’s not uncommon to hear education used as an excuse, of sorts, in discussions about anti-poverty policy.

In Census Finance Data, Most Charters Are Not Quite Public Schools

Last month, the U.S. Census Bureau released its annual public K-12 school finance report (and accompanying datasets). The data, which are for FY 2009 (there’s always a lag in finance data), show that spending increased roughly two percent from the previous year. This represents much slower growth than usual.

These data are a valuable resource that has rightfully gotten a lot of attention. But there’s a serious problem within them, which, while slightly technical, hasn’t received any attention at all: The vast majority of public charter schools are not included in the data.

To gather its data, the Census Bureau relies on reporting from “government entities." Some charter schools fit this description neatly, such as those operated by governments or government-affiliated bodies, including states, districts, counties, and public universities. But most charter schools are operated by private organizations (mostly non-profits), and finance figures for these schools are not included in the report (the Census classifies them as "private charter schools").

What does this mean? Well, for one thing, it means that the overall spending figures (total dollar amounts) are a bit understated. Charters only account for a relatively small proportion of all public school enrollments (around 5-6 percent); still, given the huge amounts of money we’re dealing with here (the U.S. spends roughly $600 billion a year), we’re talking about quite a bit in absolute terms. Perhaps more important is the potential effect on per-pupil spending figures – the way that education financing is usually expressed.

When It Comes To How We Use Evidence, Is Education Reform The New Welfare Reform?

** Also posted here on “Valerie Strauss’ Answer Sheet” in the Washington Post

In the mid-1990s, after a long and contentious debate, the U.S. Congress passed the Personal Responsibility and Work Opportunity Reconciliation Act of 1996, which President Clinton signed into law. It is usually called the “Welfare Reform Act," as it effectively ended the Aid to Families with Dependent Children (AFDC) program (which is what most people mean when they say “welfare," even though it was [and its successor is] only a tiny part of our welfare state). Established during the New Deal, AFDC was mostly designed to give assistance to needy young children (it was later expanded to include support for their parents/caretakers as well).

In place of AFDC was a new program – Temporary Assistance for Needy Families (TANF). TANF gave block grants to states, which were directed to design their own “welfare” programs. Although the states were given considerable leeway, their new programs were to have two basic features: first, for welfare recipients to receive benefits, they had to be working; and second, there was to be a time limit on benefits, usually 3-5 years over a lifetime, after which individuals were no longer eligible for cash assistance (states could exempt a proportion of their caseload from these requirements). The general idea was that time limits and work requirements would “break the cycle of poverty”; recipients would be motivated (read: forced) to work, and in doing so, would acquire the experience and confidence necessary for a bootstrap-esque transformation.

There are several similarities between the bipartisan welfare reform movement of the 1990s and the general thrust of the education reform movement happening today. For example, there is the reliance on market-based mechanisms to “cure” longstanding problems, and the unusually strong liberal-conservative alliance of the proponents. Nevertheless, while calling education reform “the new welfare reform” might be a good soundbyte, it would also take the analogy way too far.

My intention here is not to draw a direct parallel between the two movements in terms of how they approach their respective problems (poverty/unemployment and student achievement), but rather in how we evaluate their success in doing so. In other words, I am concerned that the manner in which we assess the success or failure of education reform in our public debate will proceed using the same flawed and misguided methods that were used by many for welfare reform.

The Ethics of Testing Children Solely To Evaluate Adults

The recent New York Times article, “Tests for Pupils, but the Grades Go to Teachers," alerts us of an emerging paradox in education – the development and use of standardized student testing solely as a means to evaluate teachers, not students. “We are not focusing on teaching and learning anymore; we are focusing on collecting data," says one mother quoted in the article. Now, let’s see: collecting data on minors that is not explicitly for their benefit – does this ring a bell?

In the world of social/behavioral science research, such an enterprise – collecting data on people, especially on minors – would inevitably require approval from the Institutional Review Board (IRB). For those not familiar, IRB is a committee that oversees research that involves people and is responsible for ensuring that studies are designed in an ethical manner. Even in conducting a seemingly harmless interview on political attitudes or observing a group studying in a public library, the researcher would almost certainly be required to go through a series of steps to safeguard participants and ensure that the norms governing ethical research will be observed.

Very succinctly, IRBs’ mission is to see that (1) the risk-benefit ratio of conducting the research is favorable; (2) any suffering or distress that participants may experience during or after the study is understood, minimized, and addressed; and (3) research participants’ agreed to participate freely and knowingly – usually, subjects are requested to sign an informed consent which includes a description of the study’s risks and benefits, a discussion of how confidentiality will be guaranteed, a statement on the voluntary nature of involvement, and a clarification that refusal or withdrawal at any time will involve no penalty or loss of benefits. When the research involves minors, parental consent and sometimes child assent are needed.

In short, IRB procedures exist to protect people. To my knowledge, student evaluation procedures and standardized testing are exempt from this sort of scrutiny. So the real question is: Should they be? Perhaps not.