Category Archives: No Child Left Behind

The Cost of Commitment

Commitment

President Obama gave a speech at Wright Middle School in Madison today (text here) outlining his education reform initiative for the nation’s schools, called “Race to the Top,” sometimes referred to by some of his critics as the “Race off the Cliff.”

As Thomas Mertz has pointed out earlier, the amount of funds being discussed here for Wisconsin are relatively meager.

Make no mistake that this is cake, a treat, not life-sustaining bread.  The amount being discussed for Wisconsin is $80 million and this relative pittance would all be targeted for specific programs and when the $80 million is gone, Wisconsin would be stuck with more things that we can no longer afford.

So what type of reform would we be getting in this initiative, along with the modest dollars to come our way, and what would we be giving up in return? That was the crux of a letter sent yesterday by State Senator Mark Miller, chair of the Joint Committee on Finance, to Secretary Arne Duncan. He is worried like others in similar policy positions, that with all the current economic challenges out there blowing huge holes in states’ budgets across the country, that:

We do not have the fiscal resilience to sustain another long-term financial commitment based on the mere possibility that we may be awarded one-time federal dollars in the future. Once these proposed educational policy and fiscal changes are enacted into law, Wisconsin legislators and taxpayers will be responsible for the accompanying financial commitment regardless of the outcome of Wisconsin’s Race to the Top application. This promise to fund new requirements without the promise of federal dollars puts at risk other social safety net programs that rely on adequate state funding to operate.

He cited the example of costs associated with the implementation of a “Children’s Zone” in Wisconsin based upon a model developed for Harlem that could ultimately have ongoing costs to Wisconsin of more than $400 million. If you make such financial and policy commitments you must be able to have some good assurances that you can continue to pay for them. He likens the exercise in not knowing how the grant dollars will be allocated and for how long, to a gambler “trying to draw to an inside straight.”

The National Academy of Sciences recently issued a report offering recommendations on how to revise the funding guidelines and regulations of Obama/Duncan’s $4.35 billion “Race to the Top” grant program, and is well worth a read. Interestingly, the report all but neglects to mention charter schools, which are a major component of RTtT. You can read something I wrote on that subject the other day, here.

In a press release for the Academy’s study, they applauded the step of encouraging states to create systems of linking data on student achievement to teachers, since, as they noted, it is essential to conducting research about the best ways of evaluating teachers.

One way of evaluating teachers, currently the subject of intense interest and research, are value-added approaches, which typically compare a student’s scores going into a grade with his or her scores coming out of it, in order to assess how much “value” a year with a particular teacher added to the student’s educational experience.  The report expresses concern that the department’s proposed regulations place excessive emphasis on value-added approaches.  Too little research has been done on these methods’ validity to base high-stakes decisions about teachers on them.  A student’s scores may be affected by many factors other than a teacher — his or her motivation, for example, or the amount of parental support — and value-added techniques have not yet found a good way to account for these other elements.

The report also cautioned against the use of the National Assessment of Educational Progress (NAEP), a federal assessment instrument. While effective at monitoring broad trends, it will not be able to detect the type of specific effects of the targeted interventions that the RTtT hopes to fund. This infatuation with data can lead reformers, philanthropists (case in point, Bill Gates’ team up with RTtT-type initiatives) and bureaucrats to become unquestioning supporters of using test scores as indicators of real learning and teaching. As the study pointed out:

The choice of appropriate assessments for use in instructional improvement systems is critical. Because of the extensive focus on large-scale, high-stakes, summative tests, policy makers and educators sometimes mistakenly believe that such tests are appropriate to use to provide rapid feedback to guide instruction. This is not the case.

The report also urged caution when trying to apply such a blunt instrument towards making international comparisons.

We note that the difficulties that arise in comparing test results from different states apply even more strongly for comparing test results from different countries.

They conclude the report with a reiterated point, “careful evaluation of this spending should not be seen as optional; it is likely to be the only way that this substantial investment in educational innovation can have a lasting impact on the U.S. education system.”

And in another side note related to federal education financing, the Obama administration’s latest and most detailed information yet on the jobs created by the stimulus, noted that of the 640,239 jobs recipients claimed to have created or saved so far, more than half — 325,000 — were in education. Most were teachers’ jobs that states said were saved when stimulus money averted a need for layoffs.

Robert Godfrey

Leave a comment

Filed under "education finance", Accountability, AMPS, Arne Duncan, Best Practices, finance, Gimme Some Truth, National News, No Child Left Behind, Uncategorized, We Are Not Alone

Reform Is In The Air

reform1832

Mike Rose at Truthdig has noted that following the extensive and unprecedented federal reach of No Child Left Behind, the Obama administration is attempting to extend this iniative further by putting some some serious money behind a number of education initiatives that invite states and districts to compete for federal dollars. In the K-12 education world, they want, in part, to stimulate better state standards and tests, including the better measurement of teacher effectiveness, while turning around failing schools. One way they want to accomplish this is through an increase in the number of charter schools. At the same time, a third initiative wants to spark innovation and scale up the best of local academic programs.

As Mr. Rose acknowledges, this is a moment of real promise for American education, from kindergarten through college. But he also sounds a note of caution.

Reform is in the air. But within many of these reforms are the seeds of their undoing.

He pointed out that the Education Department has put a lot of stock in charter schools as “engines of innovation,” while noting, importantly, that DOE will not consider a state’s funding proposal if that state has a cap on charters.

Yet a number of research studies — the most recent from Stanford — demonstrate that charter schools, on average, are no better or worse than the regular public schools around them. To be sure, some charters are sites of fresh ideas and robust education, but so are magnet schools, and, lest we forget, so are our regular public schools, ones with strong leadership and a critical mass of good teachers. For the “reformers’” however, charter schools are the recipients of the highest accolades, the rest – not so much.

The Stanford University study shattered the myth of charter school superiority. According to Stanford’s Center for Research on Education Outcomes, students at only 17 percent of charter schools do better on math and reading tests than their demographic peers in regular public schools. Thirty-seven percent do worse, while 46 percent of charter school kids, almost half, perform at approximately the same level as their traditional public school counterparts.

The author of the report concludes:

This study shows that we’ve got a 2-to-1 margin of bad charters to good charters.

The results are especially significant, given that charter schools have built-in advantages – starting with parents that are engaged enough in their children’s education to put them there, in the first place. Yet the actual outcomes, in most cases, fail to live up to the hype.

President Obama and his administration are committed to charter schools. In no small part this policy is driven by Education Secretary Arne Duncan, who was a cheerleader for charters when he ran the Chicago school system, and has threatened to withhold federal education money from the 10 states that don’t yet have charter schools and the 26 other states that put limits on enrollment in charters. Such raw coercion, especially given the results of the Stanford study, seems strongly misguided. This comes in spite of the acknowledgement of the Stanford study on the part of Sec. Duncan, which, he suggests, merely points to the need for greater vigilance. “Charter authorizers need to do a better job of holding schools accountable.”

This administration has said that charter schools are key to educational “reform,” and provide “competition” for traditional schools. But that’s utter nonsense if the educational outcomes are no better, and in many cases worse, than in the regular public schools.

Speaking of “holding [charter] schools accountable,” one would of thought that that was a central argument for the need for charter schools in the first place, an institution free of those ill-principled and wretched teacher unions. Unionized teachers are blamed for much of the ills of education; it’s not a reasoned argument, but a matter of faith – and political prejudice. Charter schools are not private (at least not entirely, if you consider they are chartered by the state), but they are the privatizers’ foot in the door, a wedge issue to demonize unions. And that third leg of the reform movement, so to speak, measurement of teacher effectiveness, is also front and center (see the latest continued plea from the Wisconsin State Journal).

One approach being piloted in a number of education systems around the country is by the non-profit Hope Street Group, and developed by a team of teachers across the U.S., who have proposed recommendations for a smarter evaluation system, imploying more ‘objective’ measures of student achievement, ones that aim to attract and retain teachers, and put America’s schools back on top internationally.

“Policy 2.0: Using Open Innovation to Reform Teacher Evaluation Systems” suggests that in K-12 education, any teacher evaluation system should have the input of teachers and administrators and not solely come from researchers and policymakers. Their specific recommendations include the suggestion that evaluation systems should be frequently revised, that teaching advocates need to be involved in this process, and that any in-class observations for assessment must be done by teachers with sufficient experience.

Lets hope the coming “seeds of change” are not broadcasted, with great hope, onto marginal soil. There is too much at stake for education in this new century.

Robert Godfrey

Leave a comment

Filed under Accountability, AMPS, Arne Duncan, Best Practices, Gimme Some Truth, nclb, No Child Left Behind, Uncategorized, We Are Not Alone

Education Tweak #12 – Arne Duncan: “You Lie” (+ Bob Dylan Bonus)

Click on image for pdf.

Click on image for pdf.

Previous EDTweaks can be found at www.edtweak.org.

And thanks to my brother for making the connection between the Joe Wilson “You lie” outburst and this classic Bob Dylan performance.

Thomas J. Mertz

Leave a comment

Filed under Accountability, Arne Duncan, Best Practices, Gimme Some Truth, National News, nclb, No Child Left Behind

A need for pigeonholes

Thomas J. Mertz highlighted some inherent problems with the “Cluster Grouping” scheme envisioned in MMSD’s Talented and Gifted Plan. Given the swift policy creation the board is starting to enact, it is useful to highlight some of the potential downsides to ability grouping.

A dichotomous and discouraging set of statistics, one with the focus both on TAG education and the special education, should give one pause to think further about the school board’s current rush to implementation of the TAG plan without establishing the terms for an evaluation.

The Education for Change site has highlighted the under-representation of children of color in gifted education classes and programs.

* In 1997, African-Americans made up 17.2% of the total student population, but only 8.40% of those assigned to gifted and talented classes or programs.
* Latina/o students comprised 15.6% of the student population, but 8.6% of the students designated for gifted and talented classes or programs.
* King, Kozleski and Landsdowne (2009) reported that in California in 2007, 7.2% of the students enrolled in public education were African-American, yet only 4.13% of those enrolled in gifted and talented educational program were African-American.

The National Research Council Committee on Minority Representation in Special Education reported that Asian/Pacific Islanders are 1/3 more likely than white students to be in gifted programs, while African-American and Latina/o students are less than half as likely to be enrolled in gifted and talented educational classes and programs as Caucasian students.

It is not much of stretch to conclude that many of the problems with the assignment of students to gifted education programs are due in large part to the lack of agreement and an overall subjectivity around defining what giftedness actually means. Therefore, the potential for discrimination here is more evident and explicit.

At the same time, when we look at these same sort of comparisons for assessment evaluations of children in special education, we find some similar and disturbing numbers. Consider the disproportionate number of students of color classified as special needs students. The Twenty-Second Annual Report to Congress on the Implementation of the Individuals with Disabilities Education Act (2000) documents the extent and seriousness of the problem:

* African-American youth, ages 6 through 21, account for 14.8 percent of the general population. Yet, they account for 20.2 percent of the special education population.
* In 10 of the 13 disability categories, the percentage of African-American students equals or exceeds the resident population percentage.
* The representation of African-American students in the mental retardation and developmental delay categories is more than twice their national population estimates.

The same National Research Council panel cited above has also noted that in 1998, African-American students were 59% more likely to be identified as emotionally disturbed than Caucasian students. According to a NAACP study, “contrary to the expectations, is the finding that the risk for being labeled ‘mentally retarded’ increases for blacks attending schools in districts serving mostly middle-class or wealthy white students” (p. 18). In fact, as Losen and Orfield (2002) have noted, African-American children, and especially males, are at increased risk for mental retardation and emotional disturbance identification as the white population of a district increases.

These numbers tell us caution and careful study is the wisest course of action whenever we embark on an effort to pigeonhole children. It always done with the best of intentions (mostly), but a rush to implementing a program so rife with labeling is indeed a worrying one.

Robert Godfrey

Leave a comment

Filed under AMPS, Best Practices, education, Equity, Gimme Some Truth, No Child Left Behind

Sherman Dorn Asks THE QUESTION and Offers Some Answers

riddler45cover1Longtime readers should know that Sherman Dorn is one of my favorite people in the edusphere. His  recent “How can we use bad measures in decisionmaking?” is a fine example of why I value his contributions so much.

His titular question is THE QUESTION at the heart of so much ed policy action these days.  Nobody who isn’t seeking profits or losing their mind likes the tests being used — not Arne Duncan, not Barack Obama, not the people in Madison poised to build a Gifted Education house of cards on them — but almost nobody wants to give up on the tests and many want to expand their use (Arne Duncan, Barack Obama, those house of card builders in Madison).

Everyone talks of better tests, multimodal assessments, new ways of looking at data….  All this can be good, however we aren’t there yet and the simple-minded attraction of letting the flawed data “drive” education policy is strong (the current draft of the MMSD Strategic Plan has both reasonable  data ” inform[ed]”  and frightening “data driven” language).    Additionally, at least three truths often get lost when better assessments and data are discussed (Dorn hits most of all of these).

  1. All assessments and data are of limited utility.  They are snapshots at best; they are only designed to measure specific things; standard deviations and confidence intervals recognize some of the limits, but are rarely part of “accountability” discussions.  the temptation to use assessments for things they are not designed for is always there.
  2. Because better assessments should mean assessing more things in more ways,fulfilling this promise will result in more time and resources devoted to assessment and analysis and less to teaching and learning.
  3. Employing multiple assessments or sophisticated data analysis (ie Value Added) moves away from transparency in accountability. It already clear that few policy makers, much less members of the public, understand the nature of current assessments and accountability practices.  When you employ Value Added techniques all but the most statistically adept are shut out (some Value Added methods are proprietary and even those who commission the analysis are kept in the dark about the nature of that analysis; others are open, but beyond the understanding of most people).   Combining multiple assessments, including qualitative approaches, produces similar issues.   The MMSD Gifted plan is a perfect illustration.  They promise to identify potential and achievement with referrals and multiple assessments over five domains (academic, creative, leadership, visual and performing arts) and then decide who gets the extra services based on “percentile scores.”  Does anyone think that the promised “transparency” of this exercise will be meaningful to parents and Board members?

This was supposed to be about Sherman Dorn’s post, so back to that (although I think the above — especially the local stuff — is a salient context for what Dorn wrote).

After much good introductory material (including a link to the relatively recent, must read Broader, Bolder Approach Accountability Paper), Dorn explores a variety of positions relative to the problems  of “data that cover too little,” and “data of questionable trustworthiness.”  His presentation of their strengths and weaknesses is insightful and informative.

Dorn himself rejects both the “don’t worry” and “toss” extremes and seeks to extend (begin?) the conversation in pragmatic directions.  Here is how he closes:

Even if you haven’t read Accountability Frankenstein or other entries on this blog, you have probably already sussed out my view that both “don’t worry” and “toss” are poor choices in addressing messy data. All other options should be on the table, usable for different circumstances and in different ways. Least explored? The last idea, modeling trustworthiness problems as formal uncertainty. I’m going to part from measurement researchers and say that the modeling should go beyond standard errors and measurement errors, or rather head in a different direction. There is no way to use standard errors or measurement errors to address issues of trustworthiness that go beyond sampling and reliability issues, or to structure a process to balance the inherently value-laden and political issues involved here.

The difficulty in looking coldly at messy and mediocre data generally revolve around the human tendency to prefer impressions of confidence and certainty over uncertainty, even when a rational examination and background knowledge should lead one to recognize the problems in trusting a set of data. One side of that coin is an emphasis on point estimates and firmly-drawn classification lines. The other side is to decide that one should entirely ignore messy and mediocre data because of the flaws. Neither is an appropriate response to the problem.

I probably don’t do justice to his post.  Read the whole thing.

The reality is that bad data is being used and that the uses are expanding.  I am not as sanguine as Sherman Dorn about the potential for better data and better ways of using it (I’m guessing he’d object to the word sanguine here, and he’d be right because it does not capture where I think he is coming from.  Take it not as an absolute but only as a comparison with me), but I do know that explicit discussions of the issues involved like Dorn’s post are necessary to progress.

Thanks Sherman for the questions and answers.

Thomas J. Mertz

Leave a comment

Filed under Accountability, Arne Duncan, Best Practices, education, Local News, National News, nclb, No Child Left Behind, Uncategorized

Race to the Bottom? – Quote of the Day

declineOverall, our results consistently indicate that the increased focus on individual teacher performance caused a sizable and statistically significant decline in student achievement. This decline in achievement is also much more pronounced in the case of national exams with an e ffect of up to 40% of a standard deviation. As in the different effects in terms of internal and external results, our triple-difference evidence also documents a significant increase of grade inflation. In addition, in support of a causal interpretation of our results, we also find that in almost all specifications and dependent variables there are no significant differences between the treatment and control groups over time before the introduction of merit-pay. Finally, the inclusion of different control variables or the consideration of different subsets of the data makes only very minor differences to the size of our estimates, as would be the case if assignment to treatment were random.

Graph and quote from Pedro S.  Martins, “Individual Teacher Incentives, Student Achievement and Grade Inflation,” Institute for the Study of Labor (2009).

In 2007 Portugal instituted a merit pay plan.  Azores and Madeira (the graph above) and private schools were excluded.   Using these as a control, the quoted study found that this merit pay plan resulted in a decline is student achievement.

Arne Duncan and Barack Obama have made incentive pay plans a centerpiece of their “Race to the Top” scheme.  It may be a path to the bottom.

More on the “Race to the Top” later this week.

Thomas J. Mertz

Leave a comment

Filed under Accountability, Arne Duncan, Best Practices, Contracts, education, Gimme Some Truth, National News, nclb, No Child Left Behind, Uncategorized

Data Driven Sanity

Image from "Guest Blogger Scott McLeod on Data-Driven Decision Making" on the eduwonkette, click on image for more on D3M from that sorely missed blog.

Image from "Guest Blogger Scott McLeod on Data-Driven Decision Making" on the eduwonkette blog, click on image for more on D3M from that sorely missed blog.

Diane Ravitch has some more words of sanity on Data Driven policy making at the Bridging Differences blog.  Click the link for the entire post; here is an excerpt:

This approach rests squarely on the high-stakes use of testing. One only wishes that the proponents of this mean-spirited approach might themselves be subjected to a high-stakes test about their understanding of children and education! I predict that every one of them would fail and be severely punished.

We agree that a better approach is needed to assess how well students are learning what they are taught. We agree that current standardized tests are not adequate to the task of determining the fate—whether they should be rewarded or punished—of children, teachers, and their schools.

I think that testing is important and can be valuable, as it helps to spotlight problems and individuals in need of help. But the determinative word here is “help.” The so-called reformers want to use accountability to find people in need of termination and schools in need of closure. Let’s hope this punishment-obsessed crowd is never put in charge of hospitals!

Unfortunately, events are not breaking in the direction we both prefer. The stimulus bill includes millions so that every state can create a data system. This system will track the test scores of every student, from pre-K to college, and attribute their test score gains (or lack thereof) to their teachers. When the information is available, it will be used and misused. Every teacher (at least those who teach the tested subjects) will have a public record detailing whether his or her students made gains or not. This information will be used to establish calibrated merit pay schemes, so that each teacher will get more or fewer dollars depending on the scores of the year. Is this piecework?

The federal government seems ready to impose a Dr. Strangelove approach on our schools to turn them into “data-driven systems.” Not, as you suggest, “data-informed” systems, but data-driven systems. Teachers will certainly teach to the tests, since nothing else matters. The only missing ingredient from this grand data-driven scheme will be education.

More on data driven policy on AMPS here.

Thomas J. Mertz

1 Comment

Filed under Accountability, Best Practices, education, National News, nclb, No Child Left Behind, Uncategorized

Obama, Duncan, Gingrich, Bloomberg and Sharpton

sthumb_mega_vomit

First there was “Obama Echoes Bush on Education Ideas,” then “Is Arne Duncan Really Margaret Spellings in Drag?,” followed by a very factually challenged major education speech by the President, reach out from Arne Duncan to Green Dot charter school honcho Steve Barr, the appointment of edu-preneur and Bill Gates bag man James Shelton III as head of the Office of Innovation and Improvement, now comes the news that Obama and Duncan are consulting with Newt “Blame the Unions” Gingrich, Michael “Cook the Books” Bloomberg and Al “Where’s My Check?” Sharpton on education policy (hat tip Peter Rickman, via Facebook).

Education takes some hits in the proposed Federal budget too (DOE Budget Page here).

The image above expresses my feelings better than any words can.

Thomas J. Mertz

Leave a comment

Filed under Arne Duncan, education, Gimme Some Truth, National News, nclb, No Child Left Behind, Uncategorized

What’s at stake with the standards movement?: “[T]he kind of individuals we are developing and the kind of nation we wish to be”

The titular quote is from a new book by William A. Proefriedt, High Expectations: The Cultural Roots of Standards Reform in American Education; the video is from a review of that book in the Teachers College Record.

Proefriedt reminds us that the quest for quick and easy (or quick and dirty) standards and accountability has steamrolled a long tradition in America of striving for mass education that cultivates democratic ideals and full individual development while working against  “individual economic rapaciousness” as a danger to the Republic.  This is a tradition we don’t want to lose.

All the “business model” reformers and champions of “consumer interest” as a tool of reform (and that includes Sec. Arne Duncan and President Barack Obama) would do well to read Proefriedt and heed the wisdom of those he has written about.

See also: William A. Proefriedt, “Reading Emerson.”

Thomas J. Mertz

1 Comment

Filed under Accountability, Arne Duncan, Best Practices, education, National News, nclb, No Child Left Behind, Quote of the Day

Hit Again (again and again…)

3_21_captain_america

Wisconsin may have dodged the bullet of privatizers in our State Superintendent election, but at the national level the for profit, not the public crowd are going forth with guns blazing.  President Obama, Arne Duncan and their crew are showing themselves to be,  in the words of  Diane Ravitch, “Margaret Spellings in Drag.”

Their latest hire fits the profile.  Education Week is reporting and the the Department of Education site confirms the Broad trained,  former edu-preneur with LearnNow, most recently Bill “Money Talks” Gates bag man, James Shelton III (scroll here for a bio)  is the new head of the Office of Innovation and Improvement.

I guess for at least the next four years “innovation” will continue to mean privatization and profit-seeking and improvement will continue to defined by the Ministry of Truth.

In history, one school of thought holds that industrialists and capitalists came to welcome expanded government when they realized they could “capture” the boards and departments and use them for their own ends.   Think of the fox guarding the hen house.  The Obama crew are not liberators, just a changing of the guard.

As Deborah Meir recently wrote about the mindset that is at work in the corridors of power:

Some combination of Harvard and Wall Street smarts are seen as all-purpose disinterested expertise, fit for any purpose. The master key. While disregard of educators has a long history, and demonizing of teacher organizations is hardly new, it has reached new heights. A mere 20 years ago one could not imagine school systems would be run by people who never practiced or studied schooling or education. The assumption that “smarts” based on hands-on knowledge is valuable has lost its historic place in our view of reality. Law and business and finance smarts have ruled the day for this generation. At a cost. And not just in schools….

Our schools and our economy—and, above all, our democracy—require us to restore the balance.

The Obama permanent campaign will be holding listening sessions in Wisconsin.  It might be worth trying to get in a good word for public education by and for the people, not profit.

Thomas J. Mertz

Leave a comment

Filed under Accountability, Arne Duncan, Best Practices, education, Gimme Some Truth, Local News, National News, nclb, No Child Left Behind, Take Action, Uncategorized