Right now, the teachers who work at Boise Senior High School have to be some of most anti-formula individuals in the whole country. First, they’re dinged on AYP because the school missed Idaho’s targets for one population group (students with disabilities). Now, their beloved local Boise State Broncos are the only undefeated Division I-A football team in the country, but they’re not the recognized national champion because the BCS formula gave the University of Florida (and several other BCS-conference teams) a statistical advantage, leaving the University of Florida as Ohio State’s matchup in the national championship game last night. Florida trounced Ohio State, and Boise State ended up ranked 5th or 6th (depending on the poll).
\nSo what’s the connection with NCLB?<\/p>\n
<\/p>\n
There is no way, no formula, no mix of opinion polls and computers that ever consistently can select the top two teams… No matter how hard it tries, this championship system turns up paper contenders as often as not (Oklahoma 2004, 2003; Nebraska 2001).<\/p><\/blockquote>\n
As every college football fan from 5 to 95 knows, the BCS formula is not only rigged for certain conferences but inherently arbitrary. The defenders of the system pretend that having a statistical formula means that the system is objective<\/em>, and it certainly puts out a number. But the existence of a set of numbers does not mean that the formula is the best way to resolve a national championship in a fair, independent manner.
\nThat fact is why most sane individuals—those who aren’t tied to the most powerful conferences—favor a playoff, because in sports the way you have an independent judgment of which team is better is to play the game<\/em>. Only in chess tournaments and Division I-A football do you decide who is the best by asking your TI-93.
\nOne of the problems with formula-based accountability systems is the conflation of statistics with independence from conflict of interest. There is<\/em> a tremendous need for mechanisms to hold schools accountable in ways that systems would not be unless someone is looking over their shoulders. That’s a requirement for accountability independent of the political and other interests of school systems as organizations and collections of people.
\nCurrently, high-stakes accountability addresses the need for independence through formulae: insert numbers, retrieve judgment. The argument in favor of such an approach is that it removes the inherent conflict of interest in having educators judge their own work.
\nThe problem with this argument is that it assumes that statistics are the only<\/em> way to fashion an independent judgment of school effectiveness. In other walks of life, though, we don’t require statistics to remove the conflict of interest from judgments. In sports, you play a game, and the referee or umpire is the neutral dispute-resolution mechanism. (Unless you’re into Fantasy Baseball, but I’m not talking about cults here.) In law, you go to court, and a hearing officer, arbitrator, or judge makes a judgment.
\nThe key word here is judgment<\/em>, that sometimes ineffable quality that allows humans to synthesize information and make a decision. In sports and courts, statistics are tools but not trump cards. Baseball managers have a wealth of statistics at their command, but I will take the late Billy Martin’s judgment over any crude number-cruncher today. Judges will hear testimony from experts wielding tables and graphs, but the decisions tumble from their computers as a stream of words, not charts.
\nI have not only a history degree but a masters in demography, and I am not denigrating the value of well-crafted measures (not that most high-stakes test statistics deserve that description). But statistics cannot replace thought, and I am afraid that we have seen that in school accountability policies.
\nAt least football is just a game. But No Child Left Behind’s adequate-yearly-progress standard, a brain-dead mechanism that analysts knew was a problem in 2001? That’s federal law.<\/p>\n
\nWhat is it about the beginning of my semester that a Kappan<\/em> article by Rick “Tough Love” Hess and Andy “Eduwonk” Rotherham<\/a> is dangling in front of me while I have a gazillion things to do? World, will you stop putting these temptations in my path?<\/p>\n","protected":false},"excerpt":{"rendered":"Right now, the teachers who work at Boise Senior High School have to be some of most anti-formula individuals in the whole country. First, they’re dinged on AYP because the school missed Idaho’s targets for one population group (students with disabilities). Now, their beloved local Boise State Broncos are the only undefeated Division I-A football […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_hide_featured_image":false,"_jetpack_featured_image_duplicate_dismissed":0,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[16],"tags":[],"class_list":["post-838","post","type-post","status-publish","format-standard","hentry","category-accountability-frankenstein"],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pag0MB-dw","jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/posts\/838","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=838"}],"version-history":[{"count":0,"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/posts\/838\/revisions"}],"wp:attachment":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=838"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=838"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=838"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}