{"id":871,"date":"2007-02-14T20:05:51","date_gmt":"2007-02-15T00:05:51","guid":{"rendered":"http:\/\/shermandorn.com\/wordpress\/?p=871"},"modified":"2007-02-14T20:05:51","modified_gmt":"2007-02-15T00:05:51","slug":"parsing-growth-and-grossing-the-parthenon","status":"publish","type":"post","link":"https:\/\/shermandorn.com\/?p=871","title":{"rendered":"Parsing growth and grossing the Parthenon"},"content":{"rendered":"

Kevin Carey<\/a> criticizes Leo Casey<\/a>‘s take on growth measures to evaluate teacher effectiveness.  Casey cited a 2003 RAND Corp. study<\/a> which cast doubt on the use of student-achievement growth measures to evaluate teachers (something pushed by the Aspen Commission<\/a>).<\/p>\n

<\/p>\n

\nCarey makes two points:<\/p>\n
    \n
  1. How<\/em> to use the imperfect data tools we currently have available is a policy decision. To Kevin Carey, this type of decision-making includes issues such as the acknowledgment and discounting of technical flaws (in multiple possible meanings of discounting<\/em>).\n
  2. One possible reason for the lack of evidence of growth models’ ability to be used to judge teachers is resistance to their use in the U.S., except for Tennessee and a few other jurisdictions.<\/li>\n<\/ol>\n

    I completely agree with #1. It is<\/em> the authority of policymakers to tangle with the technical details of policy and the implications of those technical details. Not only do I have no problems with this claim, but I argue that point in Accountability Frankenstein<\/em>. But the authority also implies responsibility to do so, and I hope Carey understands that placing the marker down at this point means that he’ll be holding policymakers to making reasonable judgments on those technical details: No hand-waving and displacing responsibility onto invisible bureaucracies, right? Of course, I doubt he or anyone else can point to any legislature that has set a cut-score for any graduation or teacher competency test… or bar exam, electrical contracting exam, general contractors’ license exam, etc. No, I’m not arguing that legislatures should really do that, but Carey’s point is all on theoretical authority and very little on acknowledging the fact that legislatures generally do<\/em> displace responsibility for technical details. <\/p>\n

    The second point is something I’m going to quibble about.  Yes, Tennessee has had something called “value-added assessment” since the early 1990s, but I have yet to see any<\/em> evidence that Bill Sanders’ system consistently distinguishes anything more than a small proportion of teachers from the vast, vast majority (as either good or bad), and that’s even assuming the validity of the TerraNova test results in Tennessee. Sanders acknowledges it, and it’s partly an artifact of any multilevel modeling (which tends to swallow a good portion of the variance originally in the data). <\/p>\n

    The “resistance” point only makes sense if you’re restricting us to the U.S., since the U.K. has been attempting multilevel modeling of longitudinal achievement much longer than anyone in the U.S. Go ask Harvey Goldstein<\/a> what he’d say from the U.K. experience, or read his papers, such as Using Pupil Performance Data for Judging Schools and Teachers<\/a> (PDF). Basic point: There’s still little evidence that growth models are the holy grail either for school-level or teacher-level accountability. (Credit Goldstein for using “holy grail” to refer to various fantasies of growth-model advocates.)<\/p>\n

    Extra credit to anyone who knows why I used “Parthenon” in the title of an entry referring to Tennessee, apart from the obvious spoonerism.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Kevin Carey criticizes Leo Casey‘s take on growth measures to evaluate teacher effectiveness.  Casey cited a 2003 RAND Corp. study which cast doubt on the use of student-achievement growth measures to evaluate teachers (something pushed by the Aspen Commission).<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[16,11],"tags":[],"class_list":["post-871","post","type-post","status-publish","format-standard","hentry","category-accountability-frankenstein","category-education-policy"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pag0MB-e3","_links":{"self":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/posts\/871","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=871"}],"version-history":[{"count":0,"href":"https:\/\/shermandorn.com\/index.php?rest_route=\/wp\/v2\/posts\/871\/revisions"}],"wp:attachment":[{"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=871"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=871"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/shermandorn.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=871"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}