Sunday, June 21, 2020
Race to the bottom
Following the first administration of the new SAT, the College Board released a highly unscientific survey comparingà 8,089 March 2016 test-takers to 6494 March 2015 test-takers.à You can read the whole thing here, but in case you dont care to, here are some highlights: 75% of students said the Reading Test was the same as or easier than they expected. 80% of students said the vocabulary on the test would be useful to them later in life, compared with 55% inà March 2015. 59% of students said the Math section tests the skills and knowledge needed for success in college and career. Leaving aside the absence ofà some basic pieces of background information that would allow a reader to evaluate just how seriously to take this reportà (why were different numbers of test-takers surveyed in 2015 vs. 2016? who exactly were these students? how were they chosen for the survey? what were their socio-economic backgrounds? what sorts of high schools did they attend, and what sorts of classes did they take? what sorts of colleges did they intend to apply to? were the two groups demographicallyà comparable? etc., etc.), this is quite a remarkable set of statements. Think about it: the College Board is essentiallyà bragging à bragging about how much easierà the new SAT is. Had a survey like this appeared even a decade ago, ità most likely would be have been inà The Onion.à In 2016, however,à the line between reality and satireà is considerably more porous. To stateà the obvious, most high school juniorsà have notà ever taken an actual college class (that is, a class at a selective four-year college),à and it is exceedingly unlikely that any of themà have ever held a full-time, white collar job. They have no real way of knowing whatà skills vocabulary, math, or otherwise will actually be relevant to their futures. Given that exceedingly basic reality, the fact that the College Board is toutingà the surveyà as being in any way indicative of the tests value is simultaneously hilarious, pathetic, and absurd. So,à aà few things. First,à Ive said this before, but Ill reiterate it here: the assertion thatà the SAT is now more aligned with what students are learning in school overlooks the factà that the entire purposeà of the test has been altered. The SAT was always intended to be a predictive test, one thatà reflected the skills students would need in college. Unlike the ACT, it was never intended to be aligned withà a high school curriculum in the first place. Given the very significant gap between the skills required to be successful in the average American high schoolà and the skills necessary to be successful at a selective, four-year collegeà or university, there is a validà argument to be made for an admissions test aligned with the latter. But regardlessà of what one happens to think about the alignment issue,à to ignore ità is to sidestepà what should be a major component of the conversation surrounding the SAT redesign. Second, the College Board vs. ACT, Inc. competition illustrates the problem ofà applying the logic of the marketplace toà education. In order to lure customers from a competitor, a companyà must of course aim to provide those customers with an improved, more pleasurableà experience. That principle works very wellà for a company thatà manufactures, say, cars, orà electronics. If your customers are students and your product is a test, however, then the principle becomes a bit more problematic. The goal then becomesà toà provide students with a test that they willà like. (Indeed, if I recall correctly, when the College Board first announced the redesign,à the new test was promoted as offeringà an improved test-taking experience.) What sort of test is that?à Aà simpler test, of course. A test that inflates scores, or at least percentile rankings. A more gameable test: one on which it is technically possible to obtain a higher score by filling in the same letter forà every single question than by answering any of the questions for real. A testà that makes students feel good about themselves, while strategicallyà avoiding anything that might directly expose gaps in their basic knowledgeà gapsà that their parents probably dont know their children possess and whose existence they would most likely be astounded to discover. (Trust me; Ive seen the looks on their faces.) Most of the passages on the English portion of the ACT are writtenà around a middle school level, as are the Writing passages on the new SAT. Unlike the ACT, which assigns separate scores to the English and Reading portions, the new SAT takes things a step further and combines Reading and Writing portions into a single Verbal score. As a result, the SAT allows students reading below grade level to hide theirà weaknesses much more effectively. Indeed, Idà estimate that most of my ACT students, many of whom switched from the SAT because the reading wasà simply too difficult, were readingà at somewhere between a seventh- and a ninth-grade level. Those students are pretty obviouslyà the onesà the College Boardà had in mind when it redesigned the verbal portion. Forgive me for sounding like an old fogey from the dark ages of 1999 here, but shouldà a college admissions test really be pandering to these types of students? (Sandra Stotsky, one of two members of the Common Core validation committee to reject the standards, has suggested that the high school Common Standards be applied toà middle school students as a benchmark for judging whetherà they are ready forà high school.) And for colleges,à do the benefits of collapsing the distinction between solid-but-not-spectacular readersà and the exceptional readers trulyà outweigh the drawbacks? Those sorts of differences are not always captured by grades;à that is exactly what has traditionallyà made the SAT useful.à Obviously, the achievement gap is the omnipresent elephant in the room. Part of the problem, however, is the college admissions system poses such vastly different challenges for different types of students; theres no way for a single test to meet everyones needs.à Im not denying that for students aiming for elite colleges, the college admissions process can easily spiral out of control. Ive stood on the front lines of it for a while now, and Ive seen the havoc it can wreak although much of the time, that havoc also stems from unrealistic expectations, some of which are driven by rampant grade inflation. An 1100 (1550) SAT was much easier to reconcile with Bsà and an occasional C thanà with straight As.à Aà big partà of the stress, however, is simply a numbers game: there are too many applicants for too few slots at too few highly desirable schools. Changing the test wont alterà that fact.à If anything, a test that produces more high-scoring applicants will ultimatelyà increase stress levels because yet more students will apply to the most selective colleges, which will in turn rely more heavily on intangible factors. Consequently,à their decisions are likely to become even more opaque.à At the other extreme, the students at the bottom may in fact beà lacking basic academic vocabulary such as analyze and synthesize, in which case it does seemà borderline sadisticà to test them on words like redolent and obstreperous. à Its pretty safe, however, to assume that students in that category will generally not be applying to the most selective colleges. But in changing the SAT so thatà the bottom students are more likely to do passably well on it, the needs of the top end up getting seriously short shrift. No one would argue thatà words like analyze arent relevant to students applying to the Ivy League; the problem is that those students also need to know words like esoteric and jargon and euphemism and predicated. The easiestà way to reduce the gap between these two very disparate groups is of course to adjust to the test downward to a lowerà common denominator while inflatingà scores.à But does anyone seriously think that is a good solution? Lopping off the most challenging partà of the test, at least on the verbal side, will not actuallyà improve the skills of the students at the bottom. It also fails to exposeà the students at the top to the kind of reading they will be expected to do. And even if the formerly ubiquitous flashcards disappear and stress levels temporarily dip, theà underlying issues will remain, and in one guise or another they will inevitably resurface.à Im not naive enough to think that the SAT redesign will have an earth-shattering effect on most high school students.à The students who have great vocabularies and read non-stopà for pleasure wont suddenly stop doing so because a handful of hard words are no longer directly tested on the SAT. The middling onesà who were going to forget all of those flashcards they tried to memorize will come out pretty much the same in the end. The ones who never intended to take the test will sit through it in school because they have no choice, but I know of no researchà to suggest that areà more likely to complete a four-year degree as a result. Plenty of students whose parents initially thought Khan Academy could replace Princeton Review will discover that their children need some hand-holding after all and sign them up for a class especially if all of their friends suddenly seemà to be scoring above the 95th percentile. Not to mention the thousands of kids whoà will ignore the red esign altogether and take the ACT, just as they intended to do in the first place. Rather, my real concern is about the message that the College Board is sending. Launching a smear campaign to rebrandà the type of moderately challenging vocabulary that peppers serious adultà writing as obscure might have been necessary to win back market share,à butà it was a cheap and irresponsible move. It promotesà the viewà that a sophisticated vocabulary is something to be sneered at; that simple, everyday words are the only ones worth knowing. Even if that belief is rampant in the culture at large, shouldnt an organizationà like the College Board have some obligationà to rise above it? It suggests that knowledgeà acquiredà through memorization is inherently devoid of value. It misrepresentsà theà type of reading and thinking that college-level work actually involves. It exploitsà theà crassest type of American anti-intellectualism by smarmily wrappingà ità in a feel-good blanket of social justice. And ità promotes the illusion thatà student s canà grapple with adult ideas while lacking the vocabularyà toà either fully comprehend them or to articulateà cogent responses of their own.à What is even more worrisomeà to me, however, is that the College Boards assertions about the new testà have largely been taken at face value. Virtually no one seems to have bothered to look at an actual recent SAT, or interviewed people who actually teach undergraduatesà (as opposed to administrators or admissions officers), or even stopped to consider whether the evidence actually supports the claims à that whole critical thinking thing everyone claims to be so fond of.à Andà that is a problemà that goes far, far beyond the SAT.
Subscribe to:
Posts (Atom)