Become a Creator today!Start creating today - Share your story with the world!
Start for free
00:00:00
00:00:01
Re:Teaching, EP 2: What’s in a grade? GRExit, GPA, College Admissions, and the Mastery Transcript (oh my!)
15 Plays3 years ago
Long time listeners may recognize the title to this podcast: Re:Teaching. Last year, Nick released a series of short podcasts on a separate channel, focused on current events and short-form highlights of writing. We soon realized that by splitting our podcast into two segments, most folks didn't hear any of this series! Therefore, after much delay - and many reminders by Nick - we'll be releasing Re:Teaching over the next few weeks on this channel. Enjoy, and there will be even more new Re:Teaching episodes on the way.
This episode is a feature read of What’s in a grade? GRExit, GPA, College Admissions, and the Mastery Transcript (oh my!) by Nick Covington, published in March 2020. Learn more about Human Restoration Project and find a wealth of free resources to create human-centered classrooms at humanrestorationproject.org, and follow us on social media, @HumResPro.
Recommended
Transcript
NIU removes standardized tests from admissions
00:00:06
Speaker
Whether a student will succeed at NIU, whether they will graduate within a reasonable amount of time with a degree in hand, those scores tell us nothing.
00:00:14
Speaker
We've done mathematical analysis looking at the various things that go into predicting whether a student will succeed at NIU, and those scores have no value.
00:00:23
Speaker
said Northern Illinois University President Lisa Freeman in a January 2020 interview.
00:00:28
Speaker
As the university announced, they will drop standardized assessment from their admissions requirements and move to a holistic application review while guaranteeing admission to any student with a cumulative GPA of 3.0 or higher.
00:00:40
Speaker
NIU is just one of many schools dropping standardized assessments from their admissions process, and this particular decision pairs with the release of a new peer-reviewed study published an educational researcher finding that high school GPAs are five times stronger than ACT scores in predicting college graduation.
00:01:00
Speaker
teaching, a look at the movement of undergrad and graduate programs away from standardized assessments, unpack new research into our assumptions about standardized test scores as predictors of college completion, and challenge listeners to rethink what's in a grade.
Universities move away from SAT/ACT requirements
00:01:18
Speaker
The policy shift at Northern Illinois follows what the Washington Post calls a turning tide as, quote, a record number of schools have decided to accept all or most of their freshmen without requiring test results, unquote, amid a growing disenchantment with standardized tests.
00:01:34
Speaker
Between September 2018 and September 2019, they write, nearly 50 accredited colleges and universities announced that they were dropping SAT or ACT scores to
00:01:44
Speaker
as an admissions requirement, bringing the total to 1,050, or nearly 40% of the total number of accredited universities that award bachelor's degrees.
00:01:54
Speaker
With public attention still on the 2019 college admissions bribery scandal, disenchantment with standardized tests also comes from research pointing to growing score gaps across demographic groups.
Correlation between test scores and socioeconomic factors
00:02:05
Speaker
And according to the National Center for Fair and Open Testing, quote, with the average scores of students from historically disenfranchised groups falling further behind students from more privileged families and finding a consistent link between SAT and ACT scores and family incomes, mother's education level, and race.
00:02:23
Speaker
While it may be up to the governing bodies of major universities to make these decisions, Cecilia Estolano, vice chair of the University of California Board of Regents, has made her opinion clear that the tests use a, quote, clearly flawed methodology that has a discriminatory impact, end quote, adding, quote, we don't need any more studies on the issue, end quote.
Graduate programs dropping GRE requirements
00:02:46
Speaker
This disillusionment isn't confined to undergraduate institutions.
00:02:50
Speaker
A wave of graduate programs, dubbed GRExit or Grexit, have also dropped the GRE as an admissions requirement.
00:02:58
Speaker
According to ScienceMag, while most PhD programs still require a GRE score, life science programs are leading the Grexit push.
00:03:07
Speaker
It's estimated that more than 50% of molecular biology PhD programs have dropped the GRE, along with one-third of neuroscience and ecology programs.
00:03:18
Speaker
These decisions challenge public and faculty assumptions that the GRE is an accurate predictor of how students will perform in graduate programs, while a growing body of evidence seems to indicate that GRE scores aren't correlated with how long it takes to complete a degree program, whether students will graduate, nor their accomplishments in postgraduate fieldwork.
00:03:39
Speaker
A study released in January 2019 concluded that for physics PhD programs, which the study calls the least diverse of the sciences, GRE scores were not only insignificant in predicting program completion, but, quote, aside from these limitations in predicting PhD completion overall, over-reliance on GRE scores in admissions processes also selects against underrepresented groups, end quote.
00:04:06
Speaker
The authors conclude, and I'll quote at length,
00:04:08
Speaker
Excellence as a researcher is likely also a function of research mentoring and experience, both before and in graduate school, and socio-emotional slash non-cognitive competencies, for example, initiative, conscientiousness, accurate self-assessment, and communication, which scholars have linked to performance in other professional and educational domains.
00:04:48
Speaker
Like Vice Chair Estolano in the University of California system, the chair of the Physics and Astronomy Department at the University of Pittsburgh agrees with the conclusions, saying, quote, End quote.
High school GPAs vs. standardized tests in measuring readiness
00:05:12
Speaker
At the crest of this tide, a new study authored by Elaine Allensworth and Callie Clark out of the University of Chicago titled High School GPAs and ACT Scores as Predictors of College Completion Examining Assumptions about Consistency Across High Schools is, according to phys.org, the first of its kind to, quote, explicitly test whether standardized assessments are comparable across high schools as measures of college readiness, unquote.
00:05:39
Speaker
Allensworth and Clark examined over 55,000 graduates of Chicago public schools who immediately enrolled in college.
00:05:47
Speaker
This sample size and diversity of school environments in the Chicago public school system make the study of particular interest.
00:05:55
Speaker
The authors point out that all 50 states use standardized assessments as an indicator of college readiness out of the assumption that these types of college entrance exams are, quote, strong and consistent measures of readiness, end quote, in the way they assess all students under identical conditions, time, and tasks, compared to the use of GPA and subjective course grades in an era of supposed rampant grade inflation.
00:06:18
Speaker
And of course, there is concern about the alignment and comparability of school coursework to the content and skills measured by exams like the SAT and ACT.
00:06:27
Speaker
Much of the research cited in the paper questions the objectivity and validity of exams as predictive of college outcomes.
00:06:34
Speaker
For example, a large 2009 study found the relationship of SAT and ACT scores with college outcomes was small and sometimes not even significant.
00:06:44
Speaker
A 2014 study concluded that students in test-optional colleges who did not submit test scores had similar or better college outcomes than students in the same colleges with similar high school GPAs.
00:06:57
Speaker
A 2004 study examined California University data and found that much of the relationship between SAT scores and college GPA could be attributed to high school poverty, school racial composition, and student background.
00:07:11
Speaker
In fact, this study concluded that SAT scores were such a proxy for student background and socioeconomic status that, quote, the background variables themselves can provide much of the information contained in the SAT score, end quote.
00:07:24
Speaker
And the author suggests sarcastically that, quote, admissions offices could admit better prepared entering classes by giving explicit admissions preferences to high SES students and to students from high SES schools, end quote.
00:07:38
Speaker
which the author calls affirmative action for high SES children.
00:07:42
Speaker
And lastly, the authors point to a body of evidence that factors other than high school GPA that can account for college success and explain the variation and predictive ability of GPA across high schools, which go beyond college knowledge to include things like access to diverse environments and enrichment opportunities outside the classroom that help students respond to new and challenging situations.
00:08:05
Speaker
About this body of evidence and the results of their own statistical analysis, Allensworth and Clark conclude, quote, there is little evidence that students will have more college success if they work to improve their ACT score because most of the signal from the ACT score seems to represent factors associated with the student's school rather than the students.
00:08:25
Speaker
In contrast, students' efforts to improve their high school GPAs would seem to have considerable potential leverage for improving college readiness, end quote.
00:08:35
Speaker
And they recommend that schools rely less on test scores in accountability systems and in school improvement plans, adding that the factors that may work to improve test scores are not necessarily the same that improve grades and college readiness.
00:08:49
Speaker
So doesn't this work point to the centrality and importance of grades and GPAs in the work of teachers in schools?
00:08:55
Speaker
Doesn't this have implications for teachers going gradeless and those like myself who have worked to diminish and de-center grades in their classrooms?
00:09:02
Speaker
Well, I think the answer is yes, but maybe not in the way that the authors of the study propose.
00:09:07
Speaker
Clark, one of the co-authors, was quoted in a separate interview as saying, quote, Extensive time spent preparing for standardized tests will have less payoff for post-secondary success than effort put into courses as reflected in students' grades, end quote.
00:09:21
Speaker
And this first point, I think, is where the research confirms what educators have long understood about the flaws of deriving predictive value from high-stakes standardized assessments.
00:09:30
Speaker
with the support for this kind of singular decision-making originating primarily from the marketing departments at the College Board and the ACT.
00:09:39
Speaker
Where I think the researchers overextend themselves is in the second half of this claim, where Clark continues, quote, the more that middle and high school educators can support strong engagement in school, helping students overcome barriers to engagement in class, helping them succeed at different types of academic tasks so they earn strong grades, the better these educators are supporting academic skills broadly and preparing students for college, end quote.
00:10:06
Speaker
The question we should be asking is, well, what's in a grade?
00:10:09
Speaker
The qualities Clark mentioned, engagement, overcoming barriers, succeeding at different academic tasks, do not require grades.
00:10:17
Speaker
And in some contexts, grading practices actually diminish engagement, erect barriers, and prevent students from demonstrating success and contribute to inequitable outcomes.
00:10:27
Speaker
In fact, the authors also conclude, quote, that students are more likely to graduate college if they come from some high schools rather than others.
00:10:35
Speaker
These school effects may be the result of more rigorous academic programs at some high schools, different non-academic supports for preparing students for college, or simply a tendency of families with more resources for college to send their students to particular schools.
00:10:52
Speaker
End quote.
00:10:54
Speaker
For as much of their statistical analysis linked GPA to college completion, it seems the authors also rediscovered another conventional wisdom, that students from families with more resources for college are more likely to have higher GPAs because they are able to send their kids to high schools with a better track record of college attendance and completion, similar to the phenomenon in our discussion of SAT scores as a predictable proxy for socioeconomic status.
00:11:21
Speaker
But we know from socioeconomic data that it's just as likely that these families come from educated backgrounds themselves, ensuring that they understand how to navigate the systems of school and legacy admissions.
00:11:32
Speaker
They live in safe communities with stable family situations.
00:11:36
Speaker
They have access to preschool and summer enrichment, to personal libraries of books and the internet at home, to adequate nutritious meals, healthcare, braces and glasses, all of the benefits that socioeconomic status buys you in America.
00:11:50
Speaker
While it might also be the case that students with low GPAs struggle with mental and physical health, or live in segregated, underserved, and historically disadvantaged communities, to attend schools with undiagnosed learning disabilities, to be suspended or expelled at higher rates, or deal with inadequate transportation and transient housing situations,
00:12:10
Speaker
And if motivation, engagement, and success in school as measured by GPA are all positively correlated, I guess it doesn't come as a surprise to me that our education system selects for those with the most advantages and privileges.
00:12:24
Speaker
When the authors write that decreasing reliance on test scores will increase the salience of GPA in college admissions, I think we're just as correct to interrogate the factors that contribute to GPA as a measure of school success.
00:12:36
Speaker
And since we know the limitations and harms of grades and understand how GPA measures individual and school factors beyond the curriculum, we need to do better than a single average number to describe student abilities.
00:12:49
Speaker
It turns out we can do better.
Beyond GPAs: Holistic student evaluation approaches
00:12:52
Speaker
The Mastery Transcript provides an example of exactly such a model for how college admissions could look different without reducing students to just a number.
00:13:01
Speaker
The Mastery Transcript Consortium is a partnership between member schools and the Mastery Transcript team to develop mastery-based rubrics and curate an alternative representation of a student's interests and abilities beyond a single numerical average.
00:13:16
Speaker
The sample on their website visually captures and communicates students' strengths and progress in areas that a GPA is a poor proxy for anyway.
00:13:24
Speaker
Things like citizenship and decision-making, problem-solving and critical analysis, communication and self-expression, and social, cultural, and historical fluency.
00:13:33
Speaker
And the mastery transcript features selected work by the individual student to support their credentials in those areas.
00:13:39
Speaker
Even for this sample student, a much more holistic and authentic picture of their interests and abilities emerges.
00:13:46
Speaker
In both its looks and purpose, it seems more like a resume than a traditional transcript of credits.
00:13:52
Speaker
Assessment scores and GPAs alike have shown themselves to be outmoded tools from an age in which the linkage between our values, their reductive measurements, and our children's future success seemed obvious.
00:14:03
Speaker
Now the only obvious thing seems to be a clear movement away from discriminatory and dehumanizing calculations that once gave institutions a kind of technical cover to select for privilege.
00:14:13
Speaker
If we desire more than a number from our kids,
00:14:16
Speaker
We have to figure out what it is we value and develop a means of communicating those values, not compromise our values for the convenience and comfort of those with a vested interest in keeping our kids at arm's length.
00:14:28
Speaker
I've told this story in several places now, but over the last several years, Iowa high schools have largely transitioned away from reporting class rank.
00:14:36
Speaker
Where it was once assumed vital to the college admissions process that some chosen student be number one and everyone fall in their place behind them, this year the State Board of Regents eliminated class rank from its Regents Admissions Index calculation, which determines a cutoff score for automatic acceptance into the state's public universities.
00:14:55
Speaker
It's just not the case that we have to settle for what colleges demand of us and our kids.
00:15:00
Speaker
Iowa high schools changed their practice, and the university system was forced to listen.
00:15:06
Speaker
I, for one, can't wait to see what vital and sacred number we make them drop next.