Zencastr
00:00:00
00:00:01
Speed1x
Format
Share
Embed
Report

Off The Mark: How Grades, Ratings, & Rankings Undermine Learning (But Don't Have To) w/ Jack Schneider & Ethan Hutt

Human Restoration Project
Human Restoration Project

149 plays · Feb 17, 2024

“Let's start with the bad news.” is how the conclusion to my guests’ book about changing grading practice begins. “No one is coming to save us. No consultant is going to sweep through and fix things for a fee. No new technology, digital, online, or otherwise, is going to change the game.” The game, of course, is school, and the currency of that game is grades. Jack Schneider is Dwight W. Allen Distinguished Professor in the College of Education at the UMass - Amherst. He is the Executive Director of the Beyond Test Scores Project. Director of the Center for Education Policy. Co-Editor of the History of Education Quarterly, and Co-Host of the Have You Heard Podcast. Ethan Hutt is the Gary Stuck Faculty Scholar in Education and associate professor at the UNC Chapel Hill School of Education. Their 2023 book, Off the Mark: How Grades, Ratings, and Rankings Undermine Learning (but Don’t Have To), is a thorough, and at times frustratingly pragmatic, exploration of flawed necessity of the load bearing pillars of “real school” – grades, transcripts, and standardized tests – their origins in our nation’s history, the distorting effects they tend to have on the outcomes and goals of education, why nothing has arisen so far to replace them at scale, and why there are no magic potions: “No one is going to wake up one morning and realize that the answer was staring us in the face all along,” they remind us. Balancing the real with the ideal, they also chart a path toward the possibility for something different, and like the grand experiment of public schooling itself, it’s something we’ll have to figure out and build together. Off The Mark [https://www.hup.harvard.edu/books/9780674248410] Jack Schneider [https://www.umass.edu/education/about/directory/jack-schneider] Ethan Hutt [https://ed.unc.edu/people/ethan-hutt/]

Transcript

Speaker: I think my great hope for this book is not that people will read it and say, great, look, we're going to go with double clickable transcripts.

Speaker: We're going to go with overwritable grades.

Speaker: We're going to restore the use value of education.

Speaker: That's not our hope.

Speaker: At least it's not my hope.

Speaker: My hope is that we will just make visible the water in which we swim.

Speaker: That's my hope.

Speaker: Let's start with the bad news, is how the conclusion to my guest's book about changing grading practice begins.

Speaker: No one is coming to save us.

Speaker: No consultant is going to sweep through and fix things for a fee.

Speaker: No new technology, digital, online, or otherwise, is going to change the game.

Speaker: The game, of course, is school, and the currency of that game is grades.

Speaker: Jack Schneider is Dwight W. Allen, distinguished professor in the College of Education at UMass Amherst.

Speaker: He's the executive director of the Beyond Test Scores Project, director of the Center for Education Policy, co-editor of the History of Education Quarterly, and co-host of the Have You Heard podcast.

Speaker: Ethan Hutt is the Gary Stuck Faculty Scholar in Education and Associate Professor at the UNC Chapel Hill School of Education.

Speaker: Their 2023 book, Off the Mark, How Grades, Ratings, and Rankings Undermine Learning But Don't Have To, is a thorough and at times frustratingly pragmatic exploration of the flawed necessity of the load-bearing pillars of real school.

Speaker: Grades, transcripts, and standardized tests.

Speaker: Their origins in our nation's history.

Speaker: The distorting effects they tend to have on the outcomes and goals of education.

Speaker: Why nothing has arisen so far to replace them at scale.

Speaker: And why there are no magic potions.

Speaker: No one is going to wake up one morning and realize that the answer was staring us in the face all along, they remind us.

Speaker: Balancing the real with the ideal, they also chart a path toward the possibility for something different.

Speaker: And like the grand experiment of public schooling itself, it's something we'll have to figure out and build together.

Speaker: Jack and Ethan, thank you so much for taking the time to be with me today.

Speaker: Yeah, thanks for having us.

Speaker: Yeah, that was an amazing introduction.

Speaker: I think we're going to have to transcribe that and use it ourselves, yeah.

Speaker: So I figured we would just start right away with that bad news part.

Speaker: Let's start at the end, right?

Speaker: Tear the bandage off right away.

Speaker: Because if I understand the book correctly, we won't be getting rid of grades, transcripts, and standardized tests for public schools at scale anytime soon.

Speaker: So why the heck not?

Speaker: So let's start there.

Speaker: Yeah, it's a really good question.

Speaker: And one of the things that I continue to joke about when we're doing interviews about the book is the fact that we probably could have sold a lot more books if we had said something different.

Speaker: If we had said, you know, all you need to do is follow the Hutt-Schneider four-step plan for weaning yourself off of grades, tests, and transcripts.

Speaker: The problem is that

Speaker: they are so baked into not only the infrastructure of schooling and education and credentialism, but also to the culture of schooling and American life.

Speaker: So let's start with the latter of those two.

Speaker: If you dropped your kid off at a school that didn't give grades, what are the odds that you would say, this is fantastic.

Speaker: I love that the school is going to focus on

Speaker: intrinsic motivation rather than extrinsic motivation or any of the other positive things you might say about that, right?

Speaker: I think most of us would say, well, how is my kid going to get into college then if there are no grades, right?

Speaker: If you dropped your child off at a school that had no transcripts, right?

Speaker: Let's imagine it's a college or university, right?

Speaker: Your child has already successfully passed that hurdle.

Speaker: You would likely wonder, well, how is my kid going to be motivated to work hard, knowing that he or she or they, they're now 18 years old, living on their own, and there is nothing holding them accountable for making good on tuition payments there.

Speaker: So there's the cultural piece that we need to deal with, which is reinforced by the fact that we've all been through school ourselves.

Speaker: So this isn't just about the culture of the present and the ways that we use grades, tests and transcripts in our lives.

Speaker: It's also about the fact that we have expectations about what a real school is and does.

Speaker: And then there's the infrastructural piece, which is that there are all kinds of decisions that are being made all the time on the basis of test results, grades, course titles, right?

Speaker: That's a feature of transcripts that we often ignore.

Speaker: We often think of transcripts merely as places where grades and test scores reside forever permanently, but

Speaker: There are also places where course titles live that that offers an additional venue for students to game these metrics.

Speaker: And that's something that I'm sure we'll get into in this conversation.

Speaker: But that infrastructure would be very hard to totally upend when we're talking about 13,000 school districts, 98,000 public schools, never mind, you know,

Speaker: 20,000 or so 30,000 private schools that we could add into the mix, and 1000s of colleges and universities.

Speaker: So it's a major, major undertaking to do anything.

Speaker: And I think what we're trying to do in this book is convince people this is this is worth our time and energies.

Speaker: one of the things that we try to do as historians of education is try to understand, like, where did these practices come from?

Speaker: And what Jack is talking about, both the cultural piece and the idea that it really holds our system together, the idea that we use common metrics, the idea that we have a common way of presenting the work of school, and that works not just for parents of students, but also future audiences of those transcripts, so colleges, employers, that

Speaker: All of these things, and we often in the book talk about grades, tests, and transcripts as technologies, because that's what they are, that these technologies were invented for a particular purpose.

Speaker: And those purposes endure in our system.

Speaker: So we need to communicate, we need to motivate, we need to synchronize our system.

Speaker: And so as much as we would love to sell more books and just be like, well, to hell with grades,

Speaker: you're removing a core function of the system and you should expect that the system is going to respond.

Speaker: And so we'll, I'm sure, talk about it, but it's not that people have had no ideas about alternative ways, but it's whether those ideas can actually fulfill the purposes for which we first invented these things.

Speaker: And so part of the conversation in the book and one that we're hoping to have with educators around the country is,

Speaker: OK, let's think about those purposes.

Speaker: Let's think about what our technologies are doing.

Speaker: And maybe it's time to take advantage of new technologies to update some of our practices.

Speaker: But you're never going to get away from those sort of core functions that grades, test scores and transcripts perform.

Speaker: And if you if you pretend otherwise, you're just you're just selling something.

Speaker: Yeah, I think you all said it very well in the book over and over again, that schools, you know, the American education system, as much as it might be anathema now to kind of say this, but they're inherently conservative institutions that resist, you know, these kinds of radical changes.

Speaker: And we'll get to, I think, the solutions that you all offer, but really reducing the

Speaker: the potential for both top-down and the bottom-up reforms back to those first principles and really seeing how can we change it to help meet communication, meet the need for synchronization, and meet those other needs that grades, transcripts, test scores.

Speaker: help communicate really does chart a very clear path forward.

Speaker: But I think before we get to that forward path, let's actually look back to perhaps the origins of the book.

Speaker: You wrote in the introduction that the project started before COVID.

Speaker: I don't know if that was 2019 or just early 2020, but

Speaker: COVID for all of its horribleness did provide a kind of case study for how the education system responds to these drastic, dramatic changes.

Speaker: And perhaps we can talk about more of what we saw in that, but I just wanna know too, what led you both to start collaborating on this topic, on this project, the stuff that eventually became off the mark?

Speaker: Well, we're looking at you.

Speaker: The project started, I think,

Speaker: Way back when we were in graduate school together, Ethan and I shared a dismal basement office with each other.

Speaker: And, you know, to bring people really behind the curtain, this office was so bad that if you sat at Ethan's desk and your office mate was not sitting at his desk, that the light sensor that needed to sense movement from you in order to provide illumination,

Speaker: would not register that anybody was in the office.

Speaker: So I would often come back to our office and Ethan would be quietly working in the dark.

Speaker: But we have been friends and collaborators for, gosh, at this point, you know, 15 years, maybe closer to 20 years.

Speaker: And

Speaker: One of the things that we're both really interested in, and I'll defer to Ethan for a more detailed description here because he tends to be more precise in the way he talks about this stuff than I am.

Speaker: But one of the things that we're both really interested in

Speaker: is the way that behavior and action is shaped by things like rules and measurement and systems that are often based on really thin information right i just speaking only for myself here we are such interesting complex thoughtful capable life forms and yet we pin ourselves in

Speaker: with these very thin rules that are not able to capture the thickness of life or the richness of what we can work through in terms of human deliberation.

Speaker: And for me,

Speaker: That irony, and it's a kind of tragic irony, is really interesting.

Speaker: And we could look at it anywhere.

Speaker: But I think it's most interesting and sometimes most tragic in education because we do it at such large scale.

Speaker: And we do it for what we think is the best interests of 50 million young people who are in the schools.

Speaker: Yeah, I was just I mean, we've always I think Jack and I have always shared an interest.

Speaker: We had a mutual mentor in David Tyak, who always talked about the important part of the grammar of schooling.

Speaker: So those things in the school that we take for granted and they're just, you know, when Jack was talking earlier about like when you show up at a school, how do you know it's a school?

Speaker: You know, all those things.

Speaker: that's part of the grammar of schooling.

Speaker: It's what we expect.

Speaker: It's how we communicate about education systems.

Speaker: And I think we've always shared an interest in kind of thinking about, okay, the pieces of that grammar and where they came from and what they do.

Speaker: And I've had in my work, both with Jack and without

Speaker: is a particular interest in how we communicate about the work of schools to the public.

Speaker: So, you know, whether it's test scores and grades.

Speaker: And so one of the interesting things about these technologies, these assessment technologies, is that they have multiple audiences and those audiences have expanded in scope over time.

Speaker: And so thinking about how

Speaker: these practices have evolved has always just been really fascinating to me.

Speaker: And just, you know, we, we wrote a piece, our very first, I think, collaboration together, I think it was in 2014.

Speaker: We, we first wrote about the grading system and, you know, we just kept coming back to those kinds of, of questions.

Speaker: And then obviously, you know, we've,

Speaker: all experienced together, no child left behind, which added another layer of this sort of communication.

Speaker: So thinking about those practices and again, coming from them, as you said, like from a place of like there's preserved wisdom in some of these inherited practices doesn't mean they're perfect and can't be improved.

Speaker: But I think especially when you look at the history of school reform,

Speaker: Too often we have reformers who are like, I know better.

Speaker: The teachers don't.

Speaker: Everything is broken.

Speaker: Let's throw it out.

Speaker: And, you know, my sister is a second grade teacher.

Speaker: My mom was a teacher.

Speaker: When you talk to teachers, they have a lot of understanding and knowledge about the system.

Speaker: And so this idea that schools are conservative or that reform should approach things in a conservative way.

Speaker: What we're talking about a lot of times is preserving the system.

Speaker: both the shared experience of folks, but also the knowledge when teachers look at a lot of reforms, they go, that's not going to work.

Speaker: You can make me try to do this, or maybe I will just not do it, but it's not going to work.

Speaker: And so thinking and treating the system with care rather than just taking a wrecking ball to it, which may speak to our kind of like our deeper, you know, let's burn it all down.

Speaker: But practically speaking, those reforms are not built to last, no.

Speaker: That's what I think I mentioned in the intro, right, was that frustrating pragmatism as someone who kind of considers them, you know, myself as a when I was in the classroom practicing grades, really leaning into ways that I can diminish, you know, the salience, the importance of grades and grading, really changing reporting practices in my own practice.

Speaker: And now, you know, working at that big systems level to try and say, how can we

Speaker: improve the system both for students, but also make it workable for teachers and community and parents alike.

Speaker: Like trying to triangulate all of those needs can't be done simply by changing one part of that equation, right?

Speaker: You have to get all of those folks at the table and ask what is going to work to meet the needs of everybody.

Speaker: And really, you know, primarily the work that we that my organization does is focus groups with kids, with community members.

Speaker: And when you actually sit those two groups down and look at what they say about the changes they want the system to be, kids and parents predominantly like agree on the ways in which that system could change.

Speaker: So there's a lot more, I think, collaboration there than, again, leaders who are kind of at the top of the system trying to

Speaker: move those top-down reforms without getting buy-in from teachers or teachers not getting buy-in from students or schools not getting buy-in from parents, right?

Speaker: We've kind of lost that community aspect to it.

Speaker: I really want to know then in the process of researching

Speaker: And writing the book, which sounds like it'd been going on for basically, this is the culmination of a decade of work on this, a 15-year collaboration.

Speaker: What about that process of research and writing this book, either challenged, affirmed, or changed your perspectives on grades, transcripts, testing, any one of those kinds of concepts that you guys look at?

Speaker: So it's interesting.

Speaker: I mean, there's so much that you learn.

Speaker: I think the very first thing that I learned was, you know, is sort of where you started, where, you know, you kind of are led to believe, you know, when you enter like, oh, American public education is bad.

Speaker: And, you know, Finland has the answer and Germany has the answer.

Speaker: And, you know, Korea has the answer and the Soviets have the answer.

Speaker: And like the very first thing you sort of realize as you look at other practices, and especially if you take seriously the idea that,

Speaker: you know, it's that there's a cultural development element to these practices that there's no secret sauce.

Speaker: And I mean, it's like you can you can take some exotic, you know, practice.

Speaker: It's like taking a plant out of like, you know, the rainforest and then moving it to like the desert of L.A.

Speaker: It's like it's like there's so much that goes into these.

Speaker: It's not a it's not a technical problem in the sense of like, oh, you just you just grab something off the shelf or grab some secret practice.

Speaker: I've spent time abroad and I figured this out.

Speaker: And once you sort of give up the idea that there is some holy grail out there of practices, and as you say, focus on like the sort of human element, like what are the problems that these folks were trying to solve over time?

Speaker: You know, you just realize how embedded they are.

Speaker: Like one of the things that never really had occurred to me.

Speaker: in a real concrete sense until I got into it was like how there really is historically a real symbiotic relationship between this idea of local control, the idea that we want communities to be able to make decisions for themselves and have flexibility in talking about what practices make sense, what courses make sense, what trajectory for our students makes sense.

Speaker: And this need, because we live in a very large country that has a decentralized system, and I think most of us like on a regular basis like that, that we have a school board and we have teachers that have flexibility.

Speaker: that that almost requires somewhere in the system some standardization, some points of synchronization, as we call it in the book, that allows people to move from that decentralized local practice to some higher level.

Speaker: And you see this with transcripts and this idea that we need a common currency to record like, well, how much learning is learning?

Speaker: We need a unit.

Speaker: And we give time, you know, pride of place there.

Speaker: But same with, you know, things like the SAT.

Speaker: I've done work on the GED.

Speaker: Like having these tests that kind of sit on top and allow for flex in the system, those practices come together.

Speaker: So we often talk about standardized tests and grades as separate.

Speaker: And one of the things that we really liked about the book, because we had done that in our own writing, having them separate, was putting them together and actually say like,

Speaker: You can mess with these, but often the other one is picking up the slack.

Speaker: So if you want to get rid of the SAT, you're putting more weight on grades.

Speaker: And if you want to get rid of grades, like some countries do, no one looks at transcripts, you're going to put all the weight on a test.

Speaker: So thinking about how these are actually sort of in conversation, they're linked in the system, was one of the big revelations is that we have to think about these as a whole system set of practices.

Speaker: and not just like tinker with one practice or the other.

Speaker: Yeah, Ethan got into this in his response there.

Speaker: But one of the things that I learned from him along the way was to be a cold-hearted realist about this and not just be a dreamer.

Speaker: I am a former classroom teacher.

Speaker: And I think it is my inclination to try to take big swings at things.

Speaker: And I think had I tried to write this book,

Speaker: or do any of this work.

Speaker: without Ethan, I might have verged into, you know, not snake oil sales, but, you know, I think dreaminess, right?

Speaker: Like, I'm good at identifying all of the problems that exist.

Speaker: I can just rattle off all of the ways that grades distort motivation and undermine the kind of communication that educators have

Speaker: in their hearts want to do with young people.

Speaker: I can tell you all of the ways that standardized testing, whether it is run by the state or an external entity like the college board, is designed in a manner that fails to incentivize real authentic learning, undermines the practices of educators that are responsive to the real needs of young people.

Speaker: I can go on this all day, but

Speaker: What I don't naturally do is think about the usefulness of things like standardized tests or the ways in which grades actually do serve a real important purpose, including for equity, which is often a critique that I will level against grades, but

Speaker: You know, one of the things that I learned from Ethan in doing this project was that a grade has just enough vagueness to it, right?

Speaker: That it can allow for important kinds of slippage.

Speaker: And what I mean by that is that we take for granted that a course title has a particular meaning.

Speaker: and that a grade in that course has a particular meaning.

Speaker: And that allows for formal equity in our educational system in a way that I think it is hard to imagine existing if we said, well, let's allow people to just use their own judgment with no formal guidance, no restrictions, no rules here in interpreting.

Speaker: what it means that a student in a high poverty community from a historically marginalized group took a particular math course and has a particular kind of recommendation from their teacher, right?

Speaker: And so although I, earlier in our conversation,

Speaker: you know, made a little speech about, you know, the thinness of information and the way we pin ourselves in with rules.

Speaker: You know, I think I'm speaking to my, my natural interests there.

Speaker: But one of the things that I learned in this project is rules also at the same time are really important.

Speaker: And so one of the things that I think we do in this book is try to help people think in clear ways.

Speaker: Like we have a lot of faith in educators and in families and some faith in policymakers, but to try to structure for them a way of thinking through when are rules useful, right?

Speaker: When is data productive, right?

Speaker: When are these kinds of assessment technologies really important?

Speaker: And then where do we need to really blur the edges?

Speaker: Where do we need to remove some of the rules?

Speaker: Where do we need to pull the guardrails a bit wider?

Speaker: I will say it was definitely interesting to read because I felt that tension, that push and pull between, you know, that pragmatic realism and then that, but that, that, the pull of the, the push of the idealism there too.

Speaker: And I think as an idealist or as a dreamer, you know, myself, I, I found myself having to sit in that tension, right.

Speaker: And, and grapple with that reality of it.

Speaker: And,

Speaker: Again, I appreciated how the book just brings it back to the first principles, to the history of how these practices even emerged and just...

Speaker: kind of distilled them down into their most component parts to say, look, we can kind of change within this range of options here to diminish distortions or to increase equity.

Speaker: And basically we can fiddle with the sliders, but these three ideas have emerged to serve a particular role.

Speaker: And I think kind of shifting the conversation perhaps towards those potential solutions where you guys found them, either internationally,

Speaker: There's a whole section in the book where you spoke with international teachers abroad and spoiler alert for anyone out there.

Speaker: Right.

Speaker: They didn't find magic potions out there either in any country that they talked about.

Speaker: But what you know, what does the successful reform of these practices, be they grades or transcripts or the standardized testing components?

Speaker: What does that look like in your view?

Speaker: Like what examples did you find abroad, here at home, contemporary ones in the mastery transcript or historical examples that you pulled?

Speaker: You guys draw from such a wide well of disciplinary knowledge, right?

Speaker: And then how do we realign the goals of grading, assessment, and reporting with the goals of learning?

Speaker: So I'll give my favorite one.

Speaker: And then Jack, I know has a different favorite one from the book.

Speaker: So, and first I'll say, any idealists out there who just need someone to ruin their day, I'm happy to get on the phone and just tell you, I've often joked that I should just start a consulting firm that's just called, dude, that's not gonna work.

Speaker: And I'll just explain to you

Speaker: Why is it not going to work?

Speaker: And you can take it early.

Speaker: Please don't listen to me.

Speaker: That's no fun.

Speaker: What's nice about writing with someone who has a little bit of a different temperament is like you do get that push and pull.

Speaker: And I am glad that it came out in the book as being a real conversation between the two of us.

Speaker: And we've had people say, so which sections did you write and which section?

Speaker: And it's like, no, it's really interwoven in that way.

Speaker: So I'm glad it comes to you.

Speaker: So I'll give a good example of something that it feels like

Speaker: the history of the practice helps inform, you know, kind of a new way of thinking about it that recognizes the value and recognizes the the the challenge, but actually moves us forward.

Speaker: So, you know, historically, if we think about a transcript,

Speaker: there were very concrete, practical, physical reasons why you needed a transcript to be short.

Speaker: It needed to have, it needed to distill all the richness of an education to a single sheet of paper because in the world before computers, like those transcripts were housed in physical spaces, in filing cabinets,

Speaker: And you needed the school to keep that for a very long time.

Speaker: So there's a real physical space reason why it made sense for schools to try to distill and have a real economy of communication, economy of record keeping around student transcripts and student, you know, student performance.

Speaker: But those space constraints don't really apply anymore.

Speaker: I mean, my transcript takes up a few bytes of space on a computer that basically has, with the cloud, infinite space.

Speaker: So one of the ideas that we talk about is that if one of the challenges of the transcript is that the information is so thin, I can bug Jack to give me a slightly higher grade, and he can record an A instead of an A minus, or let's be honest, an A minus instead of a B plus, then

Speaker: we can, you know, then I know that, you know, mission accomplished.

Speaker: No one's ever going to see that essay and no one is ever going to be able to decide whether my final project was or wasn't an A minus or B plus or whatever.

Speaker: It's like once it's on the transcript, like that's the end of the game.

Speaker: But

Speaker: And for reasons like I explained, like the lack of space means that there's no work behind that grade.

Speaker: And so one of the things we talk about in the book, one of the things that seems very within reach is if we made transcripts what we call double clickable.

Speaker: So if you could, for instance, not only deliver your transcript, but behind the grade of that transcript existed any amount of work that reflected the work behind that grade,

Speaker: We argue, and I think it feels right to me, that that helps focus the learner and the whole enterprise of education around what is the learning that is associated with that grade.

Speaker: By reattaching the work and the work product to the grade that sits on the transcript, you allow people to focus on not just the letter, but what's actually learned.

Speaker: And you can tell someone, a student, say, look,

Speaker: these are not going to be detached forever.

Speaker: Like someone's going to look and you should actually want them to look because then they can see all the things that you did and all the things that you accomplished.

Speaker: And maybe they even see the whole process of your accomplishment.

Speaker: So by making a transcript, by thinking about like, okay, the limitations no longer apply, we can recenter learning.

Speaker: We can recenter the actual product of learning rather than just have students motivated by that, by that letter on that transcript.

Speaker: Yeah, Ethan allowed me to go with my favorite here.

Speaker: So I am really enamored by the idea of an overwritable grade.

Speaker: So I'll start with the buzz phrase there, where we are referring to basically the digital capacity to replace old information with new information.

Speaker: And I'll back into an explanation of how we arrived at that as a possible way of tinkering towards reform.

Speaker: So one of the things that we talk about in the book is the fact that these assessment technologies arose to serve different purposes.

Speaker: And those purposes can be sort of shorthand conveyed as the purpose of communication.

Speaker: And there are actually two distances of communication that we talk about in the book, a short-haul communication, an educator trying to communicate with a student and or their family, and a long-haul communication,

Speaker: So the school, the educator, and sometimes even the student themselves having an interest in this, communicating with distances, blah.

Speaker: And long haul communication where an educator or sometimes the students themselves have an interest in communicating with audiences at a distance that is either geographic or temporal, right?

Speaker: Communicating with people who are really far away or who are in the future.

Speaker: So that's communication.

Speaker: Then there's also motivation.

Speaker: That one's pretty obvious, right?

Speaker: The use of assessment technologies as a way to try to get young people to work hard and show up.

Speaker: And we'll just name the fact that, you know, we have compulsory education laws for a reason, right?

Speaker: There are lots of other things to do in this life than go to school.

Speaker: and then third is synchronization to try to stitch together the component parts of a very large cumbersome and mostly decentralized system well let's just talk about the communication function that grades served in their origin right they were serving a short-haul communication function they really were an effort to communicate in shorthand

Speaker: with students' families.

Speaker: And that was related to motivation very much, right?

Speaker: Because the idea was maybe we can get these young people to work a little harder if their families know that they aren't applying themselves in school.

Speaker: And maybe we can get them to continue to work hard if their families praise them for all the good work that they're doing.

Speaker: So these purposes aren't always necessarily disconnected from each other, although they do often work across purposes.

Speaker: And so let's just consider how the fact that grades over time, so as we move from the early to mid

Speaker: 19th century into the 20th century and into the mid 20th century, we can see the grades are increasingly being used by the time we arrive at the mid 20th century as a way of communicating with much more distant audiences, right?

Speaker: By the mid 20th century, high school enrollment is pretty close to universal.

Speaker: we are moving closer to universal high school graduation.

Speaker: We still aren't there yet.

Speaker: We may never arrive there, right?

Speaker: But we get close enough that we get far more students attending college as a way of trying to distinguish themselves.

Speaker: And we see very real labor market benefits for students who get high school diplomas, who have good grades as a result of hard work.

Speaker: in high school and who go to college, right?

Speaker: And very real labor market returns for students who graduate from college and get good grades.

Speaker: And so we can see that students develop this very real interest in getting good grades in order to reap the rewards of what is essentially a credentials market there.

Speaker: We've got two different forms of communication there.

Speaker: And if we think about the ways that they are not really designed to work together, we can begin to see problems.

Speaker: So the idea that grades were originally intended to serve a short-haul communication function and then eventually get used to serve this long-haul communication function leads to a problem where educators will often want to say, hey, you don't get this.

Speaker: right?

Speaker: I'm trying to communicate to you with this grade that you do not fully understand this material.

Speaker: And I would actually like your family to know this because lo and behold, families care about the young people who live with them and want the best for them and often can intervene.

Speaker: And we could have a whole separate conversation about how we end up in this country, mostly offshoring the responsibility of giving extra assistance to families and the free market rather than doing it systematically.

Speaker: which is something that grades could actually serve a useful function in.

Speaker: But we can see that if you're trying to send this message to students and their families, hey, you don't get it, you're also doing something at the exact same time, which is ruining that student's future, right?

Speaker: That's how the student is going to interpret it.

Speaker: is, hey, you thought that you were sending me a message by giving me a C in algebra, but do you know what you actually did?

Speaker: You actually put a black mark on my record.

Speaker: And this can be not just a problem for ambitious students who want to get into highly selective colleges and universities, who want to have pristine transcripts, you know, and have more than a 4.0 grade point average.

Speaker: This can be devastating when we're talking about students for whom school isn't a natural fit, for whom there are headwinds rather than tailwinds.

Speaker: These black marks on their records pile up.

Speaker: And if the incentive is, hey, go to school and work hard because that's going to open up social and economic opportunities for you.

Speaker: Well, if they see, hey, listen, I've already got a bad enough academic record that I'm not going to benefit from this, right?

Speaker: Then that further undermines the motivation of those students.

Speaker: So that's a long wind up to a way of dealing with this problem, which is to say, well, if you made it possible to overwrite the student's grade once the student gained the relevant knowledge or skill,

Speaker: You could actually have it both ways.

Speaker: You could actually communicate to the student and their family, hey, you don't get it right now, right?

Speaker: Right now, you've got a C in algebra or geometry or English literature or physical education, right?

Speaker: You've got a C.

Speaker: But that's not where this story needs to end.

Speaker: And the example that I always give, right, Ethan's going to get sick of this example, is that none of us knew how to ride a bike once upon a time.

Speaker: Nobody came out of the womb on a bicycle, as far as I know, right?

Speaker: But if we had been graded,

Speaker: at the point in time where somebody had arbitrarily said, let's see if you can do it, many of us would have failed.

Speaker: And we would have had to carry around on our transcripts an F in bike riding, despite the fact that the vast majority of us later learned that skill, right?

Speaker: Why carry around outdated information?

Speaker: Maybe you did fail algebra, and maybe you then learned that skill.

Speaker: Why carry the F forever on a transcript instead of being able to overwrite that information

Speaker: with more accurate information that actually is going to better serve the purpose of communicating to future audiences what you know and can do.

Speaker: And I think that's another thing that I appreciated about the book was in the sense that you explore historical examples of narrative reports and of portfolio systems and all of these other kind of one size fits all replacements, right?

Speaker: That were meant to replace, upend a revolution in grading, testing, reporting, and all these things.

Speaker: And really, I think a message that I took away from the book was certainly that

Speaker: you know, these hybrid models where we're kind of Frankensteining together, the best purposes of every kind of system are going to be the things that are ultimately going to make any successful grading, reporting, testing reform work in the long run is not trying to replace one, the flaws of one, one size fits all with the flaws of another one size fits all, but really trying to take the good where we can find it and

Speaker: wherever that might come from.

Speaker: And again, that that's not a huge appeal to my dreamer idealism, but gosh, that makes a lot of pragmatic sense as somebody who has to work within the system, who has kids in the system, too, who has to attend to systemic coherence.

Speaker: So, again, I appreciated that long view, both historically and then, you know, in terms of depth of our system and the need to communicate from K-12 and beyond to employers to to the whole nine yards.

Speaker: I think then one thing kind of wrapping up the conversation here is just to get from both of you kind of a sense of what do you think is really missing in the public conversation around grades, transcripts, testing, the focus of the book and everything.

Speaker: What would be your goal about how we can speak about these things differently or how we can enrich the public conversation?

Speaker: Short of buying your book, of course, but then how can we speak to people differently about these distortions and the problems and the benefits and the equity and the need to communicate?

Speaker: I'm going to beat Ethan to the buzzer here just so I can respond to the thing that I think we both want to respond to before the question, which was your comment there.

Speaker: And both of us owe a debt of gratitude to David Tyak and Larry Cuban because totally embedded.

Speaker: in the way that you were just describing our project are some ideas that entirely come from them.

Speaker: And this idea of Frankensteining or hybridizing, that's a Tayac and Cuban idea.

Speaker: And the idea that we can't just wash away the past, that

Speaker: Every layer of educational policy, every layer of the culture of schooling builds upon the previous layers.

Speaker: That's a Tayek and Cuban idea.

Speaker: And even our dedication of the book, the book is dedicated to our students, is a ripoff of David and Larry.

Speaker: which is not to say that the rest of the book is, but we would encourage people to read side by side our book with Tinkering Toward Utopia by David and Larry.

Speaker: So now I'll actually answer the question and try not to be so long-winded and then kick it over to Ethan.

Speaker: But

Speaker: I think my great hope for this book is not that people will read it and say, great, look, we're going to go with double clickable transcripts.

Speaker: We're going to go with overwritable grades.

Speaker: We're going to restore the use value of education.

Speaker: That's not our hope.

Speaker: At least it's not my hope.

Speaker: My hope is that we will just make visible the water in which we swim.

Speaker: That's my hope, because I know that I speak for both of us, that we have tremendous confidence in the three and a half million educators who are at work every day in this country.

Speaker: We have tremendous confidence in the ability of the 50 million students who are in our public schools to speak up for themselves, including in the kind of work that you guys do.

Speaker: And we have a lot of faith in families who really want the best for young people.

Speaker: But

Speaker: But we inhabit an educational policy space and an educational culture that makes invisible practices that are totally ordinary to us.

Speaker: Not ordinary because they don't have any negative unintended consequences or don't matter, but ordinary because we completely expect them.

Speaker: We talked earlier about quote unquote real school and the grammar of schooling.

Speaker: It would be odd to us if we didn't see grades, tests, and transcripts.

Speaker: And in fact, we totally expect the unintended consequences as well.

Speaker: We say things like, well, tests are just a part of life.

Speaker: Or we will say out of one side of our mouths, hey, you should be really focused on learning this material.

Speaker: This material really matters.

Speaker: And then out of the other sides of our mouths, we'll say things like, hey, you have to get a better grade in this course.

Speaker: You don't want to have this on your transcript.

Speaker: And so what what my big hope is, is that people will read this book and think about grades, tests and transcripts not as ordinary features of real schools, but as technologies that we continue to choose to use often inappropriately every single day in school, 180 days a year.

Speaker: for all 13 years of the K through 12 experience and then into higher ed for students who go to four or, you know, in our case, you know, 10 more years after that.

Speaker: So if we can see what is presently invisible to us, then we can talk about it.

Speaker: And if we can talk about it, then we can act.

Speaker: Yeah, I'm going to just echo.

Speaker: I mean, I, the single, I'm not an ideas person.

Speaker: I'm a, I'm a, I'm a grumpy person.

Speaker: I'm not going to work, but I do, I do think that it strikes me when, when I listen to people, um,

Speaker: like struggle against our grading system.

Speaker: And they, you know, we saw this in the pandemic where lots of things were disrupted and people were having really difficult conversations in the public about what was fair and what was possible and what would happen and the long-term consequences.

Speaker: And could we set this aside and should we just give everyone an A and what would happen?

Speaker: Like,

Speaker: It struck me as that what we lacked was a real common language for having these conversations.

Speaker: And so, you know, especially I think the project started before the pandemic.

Speaker: But what the pandemic, I think, really added to the book was really it foregrounded for me and Jack that we needed to give people one of the best things we could do is give people a language to talk about.

Speaker: all of these different functions that grades serve.

Speaker: And then they're underlying, like where they come from in the system.

Speaker: And once we provided that, and if you look at the last chapter, it's, we really imagined the last chapter being like, we, we thought like, well, maybe my sister and her colleagues, um, uh, it,

Speaker: you know, would sit down with the book and say, OK, let's think about our practices.

Speaker: And now that we have this language, maybe we can talk about, OK, what about this and what about this?

Speaker: Because we really do believe in the strength of a plural approach to learning and that there isn't a one size fits all.

Speaker: And so providing a language that people could be on the same page and talking about it, but arrive at different conclusions about what makes sense for them and their students or their communities.

Speaker: That to me was the big step that we can take forward because I will not.

Speaker: I mean, we have solutions.

Speaker: We pitch some to your listeners.

Speaker: But it would be totally fine with me if everyone decided that those were bad ideas.

Speaker: If they said, OK, actually, what we need is not the double clickable.

Speaker: What we need is...

Speaker: this and this and we can serve those functions.

Speaker: So providing some clarity and hopefully the history kind of comes through and people can see why we got to where we were.

Speaker: It wasn't just bad actors.

Speaker: It wasn't just random.

Speaker: It wasn't just some like factory model that someone, you know, these are these are learned things that have accreted over time.

Speaker: So that's the big thing that I hope people will take from the book, whether they like our solutions or not.

Speaker: And that's the whole thing I hope that will endure and sort of animate or help illuminate conversations in the future.

Speaker: Right.

Speaker: None of these systems fell from the sky in a single piece to be implemented as is, right?

Speaker: They're the result of, you know, that both the social construction, the historical construction, but I think to emphasize that construction part recognizes how it's situated in the past and in a collective reality, but also kind of recognizes the potential and possibility that, hey, we can do something different to help meet our needs and the needs of our kids here in the present or perhaps in

Speaker: in the future too.

Speaker: So again, I just, I really appreciate that, that, that balance of that realism, that idealism, that, that, that pragmatism, I think for me was, it was a huge appeal of the book.

Speaker: So the book of course is off the mark, how grades, ratings, and rankings undermine learning, but don't have to from Jack and Ethan.

Speaker: Thank you guys both so much for joining me today.

Speaker: Thank you for having us.

Speaker: Yeah.

Speaker: Thanks for having us.

Speaker: This was fun.

Speaker: Thank you again for listening to our podcast at Human Restoration Project.

Speaker: I hope this conversation leaves you inspired and ready to start making change.

Speaker: If you enjoyed listening, please consider leaving us a review on your favorite podcast player.

Speaker: Plus, find a whole host of free resources, writings, and other podcasts all for free on our website, humanrestorationproject.org.

Speaker: Thank you.

Speaker

Speaker

Speaker

Speaker

Speaker

Speaker

Speaker

Speaker

Speaker

Speaker

Speaker

Speaker

Recommended