Become a Creator today!Start creating today - Share your story with the world!
Start for free
00:00:00
00:00:01
74: The Research on Assessment w/ Dr. Astrid Poorthuis
25 Plays5 years ago
Our podcast today features Dr. Astrid Poorthuis, an assistant professor at the developmental psychology program at Utrecht University, Netherlands, whose work focuses on performance, school, and its relationship to social/emotional learning. Dr. Poorthuis has researched and published a variety of works concerning grades, student/teacher emotional well-being, student/teacher relationships, and peer relationships.
Dr. Poorthuis and I talk about her research and its applications for the classroom, notably how ungrading and its benefits of engagement, well-being, and participation are backed by substantial amounts of research - referencing a variety of studies. It's incredibly interesting how universal these results are and the commonalities that US and Netherlands schools share. Attached in the show notes are the studies that Dr. Poorthuis has been involved with, as well as recommendations she makes during this episode.
GUESTS
Dr. Astrid Poorthuis, a leader in researching practices that demonstrate the importance and implementation of practices that bolster student social and emotional well-being, who serves as an assistant professor in the developmental psychology program at Utrecht University, Netherlands
RESOURCES
- Do grades shape students' school engagement? The psychological consequences of report card grades at the beginning of secondary school
- See me through my eyes: Adolescent–parent agreement in personality predicts later self-esteem development
- Dashed Hopes, Dashed Selves? A Sociometer Perspective on Self-esteem Change Across the Transition to Secondary School
- The Role of School in Adolescents’ Identity Development. A Literature Review
- Klapp: Does grading affect educational attainment? A longitudinal study
- Koenka et. al.: A meta-analysis on the impact of grades and comments on academic motivation and achievement: a case for written feedback
FURTHER LISTENING
Recommended
Transcript
Introduction and Sponsorship
00:00:03
Speaker
Hello!
00:00:03
Speaker
Before we get started, I wanted to let you know that this podcast is brought to you by Human Restoration Project's fantastic patrons.
00:00:09
Speaker
All of our work, which includes free resources, materials, and this podcast are available for free due to our Patreon supporters, three of whom are Dina Koretsky, Casey Nedry, and Shannon Schinkel.
00:00:20
Speaker
Thank you for your ongoing support.
00:00:22
Speaker
You can learn more about the Human Restoration Project on our website, humanrestorationproject.org, or find us on Twitter, Instagram, or Facebook.
Meet Dr. Astrid Portis: Social Emotional Learning
00:00:47
Speaker
Hello and welcome to Episode 74 of our podcast at Human Restoration Project.
00:00:51
Speaker
My name is Chris McNutt and I'm a high school digital media instructor from Ohio.
00:00:55
Speaker
Our podcast today features Dr. Astrid Portis, an assistant professor at the developmental psychology program at Utrecht University Netherlands, whose work focuses on performance, school, and his relationship to social emotional learning.
00:01:07
Speaker
Dr. Portis has researched and published a variety of works concerning grades, student teacher emotional well-being, student teacher relationships, and peer relationships.
How Do Grades Affect Student Engagement?
00:01:16
Speaker
Dr. Portis and I talk about her research and its applications to the classroom, notably how ungrading and its benefits of engagement, well-being, and participation are backed by substantial amounts of research, referencing a variety of studies.
00:01:27
Speaker
Attached in the show notes are the studies that Dr. Portis has been involved in, as well as recommendations that she makes during this episode.
00:01:37
Speaker
So my interests lie in what is the impact of grades that students receive, but also social dynamics in the school, in the classroom.
00:01:46
Speaker
How do they impact students' life and their well-being, the way they approach school, how engaged they are during classes.
00:01:56
Speaker
So the social-emotional aspects and not so much the cognitive or learning, the actual learning, but all that's surrounding that.
00:02:05
Speaker
Yeah, and I came across your work because I was reading some research that you had surrounding report cards and the effect that has on students and their well-being.
00:02:16
Speaker
Do you want to talk briefly about what you found?
00:02:19
Speaker
We studied a population that just transitioned into secondary school.
00:02:25
Speaker
And we know that this is a moment, we see that in the Netherlands, but also in the US, that student engagement declines.
00:02:33
Speaker
And I wondered, why is that?
00:02:35
Speaker
And could one factor be that there's so much more emphasis on grades that students receive?
00:02:42
Speaker
It's getting more important, grading is more strict.
00:02:46
Speaker
So this was the reason I started the investigation.
00:02:51
Speaker
And I looked at how students responded to their first report card in secondary school.
00:02:57
Speaker
And at least in the Netherlands, this is like important or significant events as students because card they receive, they take it home, parents look at it, so they get responses.
00:03:09
Speaker
And what we found is that the height of the grades impacted how they emotionally responded
The Case Against Grading Systems
00:03:16
Speaker
to those grades.
00:03:16
Speaker
So when they received higher grades, they would report more positive feelings, less negative feelings.
00:03:25
Speaker
And this in turn predicted how engaged they were in the class, so during classroom activities.
00:03:32
Speaker
And we saw that the higher the grades, the more positive the feelings and higher the school engagement.
00:03:39
Speaker
But you would hope as a teacher that when you give a low grade,
00:03:44
Speaker
that students may think, oh, I need to work harder.
00:03:47
Speaker
But I found the opposite.
00:03:48
Speaker
So I found that for students who receive lower grades on their first report card, they actually declined in their school engagement across the year.
00:03:58
Speaker
So I think this may be a sad negative spiral in motion.
00:04:03
Speaker
like that they get negative performance feedback, feel less engaged, less effort in their schoolwork, and this could then lead to lower, even lower performance.
00:04:15
Speaker
Yeah, this could be one of the mechanisms where you see that a certain subset of students get more and more disengaged from school or less engaged in classroom activities.
00:04:27
Speaker
And then in the end, maybe people will say, yeah, but he's not engaged at all.
00:04:31
Speaker
So it makes sense that he, yeah.
00:04:34
Speaker
So that's what we found.
00:04:36
Speaker
It's interesting because as you stated, it seems like when you then assign a low grade, it's not fulfilling any of the purpose that hypothetically it's supposed to do, which makes me question, well, then why give a grade at all?
00:04:54
Speaker
Because if it's only going to
00:04:56
Speaker
hurt rather than help because even then like I would imagine those students who were receiving high grades are probably terrified whenever they receive a low grade I mean I was that way when I was in school I was not an all-a student but if I got like a d I was floored like that was terrifying so what is your opinion based off of that research when it comes to assigning a grade at all
00:05:20
Speaker
So there's a lot of research showing that giving grades is detrimental for both motivation of students and performance.
00:05:31
Speaker
This is in experimental research, so classroom experiments, where they compared students who received a grade, a group of students who received a grade versus no feedback or a grade versus written comments.
00:05:45
Speaker
And over and over, this research shows that
00:05:48
Speaker
written comments where there's actually feedback where students can work with or they can improve their work, it's much better for their motivation, for their performance and grades.
00:06:04
Speaker
And there's also an interesting study in real life, a Swedish study, where they changed the school system.
00:06:14
Speaker
And this was, so half of the schools decided to stop giving grades and the other half didn't.
00:06:22
Speaker
And they compared the students, so those two groups of students over several years, and they found that those students who were in a non-graded primary school, so primary school where new grades were given, they would perform better in secondary school and had a higher chance of finishing secondary school.
00:06:42
Speaker
And this was especially pronounced for those students who were low ability.
00:06:47
Speaker
So again, those students you really want to keep in and you hope that they can improve.
00:06:55
Speaker
It helps them a lot if there are no grades given.
00:06:58
Speaker
And I think that builds into then the larger narrative of the research that you've done surrounding social emotional well-being.
The Role of Social-Emotional Skills in Schools
00:07:08
Speaker
I've been reading through like your various different studies.
00:07:11
Speaker
There's like narcissism and popularity and there's all these different things.
00:07:16
Speaker
If you were to talk to teachers about the research that you found surrounding social emotional well-being, what suggestions would you have for them to improve upon their practice and do better?
00:07:28
Speaker
With regard to performance, I think if a teacher has the possibility to reduce the number of grades that they give, I think that would be a good idea.
00:07:38
Speaker
And also separating feedback from grades, because we know from the literature that when you give an assignment back with a grade and with comments, that students won't process those comments.
00:07:53
Speaker
They will just focus on the grade because it's
00:07:55
Speaker
it impacts on their self and how they, on their ego and how they think about themselves.
00:08:01
Speaker
And they're so involved with that, that they don't even have the chance or the resources to really focus on the content of the comments.
00:08:12
Speaker
But I think also like creating a secure classroom where everybody, where there's not lots of competitiveness, but that people, our students are really focused on improving their own ability and their own performance and not so much comparing themselves.
00:08:35
Speaker
to others that really helps to be an inclusive classroom for everybody.
00:08:41
Speaker
Also, the students that are struggling more academically.
00:08:45
Speaker
So I think that's in many of the articles that I work at, the work that I've done over and over it.
00:08:53
Speaker
It's about being supportive.
00:08:55
Speaker
Also, the peer, so that the students within a classroom, that they are supportive to each other and not so much in competition.
00:09:05
Speaker
It really helps well-being, students' well-being in school.
00:09:11
Speaker
I would imagine that when we spend so much time focusing on the individual in this competitive nature of school, when our society is growing up and this next generation of people comes to power,
00:09:27
Speaker
you're going to see that manifest itself as this ultra-competitive, I don't care about other people, I just want to get ahead style of society where we kind of rationalize inequity or we rationalize that it's okay to beat others down or be better than others.
00:09:46
Speaker
Not in a friendly, competitive kind of way, but more of like a deadly kind of way, honestly.
00:09:51
Speaker
Also, I deserve it or the idea that you deserve it.
00:09:55
Speaker
I think that it's an important role for schools and for teachers, not only to focus on the content of what they want to teach, but also these kinds of socializing or being a citizen or being someone who contributes to the society and to the well-being of others.
Challenges of Changing Grading Systems
00:10:16
Speaker
And I think a classroom is a really good environment to practice that in a safe space where you can make mistakes or where you can say something wrong.
00:10:25
Speaker
Yeah, so this is something that teachers could really contribute to, especially in adolescence where students are also really trying to find their identity, like who they are, who they want to be, where they want to go, what's...
00:10:43
Speaker
something for them and what's not.
00:10:46
Speaker
Yeah, so it would be really nice if teachers have the opportunity to design their classes in such a way that students can also relate the content to those questions.
00:11:00
Speaker
Right, right.
00:11:01
Speaker
And it's kind of odd in a sense because I also read a lot of research and see researchers from like cognitive science
00:11:12
Speaker
Talk about and prop up the opposite, as in like we need grades to increase test scores.
00:11:19
Speaker
We need these competitive classrooms to because in a lab environment, students are showing increases, quote unquote, in their learning.
00:11:29
Speaker
I've seen like this movement of.
00:11:31
Speaker
research surrounding like a more, I guess, conservative or traditional view of education.
00:11:38
Speaker
I'm curious in the research world, do you see like a two different wings of people in the education sphere?
00:11:46
Speaker
I think if it's really the research focused on the effect of grades, that it's quite consistent, that the findings are that grades versus written comments, that it's clear that the written comments improve learning more than grades.
00:12:01
Speaker
But I can understand why it's really hard to change, because grades do have information in it that's not in the written comments, because they help select or...
00:12:15
Speaker
order students.
00:12:16
Speaker
You see who's the best, who's not.
00:12:20
Speaker
So it has a function in selection, for example, or also whether students get to a certain or fail or not.
00:12:30
Speaker
So, of course, it is important in school to see whether or to really focus on, do my students reach the goals that we have for them?
00:12:41
Speaker
And we also get a bit addicted to grades because they can be really rewarding as long as they're good grades.
00:12:50
Speaker
And students that are used to grades and usually get good grades,
00:12:55
Speaker
they will have the problems motivating themselves is suddenly in the same environment, the teacher says, from now on, I won't give any grades anymore.
00:13:06
Speaker
So it's really hard to change that if your environment where they're all over and where you get rewarded for good performance for years.
00:13:19
Speaker
So then it's really hard to suddenly say, okay, I won't...
Systemic Changes to Support Gradeless Education
00:13:23
Speaker
give grades anymore and then I'm sure the students will protest because they also got used to that especially when you receive a good grade it's also a reward so it feels good and you're happy and you work even harder
00:13:39
Speaker
Definitely true.
00:13:40
Speaker
Speaking as someone that has essentially a gradeless classroom, my students don't get a grade until the very end of the year.
00:13:47
Speaker
And it's like negotiated upon.
00:13:49
Speaker
The students who struggle the most are the students that traditionally would get all A's.
00:13:55
Speaker
It's not the students, you know, that are C, D. Those students tend to do really well, tend to end the year.
00:14:01
Speaker
I mean, barely anyone fails.
00:14:03
Speaker
A lot of it comes down to what I would call like deprogramming.
00:14:07
Speaker
like having a lot of discussions about basically what we're talking about right now, like being very transparent about what we're trying to do and what impact this has and ultimately convincing parents, guardians, and students that it isn't just something random that, you know, I want kids to feel good.
00:14:28
Speaker
There's legitimate studies that showcase why it's important.
00:14:33
Speaker
And also, even if you cared about the standardized test portion of it,
00:14:37
Speaker
As far as I know, not giving grades also helps with traditional academics.
00:14:42
Speaker
Like students actually do better on tests.
00:14:44
Speaker
It isn't just they feel better, which is, in my opinion, the most important thing.
00:14:48
Speaker
But they also do well academically.
00:14:50
Speaker
Yeah, I think that grades are not only used to signal performance, but sometimes also as a way to try to change the behavior of students.
00:15:02
Speaker
Like they will ask, is it for a grade?
00:15:05
Speaker
Will I receive a grade?
00:15:06
Speaker
And then only then they take it seriously or...
00:15:11
Speaker
I don't know about the US context, but in the Netherlands, sometimes teachers give a very low grade if someone cheated or... So that's more like a punishment, I would say.
00:15:24
Speaker
Grades are also something that a teacher can provide and gives the teacher a certain authority or... So it might also be hard to just let go of that.
00:15:37
Speaker
It gives you something to help you let the students behave the way that you want.
00:15:50
Speaker
I hope you're enjoying our podcast so far.
00:15:53
Speaker
If you like what you hear and want to dive deeper into progressive education, I highly encourage you to visit us at humanrestorationproject.org.
00:16:00
Speaker
There you'll find a range of free materials, research, writings, and more to help transform schools towards human-centered practices.
00:16:07
Speaker
Plus, you'll find ways to support us through donations, a Patreon subscription, and merchandise.
00:16:11
Speaker
We appreciate your support.
00:16:13
Speaker
Now back to the podcast.
00:16:18
Speaker
Something that you said made me think about this idea of it's all about systems.
00:16:23
Speaker
It's all about changing different systems, not necessarily about us walking into the room and saying, I'm not going to give grades anymore because it's not going to work.
Making Learning Relevant to Students
00:16:33
Speaker
As you just said, it doesn't work like that in practice because so many other systems are held up by the fact that we're giving grades.
00:16:41
Speaker
You brought up the fact that there's a power differential.
00:16:44
Speaker
If I stop giving grades, how am I going to, quote unquote, get students to learn?
00:16:50
Speaker
Because the only reason why they may or may not be doing my assignment is because it's for a grade.
00:16:55
Speaker
If the assignments are not rooted in a student's purpose or in something that matters to them or is meant to matter to them, they're not going to have any reason to go about doing it.
00:17:05
Speaker
In the same exact way that if it's not interesting or if you're using it as a disciplinary tool, as you said, does that mean I'm going to have students cheating left and right or doing weird stuff because I'm not giving them grades anymore?
00:17:19
Speaker
So there's a lot of other systems in terms of how we teach that have to change as well.
00:17:24
Speaker
Based off of your research with social emotional well-being, do you see linkages to practices beyond grades that improve how students act and feel and relate to the world around them?
00:17:41
Speaker
So I recently conducted a review study with two colleagues, Monique Verhoeven and Monique Vollmann, on how schools can contribute to the identity development of adolescents.
00:17:57
Speaker
And what particularly strike me from this review is it's really important to teach in a meaningful way.
00:18:08
Speaker
And with meaningful, I mean that students themselves can relate what they learn in your class to their own lives or to the life beyond the school.
How Can Teachers Foster Engagement?
00:18:19
Speaker
And I think if we would emphasize that, then we don't need grades or...
00:18:25
Speaker
Because it will induce their intrinsic motivation to want to know more because it will then be important for themselves.
00:18:35
Speaker
So, yeah, if we could develop assignments, et cetera, where they can also put in their own ideas or choice or related to things they know from out of school,
00:18:51
Speaker
And then I think adolescents will be really motivated to work on those assignments.
00:18:57
Speaker
I think we could also give them more control over their learning process.
00:19:01
Speaker
What do they want to learn?
00:19:03
Speaker
What are their own goals?
00:19:05
Speaker
um and and these things will will of course they will mean a a change in the school but you could also do that in your own classroom try to to start with that and you don't need a whole system change to to to do that in your your own classroom i think what you're saying makes perfect
00:19:27
Speaker
rational sense even when you don't look at it as a study i mean you could walk into any primary school and for the most part kids are asking questions they're super involved i think of myself when i was in elementary school i was like ready to go and learn about space and dinosaurs and you know stuff that kids do they would go to the library and they're excited and
00:19:50
Speaker
But by the time they get to secondary school, especially if they're getting near graduation, that is basically gone, I would say, for at least the majority of students.
00:20:02
Speaker
And part of that is just because there's a rebellious phase and things like that.
00:20:07
Speaker
But also, if you see students who are homeschooled or maybe grew up in more progressive environments,
00:20:14
Speaker
they seem like they're still actively exploring and figuring out what's going on because they're in the environment that allows them to do so and it was never really taken away from them.
00:20:25
Speaker
And all these things that you're bringing up are just, you know, they're different roadblocks that they've hit along the way where they've started to associate learning with boredom or with like hate or judgment even.
00:20:37
Speaker
It feels bad to learn.
00:20:40
Speaker
So as kind of a final point,
00:20:44
Speaker
How do you suggest teachers, assuming that their district or school is not actively doing this, not actively making these changes, how do you suggest that they in their classroom inch toward a more holistic or student-friendly environment?
00:21:03
Speaker
With regard to the assignments, you could wonder for each assignment, how could students relate this to their own life?
00:21:12
Speaker
Or you could even ask them to reflect on that.
00:21:16
Speaker
With regards to performance, reduce the number of grades to the minimum, I would say.
00:21:24
Speaker
And also, I think it's also important how you communicate about those grades.
00:21:30
Speaker
It helps if it's something private for the students, not called out loud in the classroom.
00:21:39
Speaker
If students receive a low grade, talk to them about why they think that this grade was lower than expected.
00:21:49
Speaker
Also, really communicate high expectations of that particular student so that they keep confidence that they can improve.
00:21:59
Speaker
next time.
00:22:00
Speaker
Focus also on the norms in the group.
00:22:03
Speaker
Like, is it cool to be disengaged?
00:22:07
Speaker
This is what we see.
00:22:09
Speaker
What I also see in my research that in some peer groups in adolescence, it's actually cool and you get more popular if you don't work for school.
00:22:19
Speaker
So it might be hard for a teacher to change that, but especially when a group is just formed.
00:22:25
Speaker
So in the first
00:22:26
Speaker
weeks, you can probably try to influence that.
00:22:31
Speaker
And you can communicate norms about how students respond to each other and whether they laugh or not when someone makes a mistake.
00:22:40
Speaker
You could certainly communicate norms.
00:22:44
Speaker
So that may help as well.
00:22:51
Speaker
Thank you again for listening to Human Restoration Projects podcast.
00:22:54
Speaker
I hope this conversation leaves you inspired and ready to push the progressive envelope of education.
00:22:58
Speaker
You can learn more about progressive education, support our cause, and stay tuned to this podcast and other updates on our website at humanrestorationproject.org.