Transcript
Speaker: Hello and welcome to episode 78 of our podcast at Human Restoration Project.
Speaker: My name is Chris McNutt and I'm a high school digital media instructor from Ohio.
Speaker: Before we get started, I want to let you know that this podcast is brought to you by our Patreon supporters, three of whom are Andrea Barrera, Mary Becker, and Michael Hyde.
Speaker: Thank you for your ongoing support.
Speaker: You can learn more about the Human Restoration Project on our website, humanrestorationproject.org, or find us on Twitter, Instagram, or Facebook.
Speaker: Today we're talking about ungrading with the EdTech tool Floop, short for Feedback Loop, found over at floopedu.com.
Speaker: Now we don't normally talk about specific tools or strategies at HRP, we try to get into the theory and pedagogy of progressive systems.
Speaker: But the most common question we're asked is, well, is it even possible to do any of these things that we're talking about?
Speaker: It just seems like a ton of work, it's overwhelming, everyone's against me, it just seems really hard to do.
Speaker: Well, one potential solution is Floop.
Speaker: In summary, Floop allows you to easily provide feedback to your students.
Speaker: You can create drop boxes on the platform, students then upload their assignments, and then you are given audio and text-based tools to comment on what they've done.
Speaker: You can assign feedback visually, through comment banks, see growth over past revisions, and you can see if students have read what you said.
Speaker: I personally love that Floop is committed to ungrading, and you don't have to enter in any grade whatsoever.
Speaker: It's a way to structure your class and do ungrading.
Speaker: The company actively promotes practices to distance ourselves from grades altogether.
Speaker: I myself started using Floop this year, and I'm excited to share it.
Speaker: I think it's a great example of an edtech company using their tools for actual education as opposed to maintaining the status quo, and it's affordable and ethical, as you'll soon find out.
Speaker: In the show notes, I've attached Floop's resources for feedback-driven learning, and you can learn more about Floop's pedagogy on their website.
Speaker: Finally, this episode is not sponsored in any way.
Speaker: I'm just excited to talk about it.
Speaker: Christine offered our listeners 20% off for their first year, which puts the platform at roughly $67.
Speaker: Just use the code RESTORE20 before October 31st, 2020.
Speaker: it's been quite a journey of many educators and passionate developers kind of finding each other at the right times.
Speaker: I teamed up with a teacher at my school, Elizabeth Matlick, who was an ELA teacher.
Speaker: I'm science and math.
Speaker: And
Speaker: We were both dealing with problems related to like getting students to actually read and use feedback.
Speaker: We were really lucky to be at an independent school with fairly small class sizes.
Speaker: We were sort of in teacher dreamland when it comes to having time to give feedback.
Speaker: And then we were like, wait, we're giving the feedback.
Speaker: Like, why is this not causing transformative learning?
Speaker: Right.
Speaker: And I met up at an ed tech meetup with Melanie Kong, who teaches high school engineering.
Speaker: She's now Floop's CEO, but she was working on a very similar problem related to, I think, what more classically happens in big US schools, which is that she just didn't have time to get through her paper stack.
Speaker: She knew feedback was important and just couldn't make it happen.
Speaker: And so when we sort of put our heads together, we realized that these are one in the same problem.
Speaker: Like,
Speaker: Some teachers don't have time to give feedback.
Speaker: When they do have time to give feedback, they're not seeing it making this big impact.
Speaker: We knew there had to be something going on.
Speaker: We knew there was probably a tech solution out there just for making
Speaker: feedback faster, making it more efficient so it could get to students on time.
Speaker: But we knew that just another tech tool wasn't going to solve the world's problems.
Speaker: And so we ended up doing a lot of research, consulting both our own practice and sort of the experts doing research out there.
Speaker: And we realized that there was a lot more to it, that there's this concept of feedback literacy, there's
Speaker: elements of students needing to have agency over their learning for feedback to be impactful.
Speaker: And so we were also able in our work, not just to create a tech tool, but also to be able to create sort of a philosophy of giving feedback that goes really well, I think, with the app.
Speaker: And we're hoping to sort of spread that word, that curriculum, that professional development alongside the tool, and hopefully one day embedded in the tool is a sneak peek into our hopeful future.
Speaker: That was, I think, 2017, we officially started the company.
Speaker: And now with the hit of COVID, like things have really been ramping up.
Speaker: We're hearing from teachers all over the world, really, that they need solutions for connecting with their students when they're not face-to-face anymore.
Speaker: And that makes feedback so much harder.
Speaker: So we're kind of scrambling to try to keep up with everybody right now.
Speaker: Yeah, I love how centered it is, as in a lot of tech tools, they have a tendency to do a little bit of everything, but not necessarily one thing very well.
Speaker: Whereas Floop is very much it's for feedback driven classrooms.
Speaker: And it would probably be useful for those that aren't familiar at all to just explain a little bit about how Floop works.
Speaker: Like, what literally is it?
Speaker: Yeah, absolutely.
Speaker: So Floop is a web-based, mobile-friendly app.
Speaker: So you sign up as a teacher, you sign your students up with their either Google accounts or just email and password accounts.
Speaker: You create a class, the kids enroll in the class all through their browser, whether it's on their phone or a laptop or an iPad or whatever.
Speaker: And you create an assignment and it's not a full LMS.
Speaker: So you're not putting all of your curriculum there.
Speaker: It's really sort of a digital Dropbox with feedback superpowers.
Speaker: So
Speaker: students can submit digital work, whether that's a photo that they take on their phone or they print something from OneNote to PDF or they have Google Slides and they pick it straight from Google Drive.
Speaker: It submits the work and then the teacher has some options.
Speaker: So the teacher can do spot annotated feedback.
Speaker: They can click anywhere on the work, type a comment.
Speaker: They can now do an audio comment.
Speaker: We just added that in the last couple of weeks.
Speaker: And sneak preview, we have a very exciting new way of giving feedback coming in the next couple of weeks.
Speaker: Every time a teacher leaves feedback, it opens up a conversation thread.
Speaker: So it really encourages students to engage with their feedback, to ask follow-up questions or to answer teachers' questions if the teacher asked one.
Speaker: And then students can resubmit their work to the same assignment.
Speaker: So you really can create, as a teacher, sort of a digital portfolio of revision and progress, either on one assignment or multiple assignments.
Speaker: And then you also have the option of running an anonymous and scaffolded peer review session.
Speaker: So we found and I found in my own classroom that just doing peer review sessions like paper trading really didn't work super well for kids.
Speaker: And so we built a peer review tool that focuses around a single criteria that the teacher sets and then scaffolds the questions that it asks the student to answer so that even really novice learners can produce really high quality feedback for their peers.
Speaker: Yeah, the peer feedback tool is really cool and it works really well.
Speaker: And I think some people listening might be wondering, I'm not sure if we've ever actually had an ag tech tool on this podcast because this isn't really our thing.
Speaker: We usually talk about systems and pedagogy.
Speaker: A lot of people say, I want to incorporate gradeless learning.
Speaker: I want to do PBL.
Speaker: But as you were saying before, it's just too much work.
Speaker: It feels like it's overwhelming and the reward for it isn't always what you expect it to be.
Speaker: And sadly, a lot of LMSs, they don't have the capability to
Speaker: it's something really simple, but Floop lets you write in the grade.
Speaker: Like I don't have to put in a number and that, that seems hyper simple, but I've had to like design like algorithms to convert a quote unquote letter grade to make that happen.
Speaker: So it's great for like a portfolio building tool.
Speaker: When it comes to this feedback-driven philosophy, I'm curious why you think this works.
Speaker: I'm sure most people listening probably understand the pedagogy, but what makes Floop particularly good at addressing that pedagogy?
Speaker: Yeah, so I think that we as an education system, we as teachers have known for a really long time, and I mean a really long time, like hundreds of years, that feedback is important, but
Speaker: it's really hit or miss whether giving feedback works, right?
Speaker: And the thing that I think makes a big difference between other tools out there that let you give feedback to students is that Floop also lets kids respond.
Speaker: Like it's turning feedback from a one directional transmission where the teacher's in the driver's seat telling the student what to do or telling them what's wrong or whatever.
Speaker: to a dialogue, to a two directional conversation.
Speaker: So that when I give information to a student, that student has the opportunity to engage with that feedback.
Speaker: And it's really the engagement with feedback that produces learning.
Speaker: It's not the receiving of feedback.
Speaker: we are really intentional when we're deciding what features we want to add to FLOOP or how we even want to present information in the web interface to students that we think about, like, how does this promote engagement for the student?
Speaker: How does this coach the student in developing good skills around feedback literacy that will carry them forward maybe when they're not using FLOOP?
Speaker: So that's things like the way we scaffold peer review and the questions that we choose to ask students during that
Speaker: are both research based, but they're also like, we know that if students ask those questions of each other, just in conversation on the side, that it's going to produce good feedback in that scenario too.
Speaker: So we've really been thinking about like, how can we foster that active engagement with feedback, that feedback literacy, just through the using of the tool.
Speaker: Right, right.
Speaker: And it seems like you're being very, I guess, concise about which elements you add in because, again, I don't mean this as an insult.
Speaker: It's very simple.
Speaker: That to me is the appealing part of it is that it doesn't try to do everything at once and therefore it's easy to understand what's going on.
Speaker: So as we are adapting all these different tech tools, there are a lot of concerns, especially in virtual learning when it comes to, well, what is the ed tech companies gambit?
Speaker: What are they trying to get?
Speaker: Is it a huge moneymaker?
Speaker: Is it a data privacy thing?
Speaker: Even something as simple as like Flipgrid, which I use, I like Flipgrid, but it's also owned by Microsoft and Cell Student Data.
Speaker: And it's, I mean, explicitly in the terms of use says that we will sell student data.
Speaker: And it's like, oh, great.
Speaker: And when students don't have the option.
Speaker: Oh, I didn't want to know that.
Speaker: I didn't know that.
Speaker: Now I do.
Speaker: Oh, man.
Speaker: I know.
Speaker: Exactly.
Speaker: Like, there's all these great tech tools, but there are data privacy concerns.
Speaker: There's concerns about if students can opt in and if they can't opt in.
Speaker: Like, what does that mean?
Speaker: So could you talk a little bit about your company's ethics surrounding student data and its use?
Speaker: Yeah, absolutely.
Speaker: So we, like I've said, are a company of teachers.
Speaker: And I don't just mean like we used to be teachers.
Speaker: Like I am in the digital classroom right now full time.
Speaker: And so we are creating both our company and our tool with teachers and students in mind.
Speaker: I will elaborate on that, but without further ado, we take student data privacy very seriously.
Speaker: We do not sell student data.
Speaker: We do not loan it or rent it or any of the other crafty ways that companies are getting around.
Speaker: saying that they sell data.
Speaker: We have a what we consider a pretty robust consent system, which requires that any students under 13 are getting consent, not just from a teacher, but from the school or district before they use the service.
Speaker: We ask students over 18 to review our terms of use and consent to them themselves.
Speaker: which has not really been a very easy system for us to build in, but it was one that we knew was really important.
Speaker: And we try to stay up on all of the changing things happening with GDPR and with COPPA and all the other regulations that sort of tell us what best practice is.
Speaker: We are also engaging right now in some research related to feedback, and that looks like analyzing data from the app to see what people's practices are.
Speaker: That is something that we think is really important.
Speaker: That's something that we can do as a company with the data that we have that will benefit education directly.
Speaker: And it's also something we have taken our time with because we wanted to make sure that we were doing it in an ethical way.
Speaker: So we've been working in partnership with a researcher who will pass his research plan through an ethics board to make sure that we're getting appropriate consent using the data in a responsible and ethical way.
Speaker: But so essentially, like every step along the way, we have said, like, what are teachers and students going to expect of us as a company with the way that we inform them about the way their data is being used and also use their data, not just like, what does the law require of us?
Speaker: I'm trying to brainstorm now from the practical side of things.
Speaker: If I were a teacher and I didn't already use flu, the common Q&A type questions that would take it from me to adopting this now that I understand the pedagogy, I understand the practice is
Speaker: What in your view would be the major limitations for someone that was seeking an app for gradeless learning or for feedback driven learning?
Speaker: They see Floop.
Speaker: Would there be anything preventing them outside of like a cost?
Speaker: That's a great question.
Speaker: So I would say that the number one thing that we are hearing from users right now that is a block or a potential block for them is LMS integration and authentication systems.
Speaker: So we are hearing, and I am also very much dealing with in my own classroom, an issue of just like login overload.
Speaker: Like our kids just have way too many passwords to keep track of, way too many different platforms to learn and to troubleshoot when they're not working well.
Speaker: And we know that asking teachers to pick up one more
Speaker: sort of might call like a la carte system is really hard.
Speaker: And so we are actively right now working on LMS integration, rostering SSO through a variety of different platforms.
Speaker: We know that that's important.
Speaker: It's also really hard from a technical standpoint to do it and do it well.
Speaker: And you can tell that a lot of the companies out there are still sort of figuring it out.
Speaker: In fact, like my school just switched to Canvas this year.
Speaker: So I am not only learning remote learning, but also learning Canvas and finding that like half of the LTI integrations aren't working correctly.
Speaker: So we want to make sure that if we're going to launch something, it's going to be ready when we do it.
Speaker: But we know that that's important.
Speaker: I think some of the other blocks are really around like figuring out how to use it
Speaker: well or like integrated into your system in a way that's effective.
Speaker: So if you're going to use Floop as just a digital Dropbox and not a feedback platform, it might not meet all your needs.
Speaker: Like if your goal is just to have a place for students to turn in work, we can do that.
Speaker: Like you can turn in work on Floop.
Speaker: You can't turn videos in, like you can't turn, you know, full Excel spreadsheets that are interactive in, but you can turn photos in and you can turn PDFs in and you can give feedback on those things.
Speaker: So I think
Speaker: Really asking yourself, like, what is the need that I have and what's the potential of this tool before deciding that you want to onboard?
Speaker: But we find that teachers who really dig in and use it both to collect work and also give feedback and do peer feedback on it are finding pretty impactful outcomes from switching over to Fluke from, you know, maybe a system like just using their LMS.
Speaker: Right, right.
Speaker: I mean, in my experience, using the LMS for grading is, I mean, obviously you have the number there, which automatically is going to disassociate any comment that's there.
Speaker: But also the way that comments work in almost every LMS is very much an afterthought, and it's very difficult to navigate to.
Speaker: I like the fact that Floop has the, like, not only is it easy to see what's going on, but you can tell if they've seen it.
Speaker: like it pops up and tells you, that's highly beneficial, especially in virtual learning where I'm not sitting down with them and explaining to them what's going on.
Speaker: Absolutely.
Speaker: And I've sort of been crafting this sort of philosophy of ed tech over the last couple of weeks as I've been onboarding to Canvas and not to pick on Canvas.
Speaker: I mean, it really has a lot of great potential for us as a school, but it very clearly started as a grade book, right?
Speaker: It started as a place for assignments to be posted and
Speaker: stuff to get collected and grades to be put up.
Speaker: And I think the same is true for most LMSs and Floop started as a feedback tool.
Speaker: And yes, we are considering adding on some sort of whole class or whole student metrics that you might be able to call a grade book.
Speaker: Although we have some fun plans for making it what we're going to call a growth book instead of a grade book.
Speaker: So it's not going to be numbers focused.
Speaker: It's going to be engagement focused.
Speaker: But I think like really at the core, the fact that we're feedback focused means that anything we develop is going to foster that feedback forward, that sort of like feedback should be the first thing that you engage with.
Speaker: So there's a very interesting study that just came out this summer from researchers in the UK, Winstone et al, that looked at sort of the classic
Speaker: Finding that I think research has had since the mid 80s of that grades don't really produce meaningful outcomes, but feedback does and that grades override feedback when you give them together, but they're finding that LMS systems actually make that worse.
Speaker: And the reason is that an LMS system generally creates a physical spatial environment.
Speaker: separation between comments and scores.
Speaker: So traditionally you might pass back a test and it would have the grade at the top and then all the markings on the test and the kid would kind of flip through to understand, well, where did I lose all these points, right?
Speaker: Which is not ideal, but at least they're looking at both things.
Speaker: And they're finding that now with LMS systems, the kid gets the grade first and has to click multiple times to see any comments or feedback.
Speaker: And so like a huge percentage of students are never even seeing the feedback that comes with the grade.
Speaker: So I think that that's something that we need to just be really mindful as we're moving into a more tech heavy remote learning or hybrid learning world is like what information is being presented to kids first?
Speaker: What's the candy?
Speaker: Like what's the easiest thing for them to get to?
Speaker: And even if you can't use a system like Floop, how can you hack the system you have to make it feedback forwards?
Speaker: Yeah, yeah, yeah.
Speaker: I'm totally with you.
Speaker: That study sounds really interesting.
Speaker: I'm going to get a hold of that.
Speaker: I'll put it in the show notes.
Speaker: Because I'm completely with you that the way that we run LMSs, especially in virtual classrooms, gets very much in that rank and file.
Speaker: We have 120 kids.
Speaker: Let's get them through and get everybody a one out of zero, whatever it might be.
Speaker: It's not only dehumanizing to the student, but it's dehumanizing to the teacher.
Speaker: It no longer feels like school.
Speaker: It just feels like, I mean, the assembly line thing is overused, but this is a true example of just kind of get through the queue and then end it.
Speaker: Whereas grading should be, if it has to be given, something that's at least conversational and feedback driven, as you're saying.
Speaker: Where do you see the end game?
Speaker: So I know you're bringing up like a few things that are along the way.
Speaker: What is your end product?
Speaker: What do you really want to see at the end of Floop's lifecycle or as it continues to grow?
Speaker: Yeah, that's such a great question.
Speaker: And don't hold me to this because, you know, things change as companies evolve.
Speaker: But I think our dream right now is that we are serving people.
Speaker: teachers and students in their feedback journey.
Speaker: So we are very much hoping to do embedded just-in-time professional development for teachers.
Speaker: That's something that we're going to be working on long-term.
Speaker: It's not coming right away, but thinking about either incorporating machine learning, AI-type technology that can say like, hey, I see you're giving this type of feedback.
Speaker: It seems to have these sorts of outcomes for your kids.
Speaker: Why don't you try this type of feedback instead?
Speaker: And similarly with students, like I see that you're giving these sorts of responses.
Speaker: Why don't you try this instead?
Speaker: also being involved in the research that supports doing that in an effective way.
Speaker: So not just sort of shotgun approach, like maybe we try this thing and see what happens, but really building research into that.
Speaker: We are also hoping that maybe we can become the type of platform that handles feedback and feedback
Speaker: I don't want to say grading or LMS because that's not what we want to be.
Speaker: But I think becoming a slightly bigger platform that encompasses portfolios, actual tracking of growth, not just tracking of scores, and like revealing of patterns across courses, across years in a way that helps teachers, I think, target in their time and energy to the students that need it in those moments and help students recognize earlier when they need intervention, those sorts of things.
Speaker: I hope this conversation leaves you inspired and ready to push the progressive envelope of education.
Speaker: You can learn more about progressive education, support our cause, and stay tuned to this podcast and other updates on our website at humanrestorationproject.org.
