Introduction and Weather Chat
00:00:13
Speaker
Welcome back to the Policy Viz Podcast. I'm your host, John Schwabisch. I hope you're well. I hope the weather is treating you nice. It has gotten hot here in Virginia, and it has made umpiring behind the plate of the little league a little difficult. But anyways, on to the show. As you probably know, if you're in the data visualization
COVID Stories in The New York Times
00:00:34
Speaker
There were a number of stories from the New York Times a couple of weeks ago about the marking of one million deaths in the United States from COVID. And there was some conversation about whether, in particular, one of those stories, that included a bunch of dots animating around the screen, whether that was an effective way to get readers to feel the impact of that unfortunate milestone. But later in the week, there were a couple of other stories, and one in particular by Eliza Alfredtig,
00:01:04
Speaker
that used audio from family members of people who had passed away from the virus. And so I reached out to Eliza to get her take on her story, how she built it, and also this sort of broader body of work that The Times had come out with that
Interview with Eliza: Storytelling with Audio
00:01:20
Speaker
week. So we chat about her work, we chat about how she actually built it, where she got the audio files from, and her
00:01:27
Speaker
thoughts generally about how we can use sound to help readers or users or audience members connect with our content. So I'm going to hand it over to this interview with Eliza from the New York Times, and I hope you'll enjoy it. Hi, Eliza. Good morning. How are you? Hi, John. I'm doing well. How are you? I'm doing fine. It's definitely summertime here in Virginia in the high 90s. Yeah, here in Brooklyn as well. It is quite warm.
00:01:58
Speaker
What do we have? Like basically a couple of months of like 50, I don't know about doubt up there, but down here was like 50 degrees for a couple of months in like April and May, which never happens. Yeah. It was, it was very cool for a while. I think I wore my, my coats for longer than I expected, which I don't mind actually, because everybody complains about the 50 degrees and then everybody will complain about the 90 degrees. So, you know, why does what complaint? We're not sweating as far as I'm concerned.
00:02:23
Speaker
Well, anyways, thanks for coming on the show. I'm really excited to chat with you about your piece in The Times and a couple of other pieces in The Times marking this unfortunate anniversary of a million deaths from COVID. So the story that you worked on, that you wrote, Voices of a Grieving Nation came out, I think, a week or so ago, and was a combination of text and graphs and audio, which I thought was the kind of
00:02:45
Speaker
for me the most engaging piece of it. And so I thought maybe you could just tell folks how you and the folks you work with came up with it and then how you actually physically did the interviews or recorded the audio and then how you actually built the whole thing and pulled it all together.
Humanizing Data: COVID Trackers
00:03:00
Speaker
Sure. So I think as some background, I have spent more than the last two years as part of the team that creates the coronavirus trackers on the New York Times website. So there's a group of us. There's more than 100 people. I know you spoke with Charlie, another person that I work with.
00:03:21
Speaker
And I am part of a sort of smaller subset of that group that creates the graphics for the Coronavirus tracker, the charts, the time series, the tables, everything that readers and I come back and check day after day. And so I had spent a lot of time staring at these charts that I was building. And I know that also, unlike a lot of other
00:03:48
Speaker
visualizations that The Times does, readers spent a lot of time looking at these charts. And I think that that time series of cases and also of depth in some ways is like a marker of this era. I think it's this indelible image of
00:04:05
Speaker
this crisis that we've all been living through for the last two plus years. And so as I've been working on it, I think something that we talk about a lot and that's important to us is to make sure that these numbers are not just numbers, you know, that every pixel of that chart of a case chart is somebody who got sick. Every pixel of the death's chart is somebody who died. And
00:04:31
Speaker
You don't want to forget that, even as you're getting really deep into the technical details. These are lives that we're talking about.
00:04:41
Speaker
I had just been broadly thinking about what are ways that we can help make these graphics that are so familiar, perhaps focus more on individual lives.
Collaborative Projects and Personalization
00:04:54
Speaker
And so an initial idea that I had was this concept of find yourself on the curve. So for the case curve, I had this idea, oh, what if we do a call out
00:05:07
Speaker
to readers and ask them, if you had coronavirus, you're here. You're one of the pixels on this chart. Find yourself and tell us your story. And there was some discussion around that idea. And that was earlier in 2022. And as we were starting to talk about that, it became clear that we were nearing this awful milestone of one million people who had died. And so we started talking about, well, what if we did
00:05:37
Speaker
something like that, some sort of way of really personalizing these graphics, but for deaths. And so as I was sort of starting to have conversations about, oh, how could we maybe do a call out for readers and ask them to find their loved ones on this forum, I learned that The Daily, our podcast, had already done that.
00:06:00
Speaker
Yeah, so they had put out a call out asking readers who had lost someone to COVID-19 to call in with some sort of memory of the person who died.
Family Voice Memos and Data Visualization
00:06:10
Speaker
And I think also, generally, if they had any thoughts about grief and grieving to share those in a voice memo. And so I connected with The Daily and it was shortly after they had opened it, but they had already received a lot of submissions.
00:06:25
Speaker
And I asked them, they were interested in using them for their own episode, which they did do, and which I thought was really incredible. They used some of the same voice memos that I did.
00:06:39
Speaker
I was like, what if we did something collaborative where, you know, I could also make use of some of these voice memos and kind of attach them to the point on the chart and really use that as a way of not only honoring the lives of the people who died, but also, you know, think more broadly about how we make sense and how we visualize and how we, you know, visualize is, you know, talking about visuals, but how do we,
00:07:07
Speaker
make sense of such a large number using voices of people. And so once we had that initial conversation, we sort of moved forward on this collaboration and the story began to take shape. They have a large number of these voice memos that came through. Did you have to winnow your way through to find the ones that you thought would work in the story? And how did you do that filtering process?
00:07:32
Speaker
So the Daily received more than 200 voice memos, and they were just gutting to listen to. Yeah, I was going to say, just on the data prep side, it must just be torturous to have to listen to these.
00:07:49
Speaker
It was really challenging, but I think it was really important to listen to them. I wouldn't say that I listened to every single bit of all of them, because the Daily had started to go through them and they had started to organize them, but I listened to a lot of them. I didn't really have a clear sense of which ones I wanted to feature. I was looking for some particular thing, but as I was listening, I sort of
00:08:19
Speaker
started to compose them into moments in time and think about common themes. And I think The Daily did the same. We were working in sort of different lanes of a similar project and we were collaborating and they were doing curation and I was doing curation. And I think for everyone involved in the project, we felt that it was so challenging but also
00:08:44
Speaker
I don't know, it's really important to hear what the readers had to say and I think informed both of our final products, just grappling with the grief of each individual voice. And I think that that is sort of...
00:09:01
Speaker
what I would say is the thesis of the story that I was working on, my contribution to this memorializing of a million deaths is that when you are looking at such an awful milestone of a million people who've died from COVID, there's two numbers that you're thinking about. There's a million and then there's also one. And I think that what audio
00:09:24
Speaker
compared to a lot of other forms is so effective with is that it demands your attention. You can't listen to a million audio files all at once. You can't even really listen to three or four or 10 audio files at once.
00:09:40
Speaker
in a way, it kind of helps make this point that you can't just consolidate. You can't just add one and one and one and one and then get to a million. It's almost impossible to do that math and I think audio helps make that point.
Diverse Storytelling Methods at The Times
00:09:57
Speaker
I want to come back to your story, but given that you've mentioned this idea of the one and the single pixel, I want to talk about a couple of other projects that The Times had put out that same week. So there was a piece that came out a couple of days, I think, maybe the day before yours came out. It was entitled, How America Lost One Million People, and it got a lot of attention on the date of his Twitter world.
00:10:18
Speaker
It, you know, there's a big print spread, but online it started with all these dots, you know, these little dots around the screen. And then as you scroll through and animate it into this curve, as you've mentioned, the area chart, and then as you kept scrolling it, animate it out into this map. And there was some critique about that saying, you know, all these, you know, again, with all the dots, all the pixels, it still doesn't help us really grasp the magnitude and the impact of a million deaths.
00:10:47
Speaker
But in retrospect, I think over the next couple of days, your piece came out and then there was another piece that came out. There was an op-ed that had actual text message exchanges between people who were in the hospital and their family members. I don't really know what the question here is, but I guess what I'm trying to ask is,
00:11:10
Speaker
should we as the reading public, especially when we hit a milestone like this, should we view these pieces as a body of work, as a whole, rather than here's one, here's another, here's another, and sort of pick each one apart? Yeah, so I think, you know, for such an enormous story as this, one million people who've died, there are
00:11:37
Speaker
dozens, if not more, of ways that you can look at this story. And I think that that's true for any story. The larger the story is, the more ways we're going to cover it and think about it and convey it. And so I can't speak to the specific decisions that were made in those other stories. I was aware of the one
00:11:58
Speaker
that with the Million Dots, but I wasn't involved in it. And the one that was coming out of opinion was separate. And I should note, I think they're both really fantastic stories that are doing
00:12:08
Speaker
different things. And so yeah, I think that like, from my perspective, there's no one definitive way of telling the story of a million deaths. And I think, you know, this has been something that we've been grappling with, you know, how to tell the story of COVID since it began, you know, we tell it in our charts that are on the tracker that are that are reporting the numbers, we tell it in
00:12:31
Speaker
written articles that are coming out every day. We tell it in our live blog. We tell it in stories that include photography, stories that include videos. As we've hit different milestones, like 100,000, they took over the front page and there was also an online version that showed bits of obituaries and people's names. When we hit 500,000 people,
00:12:54
Speaker
who had died, there was a really fantastic video story that one of my teammates put together. And
00:13:03
Speaker
I think, for my perspective, there is no way that you can really convey this and say, okay, this is the definitive story and this is the definitive way. But I think that each story that we've published is trying to do something different. I think my story was really trying to convey, in a way, in almost like a meta kind of way, how difficult it is to understand such an enormous loss. I think that as a reader of the story with a million dots, they were looking at
00:13:33
Speaker
Different groups of people who are affected and and why and then really helping people understand, you know of this giant number like This it wasn't just a million scattered equally around the country There were very specific groups that were affected and I think it was important to look at that. I think that the opinion story it was
00:13:53
Speaker
you know, so emotionally effective, because everyone texts people if you know somebody who's sick, you're texting with them. And so I think, you know, you're just able to identify. And so I think there's they're just, and, you know, my story was, you know, thinking about how you listen to people who are grieving and how you, you know, how it's difficult to consolidate grief, and like, to sort of package it and wrap your arms around it. And I think they're, they're just all different ways of looking
00:14:22
Speaker
at something and I don't know that. I think that they each had their own goal. Right. I'm curious what how you look at your piece and the op-ed piece that was of the text messaging because those two and I know they're they're separated. There's like a wall or whatever between the news and the op-ed side. But I'm curious how you look at those two because they do seem so I guess closer in nature because they both have these individual
00:14:50
Speaker
exchanges or responses? Yeah, I think that they are doing some similar things. I think that they're both trying to contrast or really look at the compliment of, you know, one individual loss, you know, one connection with a family member and then sort of zoom out and look at, you know, how that relates to the whole. But I think that they're the formats, they just they do different things. I think. Yeah.
00:15:20
Speaker
with audio, you can you can hear the emotion in somebody's voice. I think there's just there's a lot of other information that you get from a person that are different from the words. And I think what is so effective about text messages, as I mentioned, is that they're just the way that people communicate it now. And so I think you can kind of identify in a way with those. And so, yeah, I think that, you know, they're as I said, there's many different ways of trying to look at this. And I think that
00:15:49
Speaker
they are doing similar things but I don't feel like they're redundant. No, no, no, that's right. What I also found interesting about the text messaging piece was they did such a good job with the design where it was actually like an image of a phone and you would scroll through the text messages the way you actually would as opposed to sort of having it, you know, like regular text. Like I thought the design was really well done. Yeah, absolutely. I thought they did a really fantastic job.
00:16:15
Speaker
So I want to come back to your piece.
Technical Aspects of Interactive Storytelling
00:16:17
Speaker
There are going to be some people listening to this who want to know how it was actually built. So you have all these audio files. And for folks who haven't seen it, and I'll put a link on the show notes, it's a chart on the left side. And as you scroll through, there's the written news story. And then you have these spots where you can play
00:16:38
Speaker
the audio, which was also very nice that it's sort of, I don't know, is there a name for this where, is it just closed captioning where it sort of highlighted the text as it moved along? Because you could toggle the audio on and off if you wanted to, but the highlighting always sort of occurred.
00:16:53
Speaker
Yeah, I'm not sure I should come up with a snappy name for that effect. It's something that I have been developing and used on a number of different stories, at least for like a year or two. I think the first time that I used that, let's call it, I don't know, karaoke or closed caption was actually on a story that I was collaborating on about podcast voices, which is out there.
00:17:18
Speaker
this conversation and it was sort of trying to illustrate podcast ease and the way that different people speak on podcasts and there were these illustrations, like a spiral of a voice or a very sparse. I'll send you a link to it. And the idea that as you're hitting each word, it highlights and I think it's very effective because I think that when you're coming
00:17:44
Speaker
to an article you don't usually expect that it's going to have an audio component and so I think we need to we obviously want to do our best to entice readers to turn on their sound because you know we're not we're adding audio because we think that there's something that audio can uniquely do for the story but we also know that that readers
00:18:03
Speaker
not everyone, you might not be in a situation where you can turn on sound when you're reading The New York Times. And so how do you make the experience at least somewhat satisfying without sound and maybe also use that as a way of enticing people to turn on their sound? So yeah, that's definitely been a format that I've been exploring for a while. And so it was interesting to try it out again here.
00:18:28
Speaker
Okay, so I want to get to the technical piece because I'm sure people are like, I want to add sound to my piece. So yeah, so how is this like, technically, how is this built? Yeah, sure. So it uses a JavaScript framework called Svelte, which is something that was created by a former colleague of mine, both at the Guardian and the New York Times, Rich Harris. And it's a great framework for people who are interested in JavaScript. I think it's particularly well suited to building
00:18:58
Speaker
the sort of interactive web pages that we build in news, which is not coincidental because Rich was building it to support his work in news. So that's the underlying framework. And then in terms of the audio, it's just using HTML5 audio. So there's no library, it's just using what
00:19:18
Speaker
you have available on any webpage on the modern web. You can really do a lot with that. You can play one file, you can play multiple files, you can adjust the volume. Even though I think the composition of playing multiple video files at once, it looks complicated. Under the hood, it's actually fairly straightforward.
00:19:42
Speaker
Fairly straightforward if you're familiar with development and like, I think there's something more frustrating than someone saying, oh, it's easy. And, you know, you have no idea what to do. But I think if, if you're the sort of person who's familiar with, you know, building websites and it's comfortable with JavaScript, I think working with audio is very accessible.
00:20:01
Speaker
Yeah, I already kind of know the answer to this question, but I want to I want to ask anyway. So sound and data vis sort of sonification are kind of a somewhat of a hot topic seems to kind of ebb and flow a little bit in the in the field. And I mean, I kind of already can guess your your affinity for sound.
00:20:19
Speaker
and using audio since you have at least these two projects that we've talked about. But I'm curious how you foresee sound being used maybe more regularly in the field and to communicate data. Not just these huge milestone type pieces, but more regularly.
00:20:37
Speaker
Yeah, I think that it's funny, I don't think of a lot of what I do as like, you know, data biz, even though I think, you know, maybe this case, it arguably could be, but I think more in terms of, you know, what is the best way to communicate this particular story. And I think, as I was mentioning before, the barrier to experiencing
00:20:59
Speaker
Audio is there. It can be difficult. It's a more challenging experience for the reader. And so I think when you're using audio or using video, which is also something that I have been working with a lot over the last few years, you want to have a good reason for doing it. And so it's hard for me to say, oh, yeah, we should just do more stuff with audio. But I think if there are stories that are enriched by readers hearing something,
00:21:26
Speaker
that I think it's certainly worth doing. I think that the power of audio, it's sort of a double edged sword in that it
00:21:38
Speaker
demands your attention. I think related to this Million Death story, you can't just skim it. You can't just kind of meet your eyes around a page and take it in.
Power of Audio in Storytelling
00:21:49
Speaker
Readers have been trained to sort of understand visuals over the last 10, 20 years, which it's not like they naturally knew how to do that, but it's something people have been working on. And I think
00:22:00
Speaker
there's, we don't have a good way of taking in a lot of audio. And so I think it's, you know, what are the stories that would benefit? I think it adds emotion, it really helps humanize stories to hear things. And also, I think, you know, music and media and culture journalism, I think also really benefits from audio. I've worked on a lot of stories with our culture desk that involve music. And so of course, if you're
00:22:27
Speaker
working on a story that is about sounds is about music, then it's great if you can allow readers to hear it too. I've worked on this series that we call Before After where we look at a classic album and
00:22:42
Speaker
as you go through, we describe for each song of the album its influences and the songs it influenced. And it's one thing to just be able to read a journalist telling you what this particular song took from something before, but it's another thing to be able to hear it and say, oh, okay, that
00:23:02
Speaker
like guitar pattern in the song from the 1930s, which I can now hear, I can hear it now in the song from the 1960s. So we've done that for, we did it for Maggot Brain, we did it, we did that series for
00:23:16
Speaker
My Chemical Romance. While I was working on that, I turned into a giant My Chemical Romance fan. I had never even heard it before that. I was like, this is amazing. We did it for B-52s. It's a fun series. And I think that there have been other stories about bird sounds, or there was a really fantastic one that some of my colleagues did about subway chimes in different cities. And so when you're talking about something you can hear,
00:23:46
Speaker
Yeah, hear it. Right, right, right. So how does that play then into the print side of the newspaper? Or does it or does it not? I mean, I know there's this must be a tough balance. Yeah, it is. I think that
Challenges of Digital to Print Storytelling
00:24:04
Speaker
For this story about a million deaths, I couldn't imagine what a print version of this would look like. There is no print version because it's both dealing with the animation through time of a chart and how it changes over time and whether you have a thousand deaths or a million deaths, it still fits in the same space. I think that using the web is an effective way to share that. Of course, it also deals with audio and
00:24:34
Speaker
the uniqueness of that form. And so I basically went into this being like, I don't think there will be a print version. But it ended up that I thought that the print package that was put out
00:24:46
Speaker
where they took over the whole front page and there were a lot of other stories. We did end up using the quotes that I had selected and just listing them on the back page there. The final page of that were mostly the same stories that ended up in my story. That was one way of elevating the voices of the readers who had called in. But it wasn't really the same article. It wasn't like making
00:25:15
Speaker
this point about representation, but it was still including it in a way. Right. But it's interesting because it spans then. I mean, I know there's more than just kind of the three things in my head right now, print, online and podcast. But like it spans all three of those and kind of does a nice job of linking all those different ways to reach an audience. Yeah, just in a subtle way, right? Like I probably
00:25:40
Speaker
I mean, probably no one really realizes that until right now, right? That you could have seen or heard the same quote yet. Yeah, I did sort of see the story I was working on as like existing in some space between the other ones.
00:25:56
Speaker
in a way because it is integrating the daily podcast and the data and the individual stories that we report all the time that we try to elevate those stories as much as we can. But yeah, I think it's hard to really, if you're really trying to push the web
00:26:17
Speaker
And, and like to tell stories in a unique way, it can be hard to then say, okay, well, how do we, how do we put this in print? Um, and I, I personally don't know anything about print design. I haven't worked on that. I know there are some colleagues of mine who do both and are really fantastic at both. And so when I have like, for example, those before and after music stories, they do end up, um, in the paper, but there's obviously no audio element. Just pressing on paper doesn't really play. Yeah.
00:26:47
Speaker
Yeah. Well, Liza, these are great. The story was great. Thanks so much for taking time on your day and chatting about it. I'll put on the episode notes for folks who want to check all of these out. I'll put them down there so you can, you can take a look as well as some of the other pieces that we talked about the before, after the podcast voices and the subway times, but all those. So, so again, thanks so much for coming on the show. It was really great chatting with you and yeah, thanks. Okay. Thanks John.
00:27:11
Speaker
Thanks everyone for tuning into this week's episode of the show. I hope you enjoyed that. I hope you learned a little bit. There are a lot of links in the show notes to this week's episode, so go over there, do some clicking, do some reading, and of course, do some listening. If you would like to help support the show, please rate or
00:27:26
Speaker
review it on your favorite podcast provider. You can also support the show financially through Patreon, or you can also head over to my new window community, which is a text messaging app where I send out about two or three times a week, some data visualization strategies, tips, examples, and also have some cool giveaways going on right now through the month of June and July. So I hope you enjoyed this week's episode. Only one more left in this season of the show. So until next time, this has been the policy of this podcast. Thanks so much for listening.
00:27:58
Speaker
A number of people help bring you the Policyviz podcast. Music is provided by the NRIs, audio editing is provided by Ken Skaggs, design and promotion is created with assistance from Sharon Satsuki-Ramirez, and each episode is transcribed by Jenny Transcription Services. If you'd like to help support the podcast, please share it and review it on iTunes, Stitcher, Spotify, YouTube, or wherever you get your podcasts.
00:28:19
Speaker
The PolicyViz podcast is ad-free and supported by listeners. If you'd like to help support the show financially, please visit our PayPal page or our Patreon page at patreon.com slash PolicyViz.