Throughout 2017, we’ve spent a lot of time thinking, researching, writing, and talking about how disinformation flows online, about filter bubbles and fact-checking, transparency for news organizations, and other important pieces of the puzzle about how the internet has changed the way so many of us consume and understand information.
But there’s been far too little attention paid to an older form of communication that still has deep influence in our democracy: that old-fashioned thing known as the television, specifically, TV news.
Why? Not because TV news networks, including Fox, MSNBC, and CNN, don’t have influence, but rather because television is difficult to study. Informed voices have urged Facebook to release its data to fact-checkers and others working to improve the quality of news shared online. But TV news content remains both opaque and ephemeral. TV news networks make their content available online generally, but viewers are at their mercy when searching for particular clips, sharing such information elsewhere, or providing structured datasets to help inform research. If a network goes defunct, like Al Jazeera America did, we don’t have any guarantee that material will be preserved.
Enter the Internet Archive, whose mission is to provide universal access to all knowledge. Most journalists know us for the Wayback Machine, which has preserved more than 308 billion webpages online. But the Internet Archive is also home to the TV News Archive, whose collection includes more than 1.4 million TV news shows, searchable by closed captions. We are working hard with partner organizations, with journalists, and with researchers, from Duke Reporters Lab to PolitiFact, from Stanford University to startups like Matroid and Joostware, to turn our archives into data. We are applying machine learning to generate structured data in increasingly sophisticated ways, so that ultimately it will be possible not just to search captions for TV news, but also faces, talking points, identify who is speaking, and more.
For example, in 2016 we launched the Political TV Ad Archive, which used an open source audio fingerprinting tool we called the Duplitron to track political ad airings across key media markets. We fed this information to our fact-checking and journalism partners, who mined it to report on the 2016 elections.
In 2017, we developed the Trump, congressional, and executive branch archives, curated collections of clips by key political and administration figures that can searched by keywords and phrases. We also created Face-o-Matic, which tracks the faces as shown on cable TV news of President Donald Trump and the four top congressional leaders, and Third Eye, which extracts chyrons, or the lower thirds of TV screens, and turns them into downloadable data ready for analysis. The New York Times editorial page, for example, used Third Eye to track how cable news networks differed in their coverage of key indictments in the Russia investigation by special counsel Robert Mueller.
In 2018, we plan to take even greater strides in helping us understand ourselves through TV news. “Who Said What,” by Joostware and “Contextubot,” by Bad Idea Factory, two of the winners of the Knight Foundation’s (in partnership with the Democracy Fund and the Rita Allen Foundation) call for projects to combat misinformation, rely on the TV News Archive to fuel their projects. We’re working with the Duke Reporters Lab on its Tech & Check project to help automate the workflow for fact-checkers. And we’re developing new partnerships with institutions like Stanford University to develop new ways to turn our TV News Archive into data.
We’re talking to media literacy educators about deploying TV News Archive materials into curricula. And in this age of media manipulation, we are exploring ways that we can authenticate TV news clips, so the viewer knows they have not been altered. Finally, we’re expanding our collection of TV beyond national borders, because understanding how others in the world view us, as well as how we view them, will be crucial in the years to come.
Even in 2018, in the era of tablets and phones and Twitter and Facebook and Instagram, TV still affects us all. Knowing our TV is crucial to understanding ourselves.
Nancy Watzman is managing editor of the Internet Archive’s TV News Archive.
Errin Haines At the ballot, it’s time to count black women
Edward Roussel Eyes, ears, and brains
Emily Goligoski Looking beyond news for inspiration
Kyle Ellis Let’s build our way out of this
Monique Judge Letting black women tell their own stories
Joyce Barnathan It will be harder to bury the news
Daniel Trielli The rich get richer, the poor scramble
Yvonne Leow The rise of video messaging
Ray Soto VR reaches the next level
Michelle Ferrier The year of the great reckoning
Cory Haik Suffering from realness, pivoting to impact
Jesse Holcomb Information disorder, coming to a congressional district near you
Matt Thompson Here come the attention managers
Sam Ford The year of investing in processes
Sam Sanders Shine the light on ourselves
Nicholas Quah Stop talking trash about young people
Matt Boggie The intellectual equivalent of the Dead Sea
Vivian Schiller Pivot to tomorrow
Carlos Martínez de la Serna The new journalism commons
Manoush Zomorodi Self-help as a publishing strategy
Sarah Marshall Loyalty as the key performance indicator
Alice Antheaume Are you fluent in AI?
Molly de Aguiar Good journalism won’t be enough
Craig Newmark Working together toward sustainable solutions
Julia B. Chan Looking for loyalty in all the right places
Juleyka Lantigua Women of color will reclaim and monetize our time
Imaeyen Ibanga Longform video leads the way
Tracie Powell The muting of underserved voices
Claire Wardle Disinformation gets worse
Sally Lehrman Trust comes first
Marie Gilot No assholes allowed
Mariana Moura Santos Think local, act global
Matt DeRienzo A recession, then a collapse
Rasmus Kleis Nielsen The Snapchat scenario and the risk of more closed platforms
Alfred Hermida Going beyond mobile-first
Mary Meehan Real lives are at stake in rural areas
Amy King Let’s amplify visual voice
Carrie Brown-Smith Transparency finally takes off
Emma Carew Grovum Newsroom culture becomes a priority
Christopher Meighan Passive partnership is in the rearview
Caitria O'Neill The new court of public opinion
Matt Carlson Attacks on the press will get worse
Mario García Storytelling finally adapts to mobile
Frédéric Filloux External forces
Kinsey Wilson Facebook and Google: Help out or pay up
Betsy O'Donovan and Melody Kramer Skepticism and narcissism
Borja Echevarría TV goes digital, digital goes TV
Michelle Garcia Navigating journalistic transparency
Sydette Harry Listen to your corner and watch for the hook
Ernst-Jan Pfauth Publishing less to give readers more
Kim Fox Audience teams diversify their approach
Dan Shanoff You down with OTT? (Yeah, DTC)
Joanne McNeil Gatekeeping the gatekeepers
Amy Webb Listen to weak signals
Nicholas Diakopoulos Fortifying social media from automated inauthenticity
Jim Brady With the people, not just of the people
Tanya Cordrey Finally, the seeds of radical reinvention
Lam Thuy Vo Breaking free from the tyranny of the loudest
Heather Bryant Building the ecosystems for collaboration
Felix Salmon Covering bitcoin while owning bitcoin
Pete Brown Push alerts, personalized
Pia Frey Address users as individuals
Zizi Papacharissi Women come back
Caitlin Thompson Podcasting models mature and diversify
Andrew Ramsammy The year ownership mattered
Justin Kosslyn The year journalists become digital security experts
Jacqui Cheng Retailers move into content
Niketa Patel Live journalism comes of age
Tamar Charney We get serious about algorithms
Jim Moroney Newspapers have to be good enough for readers to pay for
Corey Johnson The pro-fact resistance
Amie Ferris-Rotman More female reporters abroad (please)
Joanne Lipman Journalists inventing revenue streams
Kristen Muller The year of the voter
Eric Nuzum Beyond the narrative arc
José Zamora Revenue-first journalism
Kathleen McElroy Building a news video experience native to mobile
Aron Pilhofer We can’t leave the business to the business side any more
Sara M. Watson Feeds will open up to new user-determined filters
Alan Soon The rise of start of psychographic, micro-targeted media
Jennifer Brandel and Mónica Guzmán The editorial meeting of the future
Ruth Palmer Risks will grow for news subjects — especially minorities
Kawandeep Virdee Zines had it right all along
Cristina Wilson The year of the Instagram Story
Evie Nagy Pivot to mobile video frustration
Dannagal G. Young Stop covering politics as a game
Jared Newman Venture funding and digital news don’t mix
Steve Grove The midterms are an opportunity
Jamie Mottram From pageviews to t-shirts
Jessica Parker Gilbert Design connects storytelling and strategy
Susie Banikarim R.I.P. Pivot to Video (2017–2017)
Miguel Castro The arrival of the impact producer
Mariano Blejman News games rule
Damon Krukowski Reviving the alt-weekly soul
Alastair Coote The year of self-improvement
Michael Kuntz The only pivot that might work
Umbreen Bhatti The trust problem isn’t new
Basile Simon We need better career paths for news nerds
Vanessa K. DeLuca Women’s voices take center stage
Mira Lowe The year of the local watchdog
Charo Henríquez Training is an investment, not an expense
Rachel Davis Mersey AI, with real smarts
Mike Caulfield Refactoring media literacy for the networked age
Jennifer Choi Standing up for us and for each other
Tim Carmody Watch out for Spotify
Pablo Boczkowski The rise of skeptical reading
Jarrod Dicker Honesty in advertising
Jassim Ahmad Thriving on change
Laura E. Davis Writing answers before you know the question
Trushar Barot The Jio-fication of India
Mary Walter-Brown Show a little vulnerability
Mandy Velez texting is lit rn, fam
C.W. Anderson The social media apocalypse
Renée Kaplan The year of quiet adjustments (shhh)
Corey Ford The empire strikes back
Luke O'Neil The end is already here
David Skok Finding an information-life balance
Francesco Marconi The year of machine-to-machine journalism
Dheerja Kaur Fun with subscription products
Andrew Haeg The year journalists become relationship builders
Mi-Ai Parrish Blockchain and trust
Bill Keller A growing turn to philanthropy
Federica Cherubini The rise of bridge roles in news organizations
Raney Aronson-Rath Transparency is the antidote to fake news
Millie Tran and Stine Bauer Dahlberg (Hint: It’s about your brand)
Nushin Rashidian Publishers seek ad dollar alternatives
Marcela Donini and Thiago Herdy Collaboration is the way forward for Brazilian journalism
Rick Berke Value is the watchword
Ståle Grut Reclaiming audience interaction from social networks
Gordon Crovitz Serving readers over advertisers
Lucas Graves From algorithms to institutions
Helen Havlak Keywords, not publishers, power the world’s biggest feeds
Brian Lam Sketchy ethics around product reviews
Rubina Madan Fillion Unlocking the potential of AI
Andrew Losowsky The year of resilience
Nikki Usher The year of The Washington Post
Feli Sánchez The year for guerrilla user research
Monika Bauerlein The firehose of falsehood
Juliette De Maeyer A responsible press criticism
Jennifer Coogan The future is female
Hannah Cassius The year of the echo-chamber escapists
P. Kim Bui The reckoning is only beginning
Doris Truong Computer vision vs. the Internet vigilantes
Alexios Mantzarlis Moving fake news research out of the lab
Lanre Akinola Making noise is not a strategy
Valérie Bélair-Gagnon Seeking trust in fragmented spaces
Richard Tofel The platforms’ power demands more reporters’ attention
Will Sommer The year local media gets conservative
Rodney Gibbs Tech workers turn to journalism
S. Mitra Kalita The arc of news and audience
Julia Beizer A longer view on the pivot
Taylor Lorenz Social and media will split
AX Mina Memes and visuals come to the fore
Debra Adams Simmons And a woman shall lead them
Raju Narisetti Mirror, mirror on the wall
Rachel Schallom Better design helps differentiate opinion and news
Elizabeth Jensen Show your work
Eric Ulken The year local publishers get smart(er) about change
Cindy Royal Your journalism curriculum is obsolete
Tanzina Vega It’s time for media companies to #PassTheMic