Throughout 2017, we’ve spent a lot of time thinking, researching, writing, and talking about how disinformation flows online, about filter bubbles and fact-checking, transparency for news organizations, and other important pieces of the puzzle about how the internet has changed the way so many of us consume and understand information.
But there’s been far too little attention paid to an older form of communication that still has deep influence in our democracy: that old-fashioned thing known as the television, specifically, TV news.
Why? Not because TV news networks, including Fox, MSNBC, and CNN, don’t have influence, but rather because television is difficult to study. Informed voices have urged Facebook to release its data to fact-checkers and others working to improve the quality of news shared online. But TV news content remains both opaque and ephemeral. TV news networks make their content available online generally, but viewers are at their mercy when searching for particular clips, sharing such information elsewhere, or providing structured datasets to help inform research. If a network goes defunct, like Al Jazeera America did, we don’t have any guarantee that material will be preserved.
Enter the Internet Archive, whose mission is to provide universal access to all knowledge. Most journalists know us for the Wayback Machine, which has preserved more than 308 billion webpages online. But the Internet Archive is also home to the TV News Archive, whose collection includes more than 1.4 million TV news shows, searchable by closed captions. We are working hard with partner organizations, with journalists, and with researchers, from Duke Reporters Lab to PolitiFact, from Stanford University to startups like Matroid and Joostware, to turn our archives into data. We are applying machine learning to generate structured data in increasingly sophisticated ways, so that ultimately it will be possible not just to search captions for TV news, but also faces, talking points, identify who is speaking, and more.
For example, in 2016 we launched the Political TV Ad Archive, which used an open source audio fingerprinting tool we called the Duplitron to track political ad airings across key media markets. We fed this information to our fact-checking and journalism partners, who mined it to report on the 2016 elections.
In 2017, we developed the Trump, congressional, and executive branch archives, curated collections of clips by key political and administration figures that can searched by keywords and phrases. We also created Face-o-Matic, which tracks the faces as shown on cable TV news of President Donald Trump and the four top congressional leaders, and Third Eye, which extracts chyrons, or the lower thirds of TV screens, and turns them into downloadable data ready for analysis. The New York Times editorial page, for example, used Third Eye to track how cable news networks differed in their coverage of key indictments in the Russia investigation by special counsel Robert Mueller.
In 2018, we plan to take even greater strides in helping us understand ourselves through TV news. “Who Said What,” by Joostware and “Contextubot,” by Bad Idea Factory, two of the winners of the Knight Foundation’s (in partnership with the Democracy Fund and the Rita Allen Foundation) call for projects to combat misinformation, rely on the TV News Archive to fuel their projects. We’re working with the Duke Reporters Lab on its Tech & Check project to help automate the workflow for fact-checkers. And we’re developing new partnerships with institutions like Stanford University to develop new ways to turn our TV News Archive into data.
We’re talking to media literacy educators about deploying TV News Archive materials into curricula. And in this age of media manipulation, we are exploring ways that we can authenticate TV news clips, so the viewer knows they have not been altered. Finally, we’re expanding our collection of TV beyond national borders, because understanding how others in the world view us, as well as how we view them, will be crucial in the years to come.
Even in 2018, in the era of tablets and phones and Twitter and Facebook and Instagram, TV still affects us all. Knowing our TV is crucial to understanding ourselves.
Nancy Watzman is managing editor of the Internet Archive’s TV News Archive.
Kyle Ellis Let’s build our way out of this
Hossein Derakhshan Television has won
Tracie Powell The muting of underserved voices
P. Kim Bui The reckoning is only beginning
Rick Berke Value is the watchword
Millie Tran and Stine Bauer Dahlberg (Hint: It’s about your brand)
Matt Boggie The intellectual equivalent of the Dead Sea
Rodney Benson Better, less read, and less trusted
Carrie Brown Transparency finally takes off
Matt Thompson Here come the attention managers
Frédéric Filloux External forces
Amy King Let’s amplify visual voice
Nik Usher The year of The Washington Post
Jacqui Cheng Retailers move into content
Marie Gilot No assholes allowed
Mandy Velez texting is lit rn, fam
Sam Ford The year of investing in processes
Elizabeth Jensen Show your work
Ernst-Jan Pfauth Publishing less to give readers more
José Zamora Revenue-first journalism
Kathleen McElroy Building a news video experience native to mobile
Adam Thomas Sharing is caring: The year of the mentor
Cristina Wilson The year of the Instagram Story
Joyce Barnathan It will be harder to bury the news
Brian Lam Sketchy ethics around product reviews
Amie Ferris-Rotman More female reporters abroad (please)
Mariana Moura Santos Think local, act global
Felix Salmon Covering bitcoin while owning bitcoin
Rachel Schallom Better design helps differentiate opinion and news
Richard Tofel The platforms’ power demands more reporters’ attention
Pablo Boczkowski The rise of skeptical reading
Laura E. Davis Writing answers before you know the question
Tanya Cordrey Finally, the seeds of radical reinvention
Michael Kuntz The only pivot that might work
Raju Narisetti Mirror, mirror on the wall
Feli Sánchez The year for guerrilla user research
Charo Henríquez Training is an investment, not an expense
Christopher Meighan Passive partnership is in the rearview
Doris Truong Computer vision vs. the Internet vigilantes
Jennifer Choi Standing up for us and for each other
Juliette De Maeyer A responsible press criticism
Juleyka Lantigua Women of color will reclaim and monetize our time
Rubina Madan Fillion Unlocking the potential of AI
Rachel Davis Mersey AI, with real smarts
Justin Kosslyn The year journalists become digital security experts
Eric Nuzum Beyond the narrative arc
Renée Kaplan The year of quiet adjustments (shhh)
Alfred Hermida Going beyond mobile-first
Sydette Harry Listen to your corner and watch for the hook
Dheerja Kaur Fun with subscription products
Corey Ford The empire strikes back
Luke O'Neil The end is already here
Matt Carlson Attacks on the press will get worse
Michelle Ferrier The year of the great reckoning
Sara M. Watson Feeds will open up to new user-determined filters
Julia Beizer A longer view on the pivot
AX Mina Memes and visuals come to the fore
Tamar Charney We get serious about algorithms
Kawandeep Virdee Zines had it right all along
Alice Antheaume Are you fluent in AI?
Andrew Haeg The year journalists become relationship builders
Vanessa K. DeLuca Women’s voices take center stage
Edward Roussel Eyes, ears, and brains
Jesse Holcomb Information disorder, coming to a congressional district near you
Will Sommer The year local media gets conservative
Alan Soon The rise of start of psychographic, micro-targeted media
Borja Echevarría TV goes digital, digital goes TV
Rodney Gibbs Tech workers turn to journalism
Jamie Mottram From pageviews to t-shirts
David Skok Finding an information-life balance
Craig Newmark Working together toward sustainable solutions
Lanre Akinola Making noise is not a strategy
Hannah Cassius The year of the echo-chamber escapists
Mi-Ai Parrish Blockchain and trust
Alexios Mantzarlis Moving fake news research out of the lab
Cindy Royal Your journalism curriculum is obsolete
Jarrod Dicker Honesty in advertising
Corey Johnson The pro-fact resistance
Emily Goligoski Looking beyond news for inspiration
Sarah Marshall Loyalty as the key performance indicator
Tim Carmody Watch out for Spotify
Ray Soto VR reaches the next level
Ruth Palmer Risks will grow for news subjects — especially minorities
Zizi Papacharissi Women come back
Tanzina Vega It’s time for media companies to #PassTheMic
Mira Lowe The year of the local watchdog
Umbreen Bhatti The trust problem isn’t new
Mary Walter-Brown Show a little vulnerability
Yvonne Leow The rise of video messaging
Kinsey Wilson Facebook and Google: Help out or pay up
Jim Brady With the people, not just of the people
Gordon Crovitz Serving readers over advertisers
Claire Wardle Disinformation gets worse
Eric Ulken The year local publishers get smart(er) about change
Jim Moroney Newspapers have to be good enough for readers to pay for
Daniel Trielli The rich get richer, the poor scramble
Matt DeRienzo A recession, then a collapse
Kristen Muller The year of the voter
Lucas Graves From algorithms to institutions
Evie Nagy Pivot to mobile video frustration
Aron Pilhofer We can’t leave the business to the business side any more
Jassim Ahmad Thriving on change
Monika Bauerlein The firehose of falsehood
Susie Banikarim R.I.P. Pivot to Video (2017–2017)
Marcela Donini and Thiago Herdy Collaboration is the way forward for Brazilian journalism
Amy Webb Listen to weak signals
Manoush Zomorodi Self-help as a publishing strategy
Taylor Lorenz Social and media will split
Sam Sanders Shine the light on ourselves
Andrew Losowsky The year of resilience
Cory Haik Suffering from realness, pivoting to impact
Betsy O'Donovan and Melody Kramer Skepticism and narcissism
Imaeyen Ibanga Longform video leads the way
Dan Shanoff You down with OTT? (Yeah, DTC)
Trushar Barot The Jio-fication of India
Alastair Coote The year of self-improvement
Mary Meehan Real lives are at stake in rural areas
Carlos Martínez de la Serna The new journalism commons
Errin Haines At the ballot, it’s time to count black women
Andrew Ramsammy The year ownership mattered
Jessica Parker Gilbert Design connects storytelling and strategy
Valérie Bélair-Gagnon Seeking trust in fragmented spaces
Joanne McNeil Gatekeeping the gatekeepers
Federica Cherubini The rise of bridge roles in news organizations
Emma Carew Grovum Newsroom culture becomes a priority
Sally Lehrman Trust comes first
Joanne Lipman Journalists inventing revenue streams
Molly de Aguiar Good journalism won’t be enough
Vivian Schiller Pivot to tomorrow
Nushin Rashidian Publishers seek ad dollar alternatives
Nicholas Quah Stop talking trash about young people
Jennifer Brandel and Mónica Guzmán The editorial meeting of the future
Pete Brown Push alerts, personalized
Kim Fox Audience teams diversify their approach
Caitlin Thompson Podcasting models mature and diversify
Bill Keller A growing turn to philanthropy
Mariano Blejman News games rule
Ståle Grut Reclaiming audience interaction from social networks
Pia Frey Address users as individuals
Miguel Castro The arrival of the impact producer
Damon Krukowski Reviving the alt-weekly soul
Jennifer Coogan The future is female
Helen Havlak Keywords, not publishers, power the world’s biggest feeds
Debra Adams Simmons And a woman shall lead them
Raney Aronson-Rath Transparency is the antidote to fake news
C.W. Anderson The social media apocalypse
Mario García Storytelling finally adapts to mobile
Heather Bryant Building the ecosystems for collaboration
Francesco Marconi The year of machine-to-machine journalism
S. Mitra Kalita The arc of news and audience
Jared Newman Venture funding and digital news don’t mix
Dannagal G. Young Stop covering politics as a game
Nicholas Diakopoulos Fortifying social media from automated inauthenticity
Mike Caulfield Refactoring media literacy for the networked age
Niketa Patel Live journalism comes of age
Lam Thuy Vo Breaking free from the tyranny of the loudest
Julia B. Chan Looking for loyalty in all the right places
Basile Simon We need better career paths for news nerds
Rasmus Kleis Nielsen The Snapchat scenario and the risk of more closed platforms