How Wired moved 34,000 archival web pages to one site in 9 hours

What We’re Reading

We keep an eye out for the most interesting stories about Labby subjects: digital media, startups, the web, journalism, strategy, and more. Here’s some of what we’ve seen lately.

WIRED / Benjamin Chirlin / Oct 30, 2015

They built a bot to “crawl our vast archive and store the relevant data using a single standard format.” —JL

Tags: archival content, archives, Wired

What’s the best way to follow how the news is changing?

Our daily email, with all the freshest future-of-journalism news.

Prefer a once-a-week email? »

Cite this article Hide citations

MLA

Lichterman, Joseph. "How Wired moved 34,000 archival web pages to one site in 9 hours." Nieman Journalism Lab. Nieman Foundation for Journalism at Harvard, 30 Oct. 2015. Web. 16 Jan. 2025.

APA

Lichterman, J. (2015, Oct. 30). How Wired moved 34,000 archival web pages to one site in 9 hours. Nieman Journalism Lab. Retrieved January 16, 2025, from https://www.niemanlab.org/reading/how-wired-moved-34000-archival-web-pages-to-one-site-in-9-hours/

Chicago

Lichterman, Joseph. "How Wired moved 34,000 archival web pages to one site in 9 hours." Nieman Journalism Lab. Last modified October 30, 2015. Accessed January 16, 2025. https://www.niemanlab.org/reading/how-wired-moved-34000-archival-web-pages-to-one-site-in-9-hours/.

Wikipedia

{{cite web
    | url = https://www.niemanlab.org/reading/how-wired-moved-34000-archival-web-pages-to-one-site-in-9-hours/
    | title = How Wired moved 34,000 archival web pages to one site in 9 hours
    | last = Lichterman
    | first = Joseph
    | work = [[Nieman Journalism Lab]]
    | date = 30 October 2015
    | accessdate = 16 January 2025
    | ref = {{harvid|Lichterman|2015}}
}}

The latest from Nieman Lab