Archivage Twitter de Nick Ruest en janvier 2015

« I’ve spent the better part of a month collecting tweets from the #JeSuisCharlie, #JeSuisAhmed, #JeSuisJuif, and #CharlieHebdo tweets. Last week, I pulled together all of the collection files, did some clean up, and some more analysis on the data set (76G of json!). This time I was able to take advantage of Peter Binkley‘s twarc-report project. According to the report, the earliest tweet in the data set is from 2015-01-07 11:59:12 UTC, and the last tweet in the data set is from 2015-01-28 18:15:35 UTC. This data set includes 13,968,293 tweets (10,589,910 retweets – 75.81%) from 3,343,319 different users over 21 days. You can check out a word cloud of all the tweets here. »

Submitted by Nick Ruest on Tue, 02/03/2015 – 09:29

En savoir plus sur la collecte de Nick Ruest 


« On November 13, 2015 I was at the « Web Archives 2015: Capture, Curate, Analyze » listening to Ian Milligan give the closing keynote when Thomas Padilla tweeted the following to me:

I immediately started collecting ».

Submitted by Nick Ruest on Sat, 12/12/2015 – 14:49

Pour en savoir plus sur la collecte de Nick Ruest 

The September 11 Digital Archive

The September 11 Digital Archive uses electronic media to collect, preserve, and present the history of September 11, 2001 and its aftermath. The Archive contains more than 150,000 digital items, a tally that includes more than 40,000 emails and other electronic communications, more than 40,000 first-hand stories, and more than 15,000 digital images. In September 2003, the Library of Congress accepted the Archive into its collections, an event that both ensured the Archive’s long-term preservation and marked the library’s first major digital acquisition.

Une collection à explorer qui permet notamment de découvrir des documents nativement numériques, par exemple des documents d’animation, fichiers flash, jeux vidéo, etc., comme Bade Dudes vs Osama bin Laden.

Capture d’écran 2016-03-16 à 23.10.55

Documenting the 2015 Paris attacks web archives (1/3) : An interview with the Archive-It team

This post is the first in a series of three interviews conducted by the ASAP project team, aimed at documenting the web archives of the 2015 Paris attacks and their making, through a dialogue with the web archiving professionals from the institutions that have created event based collections on the attacks: Archive-It, the BnF and the Ina.

The first interview documents Archive-It’s Charlie Hebdo collection. It was conducted through an email exchange (11-17 March, 2016), between Valérie Schafer and Marguerite Borelli, and Jefferson Bailey, Internet Archive’s Web Archiving Programs Director of the Archive-It, and Sylvie Rollason-Cass, web archivist in charge of the Charlie Hebdo attacks fund within the Archive-It team.

Archive-It is a subscription service offered by the pioneering web archiving institution Internet Archive. Launched in 2006, it allows its partner organizations to benefit from the Internet Archive’s infrastructure, experience and know-how in terms of web archiving.

site Archive-It Charlie Hebdo collection

site Archive-It
Charlie Hebdo collection

Q1: You have worked with many IIPC members to collect the Web in relation to the Charlie Hebdo attacks: How was this partnership organized (was it a formal process or was it spontaneous?)? Did the same type of partnership and collection take place for the November attacks?

Jefferson Bailey & Sylvie Rollason-Cass : As an IIPC member we have collaborated with other member organizations on event based collections in the past. We at the Internet Archive began crawling some news and social media sites related to the event shortly after the attack on the Charlie Hebdo offices. We heard from BnF that they were beginning to nominate URLs related to the attack to archive as well and offered to collaborate with them and other IIPC organizations on building one collection. 
A similar, but smaller, effort was made to create a collection related to the November attacks. That collection to date has only received URL nominations from the BnF.

Q2: When did these emergency collections begin? (with which events? and which of them were the most important ?) How do you decide to launch a special collection? Who decides ?

JB & SRC: The first event based collection that Archive-It and the Internet Archive worked on was started in 2007 in collaboration with Virginia Tech* to document the April 16th, 2007 shooting that took place on their campus. Since then we have built over 15 event based collections with collaboration and URL nominations coming from subject matter experts, as well as via crowd sourcing.
We rely on a collaborative model that gets input from subject matter experts and/or has significant participation via crowd sourcing. This informs how event-based collections are planned and managed. Examples of this include the Nepal Earthquake collection, which is comprised of URLs nominated by Yale University, the Bodleian Library, and Columbia University, and the Boston Marathon collection, which relied heavily on crowd sourced URL nominations.

Q3: What are the goals and achievements of these collections and theirs limits?

JB & SRC: The goal of these collections is to establish an accessible archive of web content related to a specific event, capture at risk content during times of crisis, and provide open access to the archived content for research and general browsing. As mentioned, we’re a small team so one of the primary limits to creating these collections is personnel time and resources. The only limits is that we are constrained in building and managing spontaneous collections just by ourselves, so the collaborative model is essential to their success and sustainability.

Q4: Have you got an idea of the number of visites of the Charlie Hebdo archives after one year?

JB & SRC: Not off hand. It is a bit complicated to measure traffic at the collection level for an internally-managed account. So we don’t have stats handy. We are working towards getting collection-specific traffic, but aren’t there yet.

Q5: The Charlie Hebdo fund on Archive-It contains archives of Facebook and Twitter (see here for example). Considering that these archives –which hold a lot of personal data, are publicly available, what is their legal status?

JB & SRC: The Internet Archive’s mission is « Universal Access to All Knowledge » and to help preserve the artifacts that document our shared culture and heritage in order to create an Internet library for researchers, historians, and scholars. More and more of these artifacts now exist in digital form and thus our mission includes collecting web resources that are publicly available.
Details about our web archives and policies can be found on our website: and in Internet Archive’s Terms of Use, Privacy Policy, and Copyright Policy, available here:

* Virginia Tech University operates the Crisis, Tragedy and Recovery Network, a fund regrouping event based web archives on sudden tragic events and crises, hosted in part by Archive-It.

1ère rencontre Lab Ina DL Web dédiée à l’archivage des RSN Attentats Paris

La première rencontre du Lab InaDLWeb  se déroulera le 1er Avril de 15h à 17h30 dans les emprises de l’Ina, sur le site de la BnF François-Mitterrand.

La séance portera sur les problématiques et enjeux liés à la collecte, à l’archivage et au traitement des  Tweets produits et diffusés en réaction aux attentats de 2015 à Paris ainsi que sur l’usage de la collection pour et par la recherche . 

Déroulé de séance :

15h00-15h45:  Présentation des modalités de collecte , indexation, archivage par l’Ina d’un corpus de plus de  20 M de  tweets en lien avec les événements

-15h45-16h30 :  Présentation des outils  existants de traitement et visualisation du corpus 

– 16h30 -17 h30 : « Hands on » /Travaux pratiques  : Accès à l’interface de consultation des Tweets archivés depuis ordinateurs portables individuels  pour prise en main et analyse

-17h30-18h00 : discussions, échanges, expression des besoins