HOW COOL IS THIS

The Web Science and Digital Libraries Research Group at Old Dominion University.

Tips for preserving your social media content, now and into the future.

In a long-awaited decision in hiQ Labs, Inc. v. LinkedIn Corp., the Ninth Circuit Court of Appeals ruled that automated scraping of publicly accessible data likely does not violate the Computer Fraud

Web Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML file - GitHub - gildas-lormeau/SingleFile: Web Extension for Firefox/Chrome/MS E...

The Web is a vast and constantly changing information landscape that by its very nature seems to resist the idea of the archive. But for the last 20 years, archivists and technologists have worked together to build systems for doing just that. While technical infrastructures for performing web archiving have been well studied, surprisingly little is known about the interactions between archivists and these infrastructures. How do archivists decide what to archive from the Web? How do the tools for archiving the Web shape these decisions? This study analyzes a series of ethnographic interviews with web archivists to understand how their decisions about what to archive function as part of a community of practice. It uses critical discourse analysis to examine how the participants’ use of language enacts their appraisal decision-making processes. Findings suggest that the politics and positionality of the archive are reflected in the ways that archivists talk about their network of personal and organizational relationships. Appraisal decisions are expressive of the structural relationships of an archives as well as of the archivists’ identities, which form during mentoring relationships. Self-reflection acts as a key method for seeing the ways that interviewers and interviewees work together to construct the figured worlds of the web archive. These factors have implications for the ways archivists communicate with each other and interact with the communities that they document. The results help ground the encounter between archival practice and the architecture of the Web.  RÉSUMÉ  Le Web est un paysage informationnel vaste et en changement constant qui, par sa nature même, semble s’opposer à l’idée de l’archive. Pourtant, depuis les vingt dernières années, les archivistes et technologues ont travaillé de concert afin de bâtir des systèmes qui feraient exactement ça. Bien que les infrastructures technologiques pour archiver le Web ont été abondamment étudiées, on en sait étonnamment peu à propos des interactions entre les archivistes et ces infrastructures. Comment les archivistes décident de ce qui sera archivé du Web? Comment les outils d’archivage du Web modèlent leurs décisions? La présente étude analyse une série d’entretiens ethnographique avec des archivistes du Web afin de comprendre comment leurs décisions concernant ce qui doit être archivé s’articulent en fonction d’une communauté de pratique. Elle utilise l’analyse critique du discours pour examiner comment l’utilisation du langage par les participants joue un rôle dans leurs processus de prise de décision d’évaluation. Les résultats suggèrent que les politiques et le positionnement des archives sont reflétés dans la manière dont les archivistes parlent de leurs réseaux de relations personnelles et organisationnelles. Les décisions d’évaluation sont l’expression des relations structurelles d’une archive et des identités de l’archiviste, qui sont forgées au cours des relations de mentorat. L’introspection agit comme méthode essentielle pour voir la façon dont les intervieweurs et les interviewés travaillent de concert pour construire les mondes façonnés des archives du Web. Ces facteurs ont des répercussions sur les façons dont les archivistes communiquent entre eux et interagissent avec les communautés qu’ils documentent. Ces résultats aident à ancrer la rencontre entre la pratique archivistique et l’architecture du Web.

A small team at the Library of Congress is archiving internet culture as fast as it can (now, from home).

An Awesome List for getting started with web archiving - GitHub - iipc/awesome-web-archiving: An Awesome List for getting started with web archiving

The Web Science and Digital Libraries Research Group at Old Dominion University.

The Web Science and Digital Libraries Research Group at Old Dominion University.

Learn how to acquire Twitter data and process them to make them usable for further analysis.

This is a guest post by Lauren Baker, a Librarian-in-Residence on the Library of Congress Web Archiving Team (a part of the Digital Collections Management & Services Division). The Librarians-in-Residence Program offers early career librarians an opportunity to contribute to Library projects while learning from professionals in the field. In 2018, the Library of Congress […]

The Social Feed Manager, created by officials in 2013, has supported more than 300 GW community members' research projects since its launch.

Client-side WARC browsing tool. Written in Javascript. Hella cool.

ONE REASON TO AUDIT YOUR DIGITAL SHIZ, PEOPLE

Every day hundreds of millions of web pages are archived to the Internet Archive’s Wayback Machine. Tens of millions of them submitted by users like you using our Save Page Now service. You can now do that in a way that is easier, faster and better than ever before. Save Page Now (SPN) just got […]

Law review article.

Contribute to CU-ITSS/Web-Data-Scraping-S2019 development by creating an account on GitHub.

This work was primarily supported by the Andrew W. Mellon Foundation, with additional funding from Start Smart Labs, the Natural Sciences and Engineering Research Council of Canada, the Social Sciences and Humanities Research Council of Canada, and the Ontario Ministry of Research and Innovation's Early Researcher Award program. We'd like to thank our content partners and Raymie Stata for comments on an earlier draft.