Digital Repositories: A Global Work Effort --- Test

Stanford University librarian Michael Keller will join other leading digital archiving experts November 14-16 in Paris for the inaugural meeting of the Sun Preservation and Archiving Special Interest Group, a group dedicated to working on the unique problems of storage and data management, workflow, and architecture for very large digital repositories. The Sun PASIG brings together a large group of organizations for an ongoing global discussion of their research and sharing of best practices for preservation and archiving. Here, CT asks Keller for his perspectives on the effort and the goals of the Sun PASIG.

 

CT: What has the Sun PASIG set out to accomplish? Could you comment on its work from your own institution’s perspectives and needs?

Keller: More than 10 years ago we in the library profession began to realize that we had to take responsibility for preserving—both for the long term and for access—the digital objects that were coming to us in increasing waves and increasing numbers of flows from varying sources.

Over those 10 years a lot of developments occurred and a lot of projects started, but none of them were particularly large-scale—at least the ones that anybody can talk about. We know that the government and the secret agencies are doing a lot of big-scale gathering, but we don’t know whether they are preserving anything. [So, we need] technology both in the form of software and hardware that can manage across very complex hardware arrays, but also ingest across a very wide variety of data formats and what we might call digital genres.

At Stanford, we recognized about five or six years ago that the university was producing on the order of 40 terabytes per year, and consuming on the order of 40 terabytes per year, of various kinds of digital information. And of course that number has only increased in the intervening five years. So starting four years ago we acquired a big-tape robot and some spinning disk that was intended to help us understand how to manage the huge flow of digital objects that we need to ingest and preserve…

About the Author

David Nagel is the former editorial director of 1105 Media's Education Group and editor-in-chief of THE Journal, STEAM Universe, and Spaces4Learning. A 30-year publishing veteran, Nagel has led or contributed to dozens of technology, art, marketing, media, and business publications.

He can be reached at [email protected]. You can also connect with him on LinkedIn at https://www.linkedin.com/in/davidrnagel/ .


Featured

  • Abstract AI symbols, including neural network diagrams and circuit-like patterns, blending seamlessly with a blue sky filled with soft white clouds

    UC Berkeley Announces Sky-T1-32B Open Source AI Model, Offering High Performance at a Fraction of the Cost

    UC Berkeley researchers have introduced Sky-T1-32B, an open source, reasoning-focused language model that delivers high performance at an unprecedented cost of under $450 for training.

  • abstract interconnected AI neural networks merging into a single central hub

    OpenAI to Unify AI Models with GPT-5 Launch

    OpenAI has scrapped plans to release its o3 model, opting instead for a "simplified" product lineup centered on its upcoming GPT-5 product.

  • From Fire TV to Signage Stick: University of Utah's Digital Signage Evolution

    Jake Sorensen, who oversees sponsorship and advertising and Student Media in Auxiliary Business Development at the University of Utah, has navigated the digital signage landscape for nearly 15 years. He was managing hundreds of devices on campus that were incompatible with digital signage requirements and needed a solution that was reliable and lowered labor costs. The Amazon Signage Stick, specifically engineered for digital signage applications, gave him the stability and design functionality the University of Utah needed, along with the assurance of long-term support.

  • a professional worker in business casual attire interacting with a large screen displaying a generative AI interface in a modern office

    Study: Generative AI Could Inhibit Critical Thinking

    A new study on how knowledge workers engage in critical thinking found that workers with higher confidence in generative AI technology tend to employ less critical thinking to AI-generated outputs than workers with higher confidence in personal skills.