Data Curation

Alexander Kalinowski

Week 3 - Session 1

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 1 / 30
Outline

1 Introduction

2 Data Curation Lifecycle

3 Model 1: DCC Curarion Lifecycle

4 Model 2: Data Curation Continuum

5 Model 3: The OAIS Reference Model

6 Summary

7 Next Time

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 1 / 30
 Introduction

Introduction

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 2 / 30
 Introduction

Last Time

More on metadata
Common metadata tools and standards
Ontologies
Ontologies plus data equals knowledge graph
Real world examples

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 3 / 30
 Introduction

This Lecture

Data curation lifecycle

Data standards
Models for the data curation liefcycle

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 4 / 30
 Data Curation Lifecycle

Data Curation Lifecycle

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 5 / 30
 Data Curation Lifecycle

Which lifecycles?

DCC Curation Lifecycle Model

Data Curation Continuum
Open Archival Information System (OAIS) Reference Model

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 6 / 30
 Data Curation Lifecycle

Who created the lifecycles?

DCC (Digital Curation Center)

Group of library, information, and metadata professionals
Meet to discuss standards and best practices on managing data
Based in the UK, but applicable everywhere!
International Organization for Standardization (ISO)
International body developing all kinds of standards
Example: ISO 8601 (standards for dates, times and time intervals)
Example: ISO 27000 (information security standards)

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 7 / 30
 Model 1: DCC Curarion Lifecycle

Model 1: DCC Curarion Lifecycle

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 8 / 30
 Model 1: DCC Curarion Lifecycle

The Evolution of DCC Curation Lifecycle Model

Draft version published in 2007

Open for public comments
Final version published in 2008
Outlines a series of steps and a checklist for digital curation
“Actions applied at each stage of the cycle directly influence how information can be
managed in the later stages”
“the addition of metadata during early stages assists significantly in long-term
management”

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 9 / 30
 Model 1: DCC Curarion Lifecycle

Actions in the Lifecycle

Full Lifecycle Actions

Sequential Actions
Occasional Actions

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 10 / 30
 Model 1: DCC Curarion Lifecycle

Full Lifecycle Actions

Description Representation Information

Preservation Planning
Community Watch and Participation
Curate and Preserve
Concentric circles of importance, with data at the center

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 11 / 30
 Model 1: DCC Curarion Lifecycle

Describing and Representing Data

A critical task of information curators

“Assign administrative, descriptive, technical, structural, and preservation metadata,
using appropriate standards”
“Additions and associations occur at all points in the curation lifecycle”
Added information comes in many forms:
metadata that describes digital objects and refers to where they are located
metadata that provides technical information needed to use the information
metadata that describes what has happened to the digital objects over time

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 12 / 30
 Model 1: DCC Curarion Lifecycle

Metadata

helps us understand data or digital objects and how to render them (display, play, or use
as intended)
descriptive metadata is usually assigned at data creation
whereas technical metadata is derived from data, with computer assistance
key aspects of description and representation data:
understanding key standards that exist for the data
developing policies around data use, misuse, and storage

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 13 / 30
 Model 1: DCC Curarion Lifecycle

Descriptive Metadata

Administrative metadata
Descriptive metadata
Technical metadata
Structural metadata
Preservation metadata

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 14 / 30
 Model 1: DCC Curarion Lifecycle

Sequential Actions

Create of Recieve Data

Appraise and Select
Ingest
Preservation
Store
Access, Use, Reuse
Transform
Repeat the above actions!

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 15 / 30
 Model 1: DCC Curarion Lifecycle

Occasional Actions

Conceptualize
Re-appraise
Migrate
Dispose

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 16 / 30
 Model 1: DCC Curarion Lifecycle

Examples of these Actions: Preserving Historical Recipes

Let’s do an exercise: we want to curate a collection of traditional recipes

Can we walk through each stage of the lifecycle for this task?
Next session: we will look at defining some of the associated metadata for this task via an
ontology

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 17 / 30
 Model 2: Data Curation Continuum

Model 2: Data Curation Continuum

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 18 / 30
 Model 2: Data Curation Continuum

Continuum

Australian research groups

Key difference: treats the curation strategy different for differing types of digital objects
Example: the amount and type of metadata required is influenced by why we’re keeping a
particular object
Example: the amount and type of metadata required is influenced by the amount of
time we’re keeping the object

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 19 / 30
 Model 2: Data Curation Continuum

Actions in the Continuum

Splits activities into three domains

Private
Shared
Public
Allows us to talk about decisions as data moves across each boundary
Defines two migration processes as data transitions from Private → Shared → Public
Example from my work: Facebook’s ‘walled garden’

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 20 / 30
 Model 3: The OAIS Reference Model

Model 3: The OAIS Reference Model

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 21 / 30
 Model 3: The OAIS Reference Model

History

ISO standard recommended data curation process

Began as a recommendation for the space data community in 1990
Then applied to other domains
Became a full ISO standard in 2012
ISO 14721:2012

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 22 / 30
 Model 3: The OAIS Reference Model

Three Aims

Provides a shared vocabulary of concepts for digital curation

Defines an information model
Defines a functional model (the key functions needed in curation)

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 23 / 30
 Model 3: The OAIS Reference Model

Planning Tool

Defines roles and responsibilities

Defines a long-term process for preservation
Gives a common language for all parties involved
Removes ambiguity to better achieve planning and implementation

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 24 / 30
 Model 3: The OAIS Reference Model

Functions

Open Archival Information System

Ingest - receive information
Archive - store securely
Manage - provide Descriptive Information (metadata)
Administration - day-to-day operations around the data
Access - provide ways to access and documentation around who and how can access
Preservation Planning

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 25 / 30
 Model 3: The OAIS Reference Model

Information packages

Each piece of data has an accompanying package

The digital object to be preserved
The metadata required at that point in the system
Packaging information

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 26 / 30
 Summary

Summary

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 27 / 30
 Summary

Importance of Models

Conceptual models are necessary for data curation

They specify the functions and actions required of all parties involved
They create a repeatable process for dealing with data!

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 28 / 30
 Next Time

Next Time

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 29 / 30
 Next Time

Next Time

We will discuss how metadata fits in to the models from today

We will talk more about ontologies and their importance
We will use Protege to make an ontology
Please make sure you have Protege installed!

. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
Alexander Kalinowski INFO 202 Week 3 - Session 1 30 / 30