Transcript NDIIPP Preservation Network: Progress, Problems, and Promise

NCSU Libraries
NDIIPP Preservation Network: Progress,
Problems, and Promise
Jim Tuttle, Geospatial Data Librarian
13 June 2006
JCDL 2006
NC Geospatial Data Archiving Project
• Partnership between NCSU Libraries and
NC Center for Geographic Information &
Analysis
• State and local geospatial content in North
Carolina
• Tied to NC OneMap initiative, which
provides seamless access to data,
metadata, and inventories
• Engage existing state/federal geospatial
data infrastructures in preservation
NCSU Libraries
Geospatial data types: Vector data
Time series
Parcel Boundary Changes 2001-2004
North Raleigh, NC
NCSU Libraries
Geospatial data types: Aerial imagery
NCSU Libraries
Geospatial data types: Aerial imagery
NCSU Libraries
Geospatial data types: Aerial imagery
85+ NC counties with orthophotos
1-5 flights per county
30-200 gb per flight
NCSU Libraries
Today’s geospatial data as tomorrow’s
cultural heritage
Future uses of data are difficult to
anticipate (as with Sanborn Maps).
NCSU Libraries
Geospatial Data: Risks
• Producer focus on current data
• Future support of data formats in question
• Shift to web services- and API-based
access
• Inadequate or nonexistent metadata
• Increasing use of spatial databases for data
management
NCSU Libraries
Different Ways to Approach Preservation
• Technical solutions: How do we archive acquired
content over the long term?
• Cultural/Organizational solutions: How do we make
the data more preservable—and more prone to be
archived—from point of production?
NCSU Libraries
Technical Approach: Progress
• Ingest workflow
– Receiving data as is – variety of distribution
methods
– Migration of some at-risk formats
– Metadata remediation, standardization, and
synchronization
– Mechanism for distilling complex objects into
repository ingest items
• Repository
– Using DSpace for demonstration purposes
– In development: use METS record as dormant item
“brain” within the repository
NCSU Libraries
Organizational Approaches: Progress
• Engaging spatial data infrastructure
– Feedback to metadata outreach program
– Feedback on adherence to content standards
– Involvement of state and local advisory bodies in
project
– Viral approach to promoting digital preservation
• Engaging industry
– Working with software vendors (e.g, ESRI)
– Engaging standards community (Open Geospatial
Consortium)
NCSU Libraries
Changing Thinking
• Web 2.0, web mashups, and AJAX technologies
create new opportunities (and challenges)
– Looking at static, pre-cut image tiles from
geospatial web services as a preservation target
• “Contact fatigue” among local agencies—need to
work with state agencies on coordinated flow of data
– Participating in a collaborative multi-agency effort
to routinize content exchange
NCSU Libraries
Learning from the NDIIPP Network
• Maturing thinking about metadata transformations
(inspiration from the UIUC/OCLC “hub and spoke”
model)
• Leveraging outside expertise in preservation metadata
(interactions with Stanford NDIIPP project)
• Discussions about mutual use of tools in ingest
workflow (JHOVE, ClamAV, noid, MD5, etc.)
• NDIIPP network creates opportunities for interactions
that might not otherwise happen
Jim Tuttle, NCSU Libraries
[email protected]
NCSU Libraries