Transcript Power Point presentation for March 2002 OAI Sheet

OAI Standards for Sheet Music Meeting
March 28-29, 2002
Basic OAI Principals
How They Apply to Sheet Music
Presenter: Curtis Fornadley, Senior Programmer/Analyst UCLA Library
[email protected]
What are the large pieces?
1) Open Archives Initiative (OAI)
2) Sheet music metadata and discovery
Open Archives Initiative
Protocol for Metadata Harvesting
(OAI )
Background
Protocol Version 1.0 released 2001-01-21
Protocol Version 1.1 (2001-07-02) is the current version
Version 2.0 will be released in June 2002.
Full Protocol:
http://www.openarchives.org/OAI/openarchivesprotocol.htm
Editors: Herbert Van de Sompel and Carl Lagoze
Cornell University - Computer Science
The Goal of OAI:
“to supply and promote an application-independent
interoperability framework that can be used by a variety of
communities who are engaged in publishing content on the Web.”
The OAI protocol facilitates metadata harvesting.
OAI Requests and Responses
OAI Requests may be expressed using either the HTTP GET or
POST methods.
OAI Responses are formatted as HTTP responses.
Every OAI protocol request returns a Content-Type of text/XML.
All OAI Responses are valid XML
(i.e. valid to specified OAI XML schemas)
OAI Data and Service Providers
There are two classes of participants:
Data Providers:
Administer systems that support the OAI protocol as a means of
exposing metadata about the content in their systems.
“Data Providers receive Requests and issue Responses”
Service Providers (aka harvesters):
Issue OAI protocol requests to the systems of data providers, and use
the returned metadata as a basis for building value-added services.
“Service Providers issue Requests and receive Responses”
OAI Sheet Music Data and Service Providers
Important OAI “Nouns”
Repository - a network accessible server to which OAI protocol requests can be
submitted. The OAI protocol provides access to metadata from OAI-compliant
repositories. This metadata is output in the form of a record.
Record - an XML-encoded byte stream that is returned by a repository in
response to an OAI protocol request for metadata from an item in that
repository. OAI records are organized into the following parts:
header -- information that is common to all records.
unique identifier - a key for extracting metadata
date stamp -- the date of creation, deletion, or last update
metadata -- a single manifestation of the metadata from an item. The OAI
protocol supports multiple formats of metadata for any single item. At a
minimum, repositories must be able to return records with metadata
expressed in the Dublin Core format, without any qualification.
Set - an optional construct for grouping items in a repository for the purpose of
selective harvesting of records.
Example: one set for “Public Domain” and another for “Copyright” sheet music
Important OAI “Verbs”
The meat of the OAI is the six “verbs” used to harvest metadata.
1) GetRecord - to retrieve an individual record (metadata) from an item in a repository. Required
arguments specify the identifier of the requested record and the format of the metadata that should be
included in the record.
2) Identify - to retrieve information about a repository, including administrative, identity, and
community-specific information.
3) ListIdentifiers - to retrieve the identifiers of records that can be harvested from a repository.
Optional arguments permit selectivity of the identifiers - based on their membership in a specific Set
in the repository or based on their modification, creation, or deletion within a specific date range.
4) ListMetadataFormats - to retrieve the metadata formats available from a repository.
DC is
the minimum requirement. For purposes of clarity, all metadata prefixes will be preceded by the string
oai_ (for example, oai_dc).
5) ListRecords -
to harvest records from a repository.
Optional arguments permit selectivity of the harvesting - based on the membership of records in a
specific Set in the repository or based on their modification, creation, or deletion within a specific
date range.
6) ListSets -
to retrieve the set structure in a repository.
Sheet Music OAI Data Providers
Existing OAI Data Providers:
Library of Congress
http://memory.loc.gov/cgi-bin/oai?verb=ListIdentifiers&set=mussm
UCLA Library
http://digital.library.ucla.edu/oai/servlet/uclaoai.OaiServlet?verb=ListIdentifiers
Each participating institution will be responsible for creating an OAIcompliant sheet music repository.
Major hurdles to becoming a Data Provider:
-Programming
-Data Mapping
Live Demo of UCLA Sheet Music Data Provider
http://digital.library.ucla.edu/oai/
Registered OAI Service Providers
Description
Service
Implementer
Arc
Old Dominion University
A federated search services based on metadata harvested
from several OAI compliant repositories.
citebaseSearch
Southampton University
The citebase Search service provides users with the facility
for searching across multiple archives
DP9
Old Dominion University
DP9 is an open source gateway service that allows general
search engines, like Google, to index OAI-compliant
archives
NCSTRL
Old Dominion University
University of Virginia
Virginia Tech
Repository Explorer
Virginia Tech
Scirus
Scirus
TORII
International School for Advanced
Studies, Trieste, Italy
NCSTRL provides unified access to technical reports and
eprints.
web-based tool to test repositories for compliancy with the
Open Archives Initiative Protocol version 1.1 or version 1.0.
concentrating on scientific content only and by searching
both web and (often proprietary) databases.
Unified access to various open archives (Physics and
Computer Science).
Given sufficient consensus, UCLA proposes to create
The OAI Sheet Music Service Provider.
Proposed High Level Design of OAI Sheet Music Service Provider
Hypothetical User Interface
Useful Tools and Sites
Full OAI Protocol Full Protocol
http://www.openarchives.org/OAI/openarchivesprotocol.htm
OAI Repository Explorer - useful for interactive exploration and validation of
OAI repositories.
http://oai.dlib.vt.edu/cgi-bin/Explorer/oai1.1/testoai
Library of Congress OAI Sheet Music Data Provider
http://memory.loc.gov/cgi-bin/oai?verb=XXX&set=mussm
UCLA Library OAI Sheet Music Data Provider
http://digital.library.ucla.edu/oai/servlet/uclaoai.OaiServlet?verb= XXX
UCLA Library OAI Site
http://digital.library.ucla.edu/oai/
Registered OAI Service Providers
http://www.openarchives.org/service/listproviders.html