Transcript Digital Research Records at Center for Environmental Studies

Digital Research Records at Center
for Environmental Studies
Peter McCartney
Center for Environmental Studies
Arizona State University
• Distributed Resources
– 5 institutions, 8 departments
• Biodiversity
Taxonomic information Browsing
Collections query
Species checklists
Identification Keys
• Research metadata
– Datasets, Literature,Images, Protocols, Models
• Data access
– Download, Visualization, EDA
Center for Environmental Studies
Arizona State University
History
• LTER Mandate to provide longterm management of Ecological
Data
• Expand ASU Capacity for large
environmental initiatives through
integration
• Develop more effective data
sharing with central Arizona
partner (Federal, State, Municipal,
NGO)
Center for Environmental Studies
Arizona State University
Model for EcoInformatics
Outreach
Knowledge
Broad Spatial and Temporal Research
Knowledge-based Query Systems
Information
Framework Data
Semantic Metadata
Indexing Catalogs
Data
Access Technology
Syntactic Metadata
Primary Data Storage
Center for Environmental Studies
Arizona State University
Distributed computing
ADEQ
ADWR
CES
Informatics
Lab
MAG
ASU
GIS Lab
Geo Sciences
Remote
Sensing Lab
Landscape
Ecology
Modeling Lab
Office of
Climatology
ASU
MesoNet
Lab
Metadata Service
Data Service
Model Service
Message Pathway
Center for Environmental Studies
Arizona State University
Ecological Data Archives
• Diversity in formats, schema, size,
organization.
– Tabular – SQL, ASCII, App formats
– GIS – shapefiles, SDE, coverages
– Raster – raw, SDE, Remote sensing,
Erdas, ESRI Grid
• Standards and procedures may
exist within individual archives
– Few standards at network level
Center for Environmental Studies
Arizona State University
Ecological Metadata Language
• Serve to integrate, rather than
dictate, site solutions for data
management
–ASU, Central Arizona, Naitonal
LTER network, OBFS
• Machine parsable
–Based on XML
• Build on existing standards
–FLED, Dublin core, ISO 19115,
FGDC
Center for Environmental Studies
Arizona State University
EML 2.0 Design
• Modular, with classes relating to
specific functional roles
• Uses XML Schema complex types
to define extensible base classes of
information resources
• Extensible via the linking of new
modules within the schema
• Organized to abstract the logical
description of data from the
physical
Center for Environmental Studies
Arizona State University
EML Related Projects at CES
• Xylographa – Metadata Creation
• Xanthoria – Metadata Query
• Xylopia- Metadata mediated Access
Center for Environmental Studies
Arizona State University
Xylographa: Metadata Cretation
Center for Environmental Studies
Arizona State University
Xanthoria: Metadata Query
User
Xanthoria Client
Application
Metadata archives
XML
Schema
HTTP
Browser
HTTP
Request/
Response
Web
Application
Database Target
Xanthoria SOAP Server
SOAP Messages
XML File Target
Xanthoria SOAP Server
Relational
Database
XML
Files
SOAP Messages
Query Manager
Xanthoria SOAP
Client
Xindice Target
SOAP Messages
Xanthoria SOAP Server
XML
Database
SOAP Messages
Metacat Target
Metacat
Xanthoria SOAP Server
Center for Environmental Studies
Arizona State University
RDBMS Connector
Xylographa
EML
Configuration
Wizard
Config.XML
XSL
RDBMS
Catalog
Xanthoria
Connector
Native
XML
Standard
XML
Center for Environmental Studies
Arizona State University
Xanthoria Methods
ping(src): boolean
query(returnfields, querygroup, query
statement, src): Element
getFullRecordElement(id, src): Element
getFullRecordPath(id, src): String
load(file, src): String
src = target name
CES
Center for Environmental Studies
Center for Environmental Studies
Arizona State University
Xanthoria Query Reply
CES
Center for Environmental Studies
Center for Environmental Studies
Arizona State University
Xanthoria Request
CES
Center for Environmental Studies
Center for Environmental Studies
Arizona State University
Xylopia: Metadata Mediate Access
A web-service (Apache SOAP) based
data analysis application for EML
Uses EML Metadata to resolve
message content
Modules for:
Data Query
Processing
Visualization
Analysis
CES
Center for Environmental Studies
Center for Environmental Studies
Arizona State University
Xylopia Components
Web-based Application
(SEINet, Ecology Explorers, ClimDB, etc.)
Xylopia Client-side
Xylopia Server-side
SOAP
Data Collector
Graph Generator
Input: EML Query
Input: Clipped EML & GG Message
Output: Clipped EML & Raw Data
or Processed Data (ASCII)
Output: PNG graph
CES
Center for Environmental Studies
Map Generator*
Statistics Calculator
Input: EML Query & MG Message
Input: Clipped EML & SC Message
Output: JPG, zip, map service
configuration
Output: Clipped EML & Stats (ASCII)
*This module is not a web-service
Center for Environmental Studies
Arizona State University
Typical Xylopia Workflow






EML Query message built by the app/user
App sends the message to the Data Collector
Data Collector finds the data, puts it into an
ascii file and places the data and a new
‘clipped eml’ into a designated drop box
App gets these data and displays it to the
user
If the user requests a graph or statistics on
these data, the ‘clipped eml’ and ascii file is
usually used by these web services
If the user requests mapping data, the Data
Collector’s output varies depending on the
requested file’s format
CES
Center for Environmental Studies
Center for Environmental Studies
Arizona State University
Center for Environmental Studies
Arizona State University
Center for Environmental Studies
Arizona State University
Center for Environmental Studies
Arizona State University
Center for Environmental Studies
Arizona State University
Center for Environmental Studies
Arizona State University