Transcript CERA Metadaten

Introduction to WDCC / CERA Database




The CERA Database
World Data Center for Climate
Long Term Data Archiving
Retrieval and Download of Data
CERA Database: Some Facts









Oracle Database (Enterprise Edition Version 9.2)
Hardware: NEC SX-6 nodes (6)
24 TByte attached disk space
280 TByte of data
Largest Database in the World
900 named Users
Data accessible via Internet
Free Access to Metadata
Account needed for Download
WDCC Database Size
Database Size
250
TByte
200
150
Size
100
50
0
1998 1999 2000 2001 2002 2003 2004 2005 2006
Year
CERA Database Content
March 2007: 280 TB / 900 Experiments / 110.000 Data Sets
Data from
Earth System
Modelling and
Related
Observations
IPCC-DDC
BALTEX
ERA40
WOCE
ENSEMBLES
HOAPS
CARIBIC
IPCC
GEBCO
CEOP
COSMOS
ERA15/40
EH5/MPI-OM NCEP
IPCC-AR4
Simulations @ MPI, GKSS,…
Metadata
DataCERA
and Meta
data Model
WDCC (World Data Center Climate)

Start: Approved in January 2003

Maintenance: Model and Data (M&D/MPIMET) and German Climate
Computing Centre (DKRZ)

Mission: Data for climate research are collected, stored and disseminated

ICSU Policy: long-term archiving and unrestricted data access for
scientists

Restriction: Only climate data products in CERA DB, no raw data storage.

Content: Emphasis is on climate modelling and related data products.

Co-operation: with thematically corresponding data centres like WDCMARE (Bremen) and WDC-RSAT (Oberpfaffenhofen)

URL: http://www.wdc-climate.de/
Long Term Data Archiving in WDCC





Interested in Long Term Archiving Climate Data in
WDCC?
Inclusion can be done (by Model & Data) if following
conditions are met:
climate data are of general interest
data should become available to a broader community
data size is small relative to the data archive size
Archiving Data in CERA Database

Provide data in a structure that can be transferred into
the data base without further processing (timeseries)

meta data: Provide XML-files (experiment / datasets /
dataset_group)
XML-templates available from :




http://cera-www.dkrz.de/Meta_Fill/ or
http://cera-www.dkrz.de/Meta_Fill/mod_metadata.html
First Step: please contact [email protected] !
Further Information








M&D's webpage:
http://www.mad.zmaw.de
WDC Climate:
http://www.wdc-climate.de
CERA Database:
http://cera-www.dkrz.de
Help:
[email protected]
(Request Tracker)
Browse and Download data

Access CERA Database

http://cera-www.dkrz.de
Search CERA database
Select keyword(s) and/or project Experiments
Select keywords
List of keyword-connected experiments
Experiment Metadata
Datasets: add to process list
Process List
Download (1)
Download (2)
Download (3)
Save Dataset to local Disk
Batchjob: jblob, jblob.dat
Interface 2:
‘jblob‘ command line based tool
Batch download and download of large datasets:
•Java
based: Unix/Linux: jblob
Windows: jblob.dat
•JDBC
Connection (Java Database Connectivity)
•Examples:
jblob –datasetname <name> -options
jblob –datasetid <id> -options
jblob –showdatasets “<search_string>”
(% as wildcard)
See http://cera-www.dkrz.de
Summary: WDCC based on CERA db infrastructure




Use CERA GUI to Browse and Search Data
Add datasets to Process List for download
Large datasets / Batch download: use jblob
Help: write mail to [email protected]
Find entries by code
Click on Code Number for related dataset list
Find Entries by name / acronym
Output format: plain HTML
Data Catalogue
… based on CERA-2 Metadata model (PIK, AWI, DKRZ)
Reference
Contact
Coverage
ENTRY
Status
Distribution
- Experiment
- (dataset_group)
- dataset
Local Adm.
Data Org
Data Access
Parameter
Spatial
Reference