Transcript Time Series Plot from the Data Portal

Deployment and Evaluation of
an Observations Data Model
Jeffery S Horsburgh
David G Tarboton
Ilya Zaslavsky
David R. Maidment
David Valentine
http://www.cuahsi.org/his.html
Support
EAR 0622374
Data Access System for Hydrology (DASH)
Website Portal and Map Viewer
Information input, display, query and output services
Web services
interface
HTML -XML
WaterOneFlow
Web Services
e.g. USGS,
NCDC
WSDL - SOAP
3rd party data
servers
Uploads
Downloads
Preliminary data exploration and discovery. See
what is available and perform exploratory analyses
Data access
through web
services
Data storage
through web
services
GIS
Matlab
IDL
Observatory
data servers
ODM
CUAHSI HIS
data servers
ODM
Splus, R
Excel
Programming
(Fortran, C, VB)
CUAHSI Observations Data Model
• A relational database at the
Streamflow
single observation level
(atomic model)
• Stores observation data made
at points
Precipitation
• Metadata for unambiguous & Climate
interpretation
• Traceable heritage from raw
measurements to usable
information
Water Quality
• Standard format for data
sharing
• Cross dimension retrieval and
analysis
Groundwater
levels
Soil
moisture
data
Flux tower
data
CUAHSI Observations Data Model
http://www.cuahsi.org/his/odm.html
Discharge, Stage, Concentration and
Daily Average Example
Stage and Streamflow Example
ODM Implementation in WATERS
Network Information System
National Hydrologic Information Server
San Diego Supercomputer Center
• 11 WATERS Network test bed projects
• 16 ODM networks (some test beds have more than one
network)
• Data from 1246 sites, of these, 167 sites are operated by
WATERS investigators
Florida – Santa Fe Watershed
Nitrate Nitrogen (mg/L)
Millpond Spring
PI: Wendy Graham, ….; DM: Kathleen McKee, Mark Newman
Utah – Little Bear River and Mud
Lake
Turbidity
Continuous
turbidity
observations at
the Little Bear
River at Mendon
Road from two
different turbidity
sensors.
Managing Data Within ODM - ODM Tools
• Load – import existing
data directly to ODM
• Query and export –
export data series and
metadata
• Visualize – plot and
summarize data
series
• Edit – delete, modify,
adjust, interpolate,
average, etc.
Methods for Data Loading
Interactive Data Loader
Scheduled Data Loader
SQL Server Integration
Services
Direct analysis from your favorite analysis environment.
e.g. Matlab
% create NWIS Class and an instance of the class
createClassFromWsdl('http://water.sdsc.edu/wateroneflow
/NWIS/DailyValues.asmx?WSDL');
WS = NWISDailyValues;
% GetValues to get the data
siteid='NWIS:02087500';
bdate='2002-09-30T00:00:00';
edate='2006-10-16T00:00:00';
variable='NWIS:00060';
valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');
2.5
x 10
4
Daily Discharge NEUSE RIVER NEAR CLAYTON, NC
2
cfs
1.5
1
0.5
0
1920
1930
1940
1950
1960
1970
1980
1990
2000
2010
Summary
• Syntactic heterogeneity (File types and formats)
• Semantic heterogeneity
– Language for observation attributes
– Language to encode observation attribute values
• A national network of consistent data
• Enhanced data availability
• Metadata to facilitate unambiguous
interpretation
• Enhanced analysis capability
Future Considerations
• Additional data types (grid, image etc.)
• Additional catalog sets to enhance
discovery
• Unit standardization and conversion
• Ownership, security, authentication,
provenance
• Improve controlled vocabulary constraints
to enhance integrity
Advancement of water science is critically
dependent on integration of water information
Models
Databases: Structured data sets to
facilitate data integrity and effective
sharing and analysis.
- Standards
ODM
- Metadata
- Unambiguous interpretation
Analysis: Tools to provide windows
into the database to support
visualization, queries, analysis, and
data driven discovery.
Web Services
Databases
Analysis
Models: Numerical implementations of
hydrologic theory to integrate process
understanding, test hypotheses and
provide hydrologic forecasts.
HIS Website
http://www.cuahsi.org/his.html
•
Project Team – Introduces members of the HIS Team
•
Data Access System for Hydrology – Web map interface
supporting data discovery and retrieval
•
Prototype Web Services – WaterOneFlow web services
facilitating downlad of time series data from numerous
national repositories of hydrologic data
•
Observations Data Model – Relational database schema for
hydrologic observations
•
HIS Tools – Links to end-user applications developed to
support HIS
•
Documentation and Reports – Status reports,
specifications, workbooks and links related to HIS
•
Feedback – Let us know what you think
•
Austin Workshop – Material from WATERS workshop in
Austin