Transcript Class 15 HydroServerx

CUAHSI
http://his.cuahsi.org/
HIS
Sharing hydrologic data
Sharing Hydrologic Data using
the CUAHSI Hydrologic
Information System
Part I: Catalog and Server
The CUAHSI HIS is
Supported by NSF
Grant# EAR 0622374
Introducing the
“Knowing Generation”
“Just type it in your phone,
Daddy.”
What’s a Lobster?
SOA =
Enabling the Knowing Generation
CUAHSI HIS SOA =
Enabling Water Science Data Discovery
HIS Central
Data Discovery and
Integration platform
HydroServer
Data Publication
platform
Like web
servers
Data Services
Water Data Services
Spatial Data Services
Like HTML
Like search portals
Google, Yahoo, Bing
HydroDesktop
Data Synthesis and
Research platform
Like browsers
CUAHSI
Consortium of Universities for the Advancement of
Hydrologic Science, Inc.
• 111 US University
members
• 7 affiliate
members
• 19 International
affiliate members
An organization representing more than one hundred United States
universities, receives support from the National Science Foundation to develop
infrastructure and services for the advancement of hydrologic science and
education in the U.S.
HIS = Hydrologic Information System
What is HIS?
• The CUAHSI* Hydrologic Information
System (HIS) provides web services,
tools, standards and procedures that
enhance access to more and better
data for hydrologic analysis.
• http://his.cuahsi.org
CUAHSI HIS
The CUAHSI Hydrologic Information System (HIS) is an internet based system
to support the sharing of hydrologic data. It is comprised of hydrologic
databases and servers connected through web services as well as software for
data publication, discovery and access.
HIS Central
Data Discovery and
Integration platform
HydroServer
Data Publication
platform
Like web
servers
Data Services
Water Data Services
Spatial Data Services
Like HTML
Like search portals
Google, Yahoo, Bing
HydroDesktop
Data Synthesis and
Research platform
Like browsers
Remember the Observations Data Model…
Sites
Values and Time
Variables
Horsburgh, J. S., D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), "A Relational Model for
Environmental and Water Resources Data," Water Resour. Res., 44: W05406, doi:10.1029/2007WR006392.
Our approach thus far…
ODM sits on a server and we connect to it through SQL, Python, etc.
ODM Database
Internet
Our approach thus far…
Or… ODM sits on our computer, but we still use SQL, Python, etc.
Through a local internet…
ODM Database
“Internet”
HydroServer Approach
ODM Database
Web Services Server
Internet
Web Services
Translation
layer
XML
HydroServer Goals
• A platform for organizing and publishing
space-time hydrologic datasets that:
– Provides local control of data
Put the data service as
close to the data
producer as possible.
– Makes data universally available
Share the data as
widely and openly as
possible.
– Is autonomous – e.g., functional
independent of the rest of HIS
Serve as a useful data
store regardless of
the fate of CUAHSI
HIS.
ODM 1.1.1
Publishing Data in an ODM Database
WaterML and WaterOneFlow
WaterML is an XML schema for communicating water data
WaterOneFlow is a set of web services based on WaterML
• Set of query functions
• Returns data in WaterML
Slide from David Valentine
For example: to get a site, send this “SOAP” request
to the server:
Specify the site and an optional
authorization token
Get this response:
Result returns in this string.
WaterOneFlow
A vocabulary
for asking for
information
about the data
1.
2.
3.
4.
5.
Go to: http://worldwater.byu.edu/
Click “databases”
Click Sandbox
Click web services
Click SOAP Services
• What are the services available?
• What do they do?
1.
2.
3.
4.
5.
Go back one page
Click “REST Web Services Test”
Try “Get Sites”
Look at the output
Try formatting the output using
http://www.freeformatter.com/xml-formatter.html
WaterML
An XML
structure for
transferring
water timeseries data
(back to the
client)
KEY HydroServer Functionality:
• Read ODM
• Share it with WebServices
Add on Visualization
Capabilities
Capabilities
Database
Configuration
Tool
WaterOneFlow
ODM
WaterOneFlow
Services
WaterOneFlow
ODM
WaterOneFlow
HydroServer
Capabilities
Database
Spatial
Services
Add on GIS Services
through ArcGIS Server
ODM
ODM Databases and Web Services
ArcGIS Server Spatial Data Services
2 Flavors of HydroServer:
HydroServer (.NET)
• HydroServer (.NET):
• http://hydroserver.codeplex.com
• Model implementation of the HydroServer CUAHSI HIS
specification
• Runs on Windows servers
• Requires Microsoft SQL Server
• Uses ArcGIS Server
• Uses Streaming Data Loader, Data Loader and SQL tools to
manage the database.
2 Flavors of HydroServer
• Original HydroServer:
• http://hydroserver.codeplex.com
• Model implementation of the
HydroServer CUAHSI HIS specification
• Runs on Windows servers
• Requires Microsoft SQL Server
• Uses ArcGIS Server
• Uses Streaming Data Loader, Data Loader
and SQL tools to manage the database.
• HydroServer Lite:
• https://github.com/CUAHSI/HydroServerLi
te Simplified implementation of the
CUAHSI HIS specification (all required
services are supported).
• Runs on the free LAMP stack (Linux,
Apache, MySQL, PHP)
• Uses front end web pages to load data in
the database.
HydroServer PHP (HydroServer Lite)
• HydroServer Lite:
• https://github.com/CUAHSI/HydroServerLite
• Simplified implementation of the CUAHSI HIS
specification (all required services are supported).
• Runs on the free LAMP stack (Linux, Apache, MySQL,
PHP)
• Uses front end web pages to load data in the database.
What is HydroServer Lite?
• PHP and MySQL mean easy/fast/cheap setup
• Focus on easy extends to user interfaces.
• Developer community at
http://hydroserverlite.codeplex.com/
• Let’s try it out: http://worldwater.byu.edu/
• Browse data from any database, upload data
using the “sandbox” database.
Can Citizen Science Data be Shared and
Intermingled with “Real Data”?
Data Input
WaterML2 Output
Interactive Map
Time Series Graph
Open Source/ Light Weight PHP and MySQL WaterML HydroServer
HydroServers
for the Developing World
• http://worldwater.byu.edu
• Custom PHP-based Catalog for Developing
Countries
Internationalization Effort
Try it…
•
•
•
•
•
Go to worldwater.byu.edu
Databases
Sandbox
Create a new site
Add some data.
Assignment
• Build your own HydroServer instance on
worldwater.byu.edu
• Upload your own observations
• Write a brief report…