Transcript gcfoxpresentationagudec7

GEM Portal and SERVOGrid for
Earthquake Science
PTLIU Laboratory for Community Grids
Geoffrey Fox, Marlon Pierce
Computer Science, Informatics, Physics
Indiana University, Bloomington IN 47404
http://grids.ucs.indiana.edu/ptliupages
Solid Earth Research Virtual Observatory Grid
• A number of simulation methods for studying earthquakes are
being developed by GEM consortium including:
– Simplex, Disloc (JPL)
– Virtual California (UC-Davis)
– PARK codes (Brown)
• As codes become more robust and accepted, problems emerge:
– Need to manage information about distributed data sources:
multiple databases, sensors, simulated data.
– Need to organize, manage information about multiple code
installation sites.
– Need to simplify access to data, use of codes, and use of
visualization/analysis tools for broad range of users
– Need to link together
• NASA funded activity to develop SERVOGrid
Interoperability framework
SERVOGrid Architecture
Repositories
Federated Databases
Database
Loosely Coupled
Filters
Sensor Nets
Streaming Data
Database
Closely Coupled Compute Nodes
Analysis and
Visualization
Grid Web Service and Portlet based Portal
Architectures
• Web services are part of a broad industry and academic
initiative to build distributed computing infrastructure
around existing standards (HTTP, XML, etc).
• Web services can be used to provide lightweight service
descriptions and send messages between components in
XML.
• OGSA (Open Grid Service Architecture) builds on basic
Web Services
– Component model for Grid replacing/building on CORBA,
COM, Enterprise Javabeans etc.
• Portlets provide component model for user interfaces
Computing Portal Grid Web Services
• We have built a suite of general purpose Grid Web services
for managing distributed applications.
• Core Computing services define general purpose functions:
– Ex: job submission, file transfer, job monitoring, management of
jobs and results
– Described as a GridShell as plays same role to Grid that Shell does
for UNIX on a single machine
• Application Grid Web services include metadata about
applications.
– Built on top of core services.
– Original application NOT changed
• We have developed a toolkit that allows one to convert
general software packages into Grid Web Services and
manage application collections
User
Services
System
Services
Grid
Computing
Environments
Portal
Services
System
Services
Application
Application Metadata
Service
Middleware
System
Services
Actual Application
System
Services
System
Services
Raw (HPC)
Resources
“Core”
Grid
Database
Application Grid Web Services
• AGWS are designed to make scientific applications (i.e.
earthquake modeling codes) into Grid Resources
• AGWS services are described by two XML Schemas:
– Abstract descriptors describe application options. Used
by the application developer to deploy his/her service
into the portal.
– Instance descriptors describe particular user choices
and archive them for later browsing and resubmission.
Portals Aggregate Access to
Distributed Services
Client
Browser
(1) Client
Requests
(3)
Bind and
Use Service
Service
Provider
User Interface
Server
(HTTP)
(2)
Find Service
(SOAP/HTTP)
Information
Repository
(0)
Publish Services
Service
Provider
Service
Provider
Service
Provider
Browser Interface
JSP + Client Stubs
DB Service 1
Job Sub/Mon
And File
Services
JDBC
DB
Host 1
DB Service 2
JDBC
Operating and
Queuing
Systems
Host 2
DB
Host 3
GEM Portlets and Portal Stacks
Aggregation Portals
User facing Web
Service Ports
Application Grid Web
Services
Core Grid Services
Message Security, Information Services
• User interfaces to GEM
services (Code
Submission, Job
Monitoring, File
Management for Host X)
are all managed as
portlets.
• Users, administrators can
customize their portal
interfaces to just precisely
the services they want.
File Selector Screenshot
• Users can view files on remote hosts
– Shown is user file list for host noahsark.
– Host solar is also shown.
• Files can be uploaded or downloaded between PC and
remote host.
• Files may be crossloaded between two remote hosts.
• Same interface definition may be used to access
databases.
File management
Tabs indicate available
portlet interfaces.
Lists user files on
selected host, noahsark.
File operations include
Upload, download,
Copy, rename, crossload
Application Selection Screen Shots
• Users can select from available codes
(Simplex, Disloc, various VirtualCalifornia)
• Users also select from available hosts for
particular code (grids, noahsark, solar
shown).
• Selecting solar (Sun 64 Node E10000)
prompts user for information needed to use
PBS script generating service.
User Application Selection and Submission
Generate
script for job
submission
Select desired
application and
host
Application Administrator Interfaces
• Application Administrators deploy and
manage applications
• Update screen shows various application
and host parameters that are set by the user.
• These are used to generate user interfaces
for the selected codes.
Administer Grid Portal
Provide information
about application
and
host parameters
Select application
to edit
Futures I: General Capabilities
• System builds on Gateway Portal developed for NCSA Alliance and
DoD HPCMO. This project intends to:
• Integrate portlets from other groups in collaborations (common
interoperability framework for all tiers)
• Continue developing message-based security system (currently
available as demonstration) that signs SOAP messages.
• Integrate AGWS and Results Manager with arbitrary Schema
Wizard/Storage/Browser system used in Indiana XML newsgroups.
• Add negotiation capabilities to Web Services for version control
• Track evolving OGSA service standards and implementations.
• Add dynamic information service and monitoring capabilities for
transient Web Services.
• Distributed, ant-based tools to simplify service upgrades of
distributed servers (and simplify our lives).
Futures II: SERVOGrid
• Assist with design of common data format and
associated tools for GEM codes.
– i.e. SERVOGrid Object Model defined in XML
• Add support for service linkage (workflow) for
specific GEM applications
– e.g. Disloc<->Simplex interoperation).
• Add support for Web-based visualization with
portlet interface.
• SERVOGrid portal will be publicly available