Transcript Grid Services: Where will they lead us? 15 Feb 02 (Microsoft

Grid Services: Where will they lead us?
Malcolm Atkinson
Director of NeSC
Universities of Edinburgh and Glasgow
15th February 2002
Take Home Message
Our Axes need Sharpening and …
Take Home Message
Our Axes need Sharpening and
We Can Sharpen them …
Take Home Message
Our Axes need Sharpening and
We Can Sharpen them
Start by using Open Grid Services
Architecture
Ambition
airframe models
crew
capabil
ities
accura
cy models
human
percept
ion
stamin
a
reactio
n times
SOP’s
wing models
stabilizer models
•lift
capabiliti
es
•deflection
•drag
capabilities
capabiliti
•responsiv
es
engine
models
eness
•respons
iveness
landing
gear
models
Advanced Photon Source
wide-area
dissemination
real-time
collection
archival
storage
DOE X-ray grand challenge: ANL,
USC/ISI, NIST, U.Chicago
Ambition
in-flight data
airl
ine
grou
nd
stati
on
global network
eg SITA
DS&S Engine Health Center
internet, e-mail, pager
data centre
maintenance centre
Distributed Aircraft Maintenance Environment: Universities of Leeds, Oxford, Sheffield
&York
Fire fighting safety
Volcanic Eruption Prediction
Flood & Pollution Response
Diagnosis & Treatment Planning
Whole population health monitoring
Collision avoidance
Epidemic Detection & Management
Understanding Cells & Organs
In Flight problem management
Oceans, Climate, Ecosystems, …
Why Do We Need Better Methods?
Challenge 1
Composing Software
•Encapsulating ideas, methods & understanding
•Developed independently
•Multiple technologies
•Heterogeneous models and interfaces
•Changing components
•Uncertainty about component quality
Solving a Problem
•Iteration
Reason to Trust the Answer
An Answer in Time
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
Challenge 1
QoS?
Challenge 1
QoS?
Engineering
Trade offs?
Challenge 1
QoS?
Problem Handling?
Engineering
Trade offs?
Challenge 1
QoS?
Problem Handling?
Flexibility?
Engineering
Trade offs?
Challenge 1
QoS?
Engineering
Trade offs?
Problem Handling?
Flexibility?
Understood?
Challenge 1
QoS?
Engineering
Trade offs?
Problem Handling?
Flexibility?
Understood?
Reuse?
Challenge 2
Deluge of Data
•More Digital Sources
•Faster Digital Streams
•Faster Data Generation
•Heterogeneous models and standards
•Changing structures
•Uncertainty about data quality
Finding the Nuggets
•Iteration, Search, Indexing, Mining, Statistics, Inference
Reason to Trust the Answer
Challenge 3
Geographic Distribution
•Intrinsic: scientists, resources & instruments
•Diverse & Independent Regimes: Organisations, Countries
•Faster Networks
•Mobile: equipment, people & phenomena
•Changing structures
•Uncertainty about communication quality
Sustaining the Computation
•Problem Detection & Recovery, Security, Authentication, …
Reason to Trust the System’s Dependability
Ultimate Challenge
Challenge 1 + Challenge 2 + Challenge 3
Do it often
Do it quickly
Do it for everybody
Do it for everything
Change it quickly

Human Race Exhausted
How Can We Do Better?
Automation
What Does that Need?
Needs
Framework / Architecture
Tools
Methods
Composable Components
Dependable Foundations
Requirements
Self-Sustaining Infrastructure
•With regular well defined structure
Adequately Described Components
•Function, Behaviour, QoS, …
Models Supporting Analysis & Reasoning
•Finding appropriate components
•Determining how they compose
Tools for Composition, Diagnosis & Change
Sustainable Economic Model
Reason to Trust the System’s Dependability
How Do We Develop This?
Web Services
Grid Technology
Grid Services
Web Services
Independence
Client from Service
Service from Client
Description
Web Services DL
…
Separation
Function from Delivery
www.w3.org/TR/SOAP
Tools & Platforms
Java ONE
Visual .NET
WebSphere
Oracle
Commercial Buy in
www. w3c. org / TR / SOAP or TR/wsdl
Grid Technology
Distribution
Various Protocols
FTP
Security
Single Sign in
Resource Sharing
Discovery
Process Creation
Scheduling
Portability
APIs
Gov’nm’t Agency Buy in
Foster, I., Kesselman, C. and Tuecke, S., The Anatomy of the Grid: Enabling Virtual
Organisations, Intl. J. Supercomputer Applications, 15(3), 2001
Open Grid Services Architecture
Applications
Virtual Grid Services
Multiple implementations of
Grid Services
OGSA Features
WSDL + WSIL
Life Time Management
Description
Discovery
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Tools & Platforms
Apache axis
…
Invocation
SOAP
RPC
…
Representations
XML + Schema
Authentication
Certificates +
Delegation
Change Management
Platform
Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid:
An Open Grid Services Architecture for Distributed Systems Integration
OGSA Development
More Description
More Languages




QoS
Owners, Costs & Charging
Transaction & Coordination
Work Flow
Precision & Semantics
Tools & Platforms
Partial Models



Varied, open, analysis, synthesis
Directed composition
Change Managers
Invocation & Reps
Standard Schemas
Namespaces
Engineering
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Design for Testability
Dynamic Testing
Change Management
Dynamic Evolution
Platforms
Mapping to host,
invocation, notification,
protocol transmission,
authentication
OGSA Development 2
Higher-Level Description
Information-level
Semantic-level
Virtualisation
Tools & Platforms
Higher-level Models
User-Guided Automation
Invocation & Reps
Agreed Semantic Models
Trustworthy Translation
Engineering
Accessible Trade-offs
Dynamic Control
Autonomic
Design for QA
Q Testing & Certification
Change Management
Dynamic Evolution
Platforms
Raising their level




More high-level facilities
Coherent
Understandable
Specified
Families of Components
Members of a Family
Address a Domain





Data Integration
Biological Search
Fluid Dynamics
Ecological Models
…
Comply with Rules



Terms for Description
Schemas / Namespaces
Standard Operations
Varied Implementation



Development
Trade offs
Constructive Rivalry
Design
For change
For test
For performance
Engineer
Measure
Operational
Usage
Effects on Science
Review and Revise
Based on Real use
Accredit
The Yellow Brick Road
Many Players
Join in
Many Paths
Many Challenges
Worthwhile Goal