Transcript OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4

OPEN GRID SERVICES ARCHITECTURE
AND GLOBUS TOOLKIT 4
OGSA
AND GT4
OPEN GRID SERVICES ARCHITECTURE
AND GLOBUS TOOLKIT 4
OGSA
AND GT4
GRID COMPUTING
INTRODUCTION
• GRID COMPUTING
ENVIRONMENT IS
EMERGING WITH
IMPROVED CAPABILITIES
& ADAPTABILITY WITH
TRADITIONAL
COMPUTING
TECHNOLOGIES.
GRID SERVICES
GRID
SERVICES
• A SERVICE INTERFACE ASSOCIATED
WITH A GRID RESOURCE IS A GRID
SERVICE.
• IN REAL TIME ENVIORNMENT VARIOUS
GRID RESOURCES AND SERVICES
INTERACT IN HETEROGENEOUS
ENVIORNMENT.
• DEFINED STANDARD FRAMEWORKS
WILL HELP FOR EFFECTIVE
IMPLEMENTATION OF GRID SERVICES.
GRID SERVICES
GRID SERVICES CAN
BE TRANSIENT.
A GRID SERVICE IS
BASICALLY A WEB
SERVICE WITH
SOME ADDITIONS
AND ADDRESSES TO
VIRTUAL
RESOURCES
A Service-Oriented Grid
Registry
Service
Brokering
Service
Virtualized
resources
ay 10, 2006 6
CPU
Resource
Compute
Service
Data
Service
Application
Service
Printer
Service
Global Grid Forum www.ggf.org
Notify
Advertise
Grid
middleware
services
Job-Submit
Service
ORGANISATIONS FOR GRID STANDARDS
GLOBAL GRID
FORUM (GGF)
• OVERALL ARCHITECTURE FOR GRID
COMPUTING
OGSA
ORGANISATION FOR
THE ADVANCEMENT OF • INFORMATION STANDARDS MIDDLEWARE
STRUCTURED
/ WEB SERVICES / WEB SERVICES
INFORMATION
RESOURCE FRAMEWORK (WS-RF)
STANDARDS (OASIS)
W3C
• WORLD WIDE WEB CONSORTIUM
GRID SERVICES STANDARDS
GLOBAL GRID FORUM (GGF)
DEVELOPED STANDARD
INTERFACES, BEHAVIOURS FOR
GRID APPLICATIONS BASED ON
WEB SERVICES.
GGF INTRODUCES THE TERM
GRID SERVICE AS AN EXTENDED
WEB SERVICE THAT CONFORMS
TO GGF OGSA FRAMEWORKS.
OPEN GRID SERVICES
ARCHITECTURE
(OGSA)
GLOBAL GRID FORUM (GGF) DEVELOPED OGSA FOR
GRID SERVICES
OBJECTIVES:
• MANAGE RESOURCES ACROSS DISTRIBUTED HETEROGENEOUS
PLATFORMS.
• DELIVER SEAMLESS QUALITY OF SERVICE.
• PROVIDE COMMON BASE FOR AUTONOMIC MANAGEMENT
SOLUTIONS.
• DEFINE OPEN PUBLISHED INTERFACE.
• EXPLOIT INDUSTRY-STANDARD INTEGRATION TECHNOLOGIES
• WEB SERVICES, SOAP, XML
• INTEGRATE WITH EXISTING IT RESOURCE.
GRID STANDARDS
KEY
EMPHASIS
FOR
STANDARDISATION
• TO BRING SCALABLE VIRTUAL
ENVIRONMENT WITH EXTENDED
SERVICES FOR
• RESOURCE MANAGEMENT
• EXECUTION MANAGEMENT
• DATA SERVICES
• INFORMATION SERVICES
• SECURITY MANAGEMENT
• SELF MANAGEMENT
OGSA Capabilities
Execution Management
• Job description & submission
• Scheduling
• Resource provisioning
Data Services
• Common access facilities
• Efficient & reliable transport
• Replication services
Resource Management
Self-Management
• Discovery
• Monitoring
• Control
• Self-configuration
• Self-optimization
• Self-healing
OGSA
Information Services
Security
• Registry
• Notification
• Logging/auditing
ay 10, 2006 11
• Cross-organizational users
• Trust nobody
• Authorized access only
OGSA “profiles”
Web services foundation
Global Grid Forum www.ggf.org
KEY CAPABILITIES OF OGSA SERVICE MODEL
CREATION.
GLOBAL NAMING AND REFERENCES.
LIFETIME MANAGEMENT.
REGISTRATION AND DISCOVERY.
NOTIFICATION.
OGSA GRID SERVICES ALSO ADDRESS AUTHORIZATION,
CONCURRENCY CONTROL AND MANAGIBILITY ASPECTS.
OGSA
GRID SERVICES CAN BE TRANSIENT.
A GRID SERVICE INSTANCE IS AN INSTATIATION OF A GRID SERVICE
THAT CAN BE DYNAMICALLY CREATED AND EXPLICITLY DESTROYED.
A PERSISTENT GRID SERVICE THAT CAN CREATE A SERVICE INSTANCE
IS CALLED A SERVICE FACTORY.
A CLIENT CAN REQUEST A FACTORY TO CREATE MANY SERVICE
INSTANCES.
MULTIPLE CLIENTS CAN ACCESS THE SAME SERVICE INSTANCE.
OGSA
OGSA DEFINES
WHAT INTERFACES
ARE NEEDED, BUT
DOES NOT SPECIFY
IMPLEMENTATION
DETAILS.
THERE ARE TWO • OPEN GRID SERVICES
INFRASTRUCTURE
STANDARDS
(OGSI) GRID SERVICES
AVAILABLE TO
SERVICES
IMPLEMENT OGSA • WEB
RESOURCE
COMPLAINT GRID
FRAMEWORK (WS-RF)
SERVICES
GRID SERVICES
OGSI
OGSI WAS DESIGNED TO SPECIFY EXACTLY
WHAT NEEDED TO BE IMPLEMENTED TO
CONFORM TO OGSA.
IT WAS REALISED THAT OGSI IS TOO FAR
FROM STANDARD WEB SERVICES TO BE
ACCEPTABLE TO THE WEB SERVICE
COMMUNITY.
THIS LEAD TO WEB SERVICE RESOURCE
FRAMEWORK (WS-RF) STANDARDS.
STATELES AND STATEFUL
STATELESS
• HAVING NO INFORMATION OF WHAT IS
OCCURRED PREVIOUSLY .
• EXAMPLE: WORLD WIDE WEB IS STATELESS,
BECAUSE EACH REQUEST IS NEW WEB PAGE AND
IT IS PROCESSED WITHOUT ANY KNOWLEDGE
OF PREVIOUS PAGE REQUESTED.
STATEFUL
• HAVING THE CAPACITY TO MAINTAIN STATE.
WEB SERVICES RESOURCE FRAMEWORK
(WS-RF)
WS-RF IS A SET OF SPECIFICATIONS
DEVELOPED BY ORGANISATION FOR THE
ADVANCEMENT OF STRUCTURED
INFORMATION STANDARDS (OASIS).
WS-RF SPECIFIES HOW WE CAN MAKE OUR
WEB SERVICES STATEFUL WITH
RESOURCES.
WS-RF IMPROVES WEB APPLICATION,
MORE ADEQUATE TO GRID SERVICES.
WEB SERVICE WITH RESOURCES
RESOURCES
Resource
A
Service Request
CLIENT
Service Response
WEB
SERVICE
Resource
B
Resource
C
New
value
WS-RF
SPECIFICATIONS
WS-RESOURCEPROPERTIES
• WS-RESOURCE PROPERTIES SPECIFIES HOW RESOURCE PROPERTIES ARE DEFINED AND
ACCESSED.
WS-RESOURCELIFETIME
• WS-RESOURCELIFETIME SUPPLIES BASIC MECHANISM TO MANAGE LIFECYCLE OF
RESOURCES.
WS-SERVICEGROUP
• WS-SERVICEGROUP SPECIFIES HOW EXACTLY WE SHOULD GOABOUT GROUPING OF
SERVICES OR WS-RESOURCES TOGETHER.
WS-BASEFAULTS
• WS-BASEFAULTS PROVIDE A STANDARD WAY OF REPORTING FAULTS WHEN SOMETHING
GOES WRONG DURING A WS-SERVICE INVOCATION.
WS-ADDRESSING
• SPECIFICATION THAT PROVIDES MECHANISM TO ADDRESS WEB SERVICES AND RESOURCES.
WEB SERVICE RESOURCE FRAMEWORK (WS-RF)
OGSA DEFINES COMMON, STANDARD AND
OPEN ARCHITECTURE FOR GRID BASED
APPLICATIONS.
WHEREAS, WEB SERVICES RESOURCE
FRAMEWORK, SPECIFIES HOW WE CAN MAKE
OUR WEB SERVICES STATEFUL.
OSGA
requires
WSRF
STATEFUL WEB
SERVICES
extends
WEB
SERVICE
specifies
WEB SERVICES ARCHITECTURE
PROCESS
DISCOVERY
DESCRIPTION
WSDL
INVOCATION
SOAP
TRANSPORT
HTTP
GLOBUS
TOOLKIT 4
GLOBUS TOOLKIT WAS DEVELOPED TO SUPPORT SERVICE ORIENTED
DISTRIBUTED COMPUTING APPLICATION AND INFRASTRUCTURES.
GLOBUS IS A COMMUNITY OF USERS AND DEVELOPERS WHO
COLLABORATE ON THE USE AND DEVELOPMENT OF OPEN SOURCE
SOFTWARE, AND ASSOCIATED DOCUMENTATION, FOR DISTRIBUTED
COMPUTING, VIRTUAL ORGANISATION AND RESOURCE FEDERATION.
GLOBUS TOOLKIT IS A SET OF LIBRARIES AND PROGRAMS THAT
ADDRESS COMMON PROBLEMS THAT OCCUR WHEN BUILDING
DISTRIBUTED SYSTEM SERVICES AND APPLICATIONS.
GLOBUS TOOLKIT
4 (CONTD)
GLOBUS TOOLKIT SUPPORTS A SET OF
SERVICE IMPLEMENTATIONS THAT
ADDRESS RESOURCE MANAGEMENT,
DATA MOVEMENT, SERVICE DISCOVERY.
GLOBUS TOOLKIT SUPPORTS WEB
SERVICES IN JAVA, C AND PYTHON.
GLOBUS TOOLKIT INSTALLATION
GT 4 CAN BE DOWNLOADED FROM
• http://www.globus.org/toolkit/downloads/4.0.0/
GLOBUS TOOLKIT IS AVAILABLE IN
THE FOLLOWING WAYS:
BINARY PACKAGE
FULL SOURCE PACKAGE
LIST OF GLOBUS
TOOLKIT 4 SOURCE
PACKAGE
SOURCE PACKAGE NAME
DESCRIPTION
gt4.0.0-all-source-installer.tar.bz2
gt4.0.0-all-source-installer.tar.gz
SOURCE PACKAGES WITH ALL
COMPONENTS
ws-core-4.0.0-src.zip
ws-core-4.0.0-src.tar.gz
SOURCE PACKAGES WITH ONLY JAVA
WS CORE COMPONENTS
LIST OF SOFTWARE FOR GLOBUS TOOLKIT 4
INSTALLATION
SOFTWARENAME
RECOMMENDED VERSION
Java SDK
1.4.2 or higher
Apache Ant
1.5.1 or higher
PostgreSQL (or other JDBC compliant
database)
7.1 or higher (if using PostgreSQL)
GLOBUS TOOLKIT ARCHITECTURE
‘C’
CLIENT
SERVER
PYTON
CLIENT
Java Services in Apache axis plus
GT libraries & handlers
‘C’
Service
Python
container
C
container
Python
hosting, GT
libraries
C Services
using GT
libraries
Pre-WS GRAM
Python
Service
Replica Locn
Data Access
Comm. Auth
Trigger
Index
Delegation
File transfer
GRAM
Java
container
‘C’
CLIENT
X.509
Credential =
common authentication
Interoperable WS-I-complaint
SOAP messaging
Java
Client
JAVA
CLIENT
PYTHON
CLIENT
GridFTP
MyProxy
JAVA
CLIENT
Telecontrol
CLIENT
GLOBUS SERVICE COMPONENTS
We’ll
start
here.
GT4 ARCHITECTURE : GT CONTAINER
 SET OF SERVICE COMPONENTS
Four different gt4 container configurations
GT4 TOOLS
. GT 4 ENABLES
A RANGE OF
TOOLS THAT
PROVIDE
HIGHER LEVEL
CAPABILITIES
TO THE NEEDS
OF USER
COMMUNITIES
• EXECUTION MANAGEMENT
TOOLS.
• DATA MANAGEMENT TOOLS.
• INTERFACE TOOLS.
• SECURITY TOOLS.
• MONITORING AND
DISCOVERY TOOLS.
EXECUTION
MANAGEMENT
TOOLS IN GT4
EXECUTION MANAGEMENT TOOLS ARE CONCERNED
WITH
•
•
•
•
•
INITIATION
MONITORING
MANAGEMENT
SCHEDULING
CO-ORDINATION OF REMOTE COMPUTATIONS.
GRID RESOURCE ALLOCATION AND MANAGEMENT
(GRAM) IS A TOOL TO SUPPORT ABOVE FUNCTIONS.
DATA MANAGEMENT TOOLS IN GT 4
DATA
• LOCATION
MANAGEMENT
• TRANSFER AND
TOOLS ARE
• MANAGEMENT OF DISTRIBUTED
ASSOCIATED
DATA
WITH
SUPPORTED
TOOLS FOR
ABOVE
PURPOSE ARE
•
•
•
•
GridFTP
REPLICA LOCATION SERVICE (RLS)
RELIABLE FILE TRANSFER (RFT)
DATA RELICATION SERVICE
INTERFACE
TOOLS IN GT 4
TO INVOKE, MONITOR
AND MANAGE GRID
RESOURCES, GT 4
SUPPORTS WITH USER
INTERFACE TOOLS.
THE FOLLOWING ARE
SUPPORT TOOLS:
• JAVA CoG
DESKTOP
• WebMDS
SECURITY
MECHANISM IN
GLOBUS TOOLKIT
Basic security mechanisms are
provided as libraries/classes and APIs.
• Integrated with other GT tools and services
• Integrated with many Grid community tools and services
(and applications & systems)
A few stand-alone tools are also
included.
SECURITY MECHANISM IN GLOBUS TOOLKIT
Standards based support for message level and
transport level security
Standards based authorization (SAML) via
Community Authorization Service (CAS) or callouts
Stand-alone delegation service
More authentication options
• MyProxy, simpleCA, …
GT 4’S USE OF SECURITY STANDARD
MONITORING AND DISCOVERY TOOLS IN GT 4
MONITORING
AND DISCOVERY
TOOLS ARE
ASSOCIATED
WITH
SUPPORT
COMPONENTS
FOR ABOVE
PURPOSE
•
•
•
•
OBTAINIG
DISTRIBUTING
INDEXING
ARCHIVING OF THE INFORMATION.
• JAVA
• C
• WS-NOTIFICATION INTERFACE
EXECUTION OF A JOB USING GRAM IN GT4
Host A
WS GRAM
Client
Host B
SOAP message
Notifications
sudo
WS GRAM
Service
GRAM Adapter
Delegated
Credential
SOAP message
Delegation
Service
RFT
Request
Delegated
Credential
GridFTP Protocol
GridFTP
Server
GridFTP Transfer
PBS
RFT Service
GridFTP
Server
LSF
Fork
Transfer
information
Database
Logical Resource
Manager
THANK YOU