Transcript No Slide Title

GT Components
Globus Toolkit
• A “toolkit” of services and packages for
creating the basic grid computing
infrastructure
• Higher level tools added to this infrastructure
• Version 4 is web-services based
• Some non-web services code exists from
earlier versions (legacy) or where not
appropriate (for efficiency, etc.).
• Each part comprises a set of web
services and/or non-web service
components.
• Some built upon earlier versions of
Globus.
Globus Open Source Grid Software
G
T
4
G
T
3
G
T
2
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
Pre-WS
Authentication
Authorization
Web
Services
Components
Components
Replica
Location
Service
XIO
Credential
Management
Security
Data
Management
Non-WS
Execution
Management
Information
Services
Common
Runtime
Another view of GT4 Components
Your
Your
CC
Client
Client
SERVER
Your
Your
Python
Python
Client
Client
Java Services in Apache Axis Python hosting,
Plus GT Libraries and Handlers
GT Libraries
Pre-WS MDS
C WS
Core
Pre-WS GRAM
pyGlobus
WS Core
RLS
Your
C
Service
MyProxy
Your
Python
Service
SimpleCA
X.509 credentials =
common authentication
CAS
OGSA-DAI
GTCP
Delegation
Index
Trigger
Archiver
Your
Your
Java
Java
Service
Service
GRAM
RFT
Interoperable
WS-I-compliant
SOAP messaging
Your
Your
CC
Client
Client
Your
Your
Java
Java
Client
Client
Your
Your
Python
Python
Client
Client
GridFTP
Your
Your
Java
Java
Client
Client
CLIENT
C Services using GT
Libraries and Handlers
GT4 Web Services Core
Custom
Web
Services
Custom
GT4
WSRF Web WSRF Web
Services
Services
WS-Addressing, WSRF,
WS-Notification
WSDL, SOAP, WS-Security
Registry
Administration
GT4 Container
User Applications
Execution Management
Key component
GRAM (Grid Resource Allocation Manager)
• For submitting executable jobs
• May interface to a local job scheduler
GT4 GRAM Structure:
Service host(s) and compute element(s)
Client
Delegate
Delegation
Transfer
request
RFT File
Transfer
Compute element
Local job
control
sudo
GT4 Java Container
GRAM
GRAM
services
services
GRAM
adapter
GridFTP
FTP
control
Local
scheduler
User
job
FTP data
GridFTP
Data management components
Remote
storage
element(s)
I Foster
Security Components
Addresses the security requirements of grid
computing. Three important factors are:
• Authorization
– Process of deciding whether a particular identity can
access a particular resource
• Authentication
– Process of deciding whether a particular identity is
who he says he is (applies to humans and systems)
• Delegation (somewhat specific to grid computing)
– Process of giving authority to another identity
(usually a computer/process) to act on your behalf.
Security continued
• Security aspects complicated by the fact
that virtual organization members and
resources can be in different
administrative domains.
Security
G
T
4
G
T
3
G
T
2
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
Pre-WS
Authentication
Authorization
Web
Services
Components
Components
Replica
Location
Service
XIO
Credential
Management
Security
Data
Management
Non-WS
Execution
Management
Information
Services
Common
Runtime
GT4’s Use of Security
Standards
I Foster
GT4 Data Management
• Move large data to/from nodes
• Replicate data for performance &
reliability
• Locate data of interest
• Provide access to different data sources
– File systems, parallel file systems,
hierarchical storage (GridFTP)
– Databases (OGSA DAI)
GridFTP and Reliable File Transfer
G
T
4
G
T
3
G
T
2
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
Pre-WS
Authentication
Authorization
Web
Services
Components
Components
Replica
Location
Service
XIO
Credential
Management
Security
Data
Management
Non-WS
Execution
Management
Information
Services
Common
Runtime
GridFTP
• Built on FTP using separation of data and
control channels
• Provides features for
–
–
–
–
–
Large data transfers
Secure transfers
Fast transfers
Reliable transfers
Third party transfers
• Not a web service
– RTF (Reliable File Transfer) service provided WSlevel interface
Third party transfers
Client
PI
PI
Server
Server
PI
PI
DTP
Control channels
Data channel
DTP= FTP Data Channel Process
PI = FTP Protocol Interpreter
DTP
Performing a third-party
transfer
1. Client establishes control channel with server
2. Using control channel, client sets up transfer
parameters and requests data channel
creation
3. Data channel established,
4. Client sends transfer command over control
channel,
5. Data transfer starts through data channel.
Either client or server can send.
Parallel transfers and striping
• Using multiple (virtual) connections for
transfer
– Same external network
– Speed improvement possible, but limited by
network card
• Striping
– a version of parallel transfers that can use
separate hardware interfaces
– Implemented in GT 4.
GridFTP and RFT
WS Client
RFT service
(Java)
Client API
(Java)
Control channel
Control channel
Data channel
XIO based (C)
XIO based (C)
GridFTP server
GridFTP server
From Gridwise
GT 4 Replica Location Service
• Identify location of files
via logical to physical
name map
Index
Index
• Distributed indexing of
names, fault tolerant
update protocols
I Foster
Monitoring and Discovery
G
T
4
G
T
3
G
T
2
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
Pre-WS
Authentication
Authorization
Web
Services
Components
Components
Replica
Location
Service
XIO
Credential
Management
Security
Data
Management
Non-WS
Execution
Management
Information
Services
Common
Runtime
Monitoring and Discovery
• WSRF provides common mechanisms for
monitoring and discovering a service:
• GT4 “aggregator” services within MDS:
– MDS-Index: collects state information from
registered resources and makes it available
as XML document
– MDS-Trigger: passes this information to an
executable
– MDS-Archive: archives state information
(awaiting implementation)