Transcript JavaCoG - AstroGrid-D

Java Cogkit
Hans-Martin Adorf (MPA)
Alexander Beck-Ratzka (AEI)
Astrogrid WS Heidelberg, 24.07.06
24.07.2006
The Java CoG Kit
Enables Globus client operations without
having to install Globus
 Accesses Globus over Globus Java-API
 Consists of JAR files
 Provides some scripts as CLI for Globus
client operations (not all).
 Also part of Java-GAT

24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
2
JCoG: where to get

Download via www.cogkit.org
Binary download
 Libraries for GTK 4 and GTK 3.2
 Scripts for emulation of Globus CLI in bin subdirectory and for setup

24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
3
JCoG: configuration (1)
Installation – nothing to do
 Configuration with script cog-setup
 Java (GUI) application; finally creates
$HOME/.globus/cog.properties

24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
4
JCoG: cog.properties
#Java CoG Kit Configuration File
#Tue Jul 04 07:05:01 EDT 2006
usercert=/home/ali/.globus/usercert.pem
userkey=/home/ali/.globus/userkey.pem
proxy=/tmp/x509up_u500
cacert=/home/ali/.globus/cog-certificates/
ip=dhcp-199.aei.mpg.de
tcp.port.range=20000,20100
24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
5
JCoG: bin CLI scripts
grid-proxy-init
grid-proxy-destroy
grid-info-search
globus-url-copy
globus-gass-server-shutdown
globus-personal-gatekeeper
globus2jks
cog-register
cogrun
cog-ws-invoke
cog-file-transfer
cog-checkpoint-submit
cog-info
cog-workflow
cog-setup
cog-gridshell
cog-shell
cog-gridftp
24.07.2006
grid-proxy-info
grid-cert-info
globusrun
globus-gass-server
cog-myproxy
grid-change-pass-phrase
cog-proxy-init
cog-graph-editor
cog-job-submit
cog-file-operation
cog-task2xml
cog-checkpoint-status
cog-workflow-gui
cog-workflow-service
grid-cert-request
cog-directory-browser
cog-desktop
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
6
JCoG: desktop

GUI, suitable for
Job definition
 Execution host definition
 Job submission via drag ‘n drop

• Primitive executable staging
• Job monitoring
• Inspection of results (stdout, stderr)
File transfer (via GridFTP)
 Management of remote directory (via GridFTP)

24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
7
JCoG: desktop (ctd.)
24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
8
JCoG: desktop (ctd.)

Highlights two general Globus problems
Firewall configuration with multiple users on
individual job submission hosts
 Staging of executables

24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
9
Globus firewall problem

Assume there are M Globus servers


Assume there are N Globus users (submit hosts)


inside your firewall
You have to pierce M x N holes into your firewall.


outside your firewall
Each hole consists of
 several individual ports and
 a port range open to TCP communication
Not acceptable to firewall administrators
24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
10
Globus firewall problem: gateway

Potential solution: gateway bundling outgoing
traffic (i.e. job submits)
Nothing seems to be known about how to set up
such gateway
 Question posted to Globus mailing list

24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
11
JCoG: staging of executables
Single executables (scripts, binary)
 What if …

there are multiple executables or libraries to be
staged?
 we want to execute our jobs on any of several
remote Globus servers?
 there is a group of collaborators who wants to
share a “software installation” on a remote
Globus server?

24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
12
JCoG: summary

Very useful for client-side Globus usage!!!
CoG is easy to install and to configure
 CoG comes with GUI
 GUI: no direct viewing of remote files (yet)
 CoG comes with CLI
 Some syntax differences between equivalent
Globus and CoG commands
 Still incomplete: no gsissh


Highlights Globus problems
24.07.2006
Java CoG Kit; Hans-Martin Adorf, Alexander Beck-Ratzka
13