Transcript New features of WS-PGRADE - P

New Features of WS-PGRADE (and gUSE)
2010 Q3 - 2011 Q2
Miklós Kozlovszky
([email protected])
MTA SZTAKI
LPDS
07/06/11
Outline
•External features (WS-PGRADE)
–
GridsphereLiferay 6.x based (JSR 168 GS  JSR 286 Liferay)
–
gUSE remote access specification + implementation
–
New portlets
–
•
Public key (support of remote resources)
•
Internal Services Portlet group (visual feedback about the internal services)
•
Resources (management of the available resources)
•
gLite Explorer – It gives a chart to the users for configured gLite VOs
Security enhancement (XSS extinguished)
•Internal features (gUSE)
–
Statistics & logging
–
Submitters
–
•
ARC
•
UNICORE
Authentication
•
SAML (Security Assertion Markup Language)
–
LFS support
–
PBS support
–
Computing as a Service” new upcoming technologies as: Google Application Engine new supported middleware
–
Optimization of submitter status updates (concurrency API)
•Additional elements
DCI Bridge
Metabroker
Translator service
07/06/11
2
New portlets
• Internal Services Portlet
– group visual feedback
about the internal
services
• Resources Portlet
– management of the
available resources
• gLite Explorer Portlet
– It gives a chart to the
users for configured gLite
VOs
• Public key Portlet
– Support of remote
resources which need
dedicated user accounts
and SSH level
identification.
07/06/11
Chemaxon’s
JChem JAVA API
gUSE remote access
Programming Environment (JAVA API)
Remote access module
(JAVA API)
WS-PGRADE
ASM
Remote
client (CLI)
MOSGRID/x
ASM
Remote
access
API
Client side
gUSE
Server side
07/06/11
SHIWA
ASM - Basic idea
• A new module called “Application Specific Module” has been
developed for gUSE that ease the creation of Application Specified
Portlets
– The module provides programming API to control applications
developed using gUSE
– The module provides programming API to access inner gUSE services
• Any kind of Graphical interface can be developed on top of this
module
– GUI written in JSP, JSTL (Java Servlet Tag Library ) and Java
– GUI can be customized for the grid application
– GUI can be customized for end users
07/06/11
ASM Concept
Client
Web browser
WS-PGRADE
Liferay + Tomcat
gUSE
Internal components
submitter
DCIs
07/06/11
Desktop or Service grids / cloud / Clusters
ASM Concept contd.
Client
Web browser
WS-PGRADE
Developed web-interface
Liferay + Tomcat
gUSE
Internal components
submitter
DCIs
07/06/11
Desktop or Service grids / cloud / Clusters
ASM Concept in details
Client
Web browser
You develop it
Web pages (JSP, JSF or other)
Developed
webinterface
You develop it
JAVA event handler, and inner classes
Configuration
files (wsdd)
Application Specific Module API
07/06/11
Statistics & logging
Objective
Generic method for measuring workflow, job and
resource performance
Solution:
Integrate a new service into the WS-PGRADE Grid
Portal
Data Collection
Metric Calculation
Metric Visualization
07/06/11
Aggregate Job Example
SEEGRID
SEEGRID
GILDA
Inserted Into
Aggregate Job
for Random
07/06/11
Inserted Into
Inserted Into
Aggregate Job
for
LongRunner
Aggregate Job
for
LongRunner
Workflow
Instance
Status =
Done
07/06/11
Data Aggregation
Job Status Entries to
Job Instance Entries
Job Instance to
Aggregate Job Entries
07/06/11
Demo
07/06/11
07/06/11
07/06/11
07/06/11
Case studies…
-CancerGrid was covered (skipping)
07/06/11
ProSim workflow in g-USE
•
Phase 1
07/06/11
UK project for
Protein Molecule
Simulation on the
Grid
Phase 2
•
a combination of
GEMLCA and
standard g-USE
jobs
•
Executed on 5
different sites of the
UK NGS
•
Parameter sweeps
in phases 3 and 4
•
Status: actively
used in production
MosGrid Science Gateway for Molecular Simulations
• Requirement: Workflow
enabled grid portal for
UNICORE based on Liferay
• Solution:
– Adaptation of WS-PGRADE
from GridSphere to Liferay
– Development of UNICORE
Submitter
– Support for SAML
– Development of ASM support
• See details:
– Previous presentation by Sandra
Gesing: A Science Gateway for
Molecular Simulations
07/06/11
Advanced simulation event visualization and result analysis
Simulations write result files:
vector results: a sequence of (time, value) pairs recorded during simulation
example: queue lengths during simulation; end-to-end delays of arrived packets
typical visualization: line chart
scalar results: values of variables, typically recorded at the end of simulation
example: total number of packets dropped; average throughput
typical visualization: bar chart, x-y plot (scatter plot)
File format: line-oriented text file
you can use OMNeT++'s tools to process and visualize them
or you can use 3rd party tools (R, Matlab, Excel, etc) or write your own ones
for specialized computations
07/06/11
Two types of OMNET portals
OMNET user portal
• User accounts exist for 1 week
• Can handle NED files that use
INET and Queuing module
sets from OMNET
• No binary come from end user
– Portal does grid operations with
one fixed certificate
07/06/11
OMNET developer portal
• Permanent user accounts
• Can handle custom OMNET
modules and NED files that
handle such modules
• Binaries come from end users
– Users are authenticated based
on their personal certificates
OMNeT++ user portal
Account request
07/06/11
OMNeT++ user portal
Account request
07/06/11
OMNeT++ user portal
“Account created” email
07/06/11
OMNeT++ user portal
Personal settings
07/06/11
OMNeT++ user portal
Input definition window
07/06/11
OMNeT++ user portal
Simulation execution window
07/06/11
OMNeT++ user portal
Simulation execution window
07/06/11
OMNeT++ user portal
Simulation execution window
07/06/11
OMNeT++ user portal
Result download window
07/06/11
Thank you for your attention
Questions?
[email protected]
www.lpds.sztaki.hu
07/06/11