Transcript Grappa: Grid access portal to physics applications

Grappa: Grid access portal
for physics applications
Shava Smallen
Extreme! Computing Laboratory
Department of Physics
Indiana University
Outline
• GriPhyN
• Grappa
– XCAT Science Portal project
– Demo
• Future Directions
– Virtual Data Browser
GriPhyN: Grid Physics Network
• Many many participating
people and institutions
• Targets data-intensive
applications
– ATLAS, CMS, LIGO, and SDSS
– 90% of data is derived
• Provide a set of tools for collaborative
data analysis
– Virtual data - transparency with respect
to location and materialization
Simplified View
Applications
Athena
Information
Services
Planner
GriPhyN/Grid
Services
Executor
Resources
App2
App1
Replica
Management
Reliable Transfer
Service
storage
storage
storage
Catalog Services
Monitoring
Policy/Security
Virtual Data Catalogs
Transparency with respect to
location
Metadata Catalog
Transparency with respect to
materialization
Derived
Metadata Catalog
Higgs particle, proton center of mass, etc
Replica Catalog
Data
X
Data
X
Data
X
orig
copy1
copy2
Indiana
Boston
Oklahoma
Derived Data Catalog
Random seed, number of events
Transformation
Catalog
Athena version, pythia, atlfast, application
model, etc.
Virtual Data Language
Motivation for Grappa
• Lots of GriPhyN/Grid services
• Requires a good deal of
expertise – more than what
many users want to know
• Common approach is a Grid
portal
• Provide a portal interface by which
physicists can launch and manage
applications and data over the Grid
XCAT Science Portal
• Framework for building personal science
portals
• A science portal is an applicationspecific Grid portal
• Active notebook
– HTML pages to describe the features of
the notebook and how to use it
– HTML forms which can be used to launch
parameterizable scripts (transformation)
– Parameters stored in a sub-notebook
(derivation)
Scripts
• Very flexible
• Jython - access to Java classes
– Globus Java CoG kit
– XCAT
– XMESSAGES
• Not every user has to write scripts
• Notebooks can be shared among users
– Import/export capability
XCAT Science Portal
Architecture
User’s Web
Browser
Portal Web Server
(tomcat server + java servlets)
GSI
Authentication
Jython
Intepreter
Grid
Notebook
Database
Athena Notebook Demo
Graphical way to submit jobOptions file
1. Log in using GSI credential
2. Select athena notebook from desktop
3. Content pages describing athena and how
to use the notebook
4. Resource management via “Add Resource”
and “Check Resources”
5. Submit job options file via “Submit
Athena Job”
Boston
University
IUPUI
University of
Oklahoma
a) Stage directory
b) Results directory
BNL
Indiana
University
Indiana University
6. Monitor simple status of job (i.e., pending,
active, done)
Demo
• Available via Pacman under grappa-demo
> pacman –fetch –install grappa-demo
• Further information and installation
instructions available at:
http://iuatlas.physics.indiana.edu/grappa
Where next?
• Interface to GriPhyN and other Grid
services (i.e., Virtual Data Language,
Magda, EDG, etc.)
• Only focused on execution management
– (Still can make improvements here)
– Centered around notebook abstraction
• Is this an appropriate abstraction for
data management too?
Grid
Virtual Data Browser
• A browser interface which can be used to
search and create virtual data
• Functionality analogous to that of a web
browser
– Create virtual data (e.g., Netscape composer)
– Navigate virtual data (e.g., point n’ click links)
– Search virtual data (via search engines – Yong
Zhao – U. of Chicago)
– Bookmarks to virtual data (or
transformations)
– User profile – resource mgmt, credential
mgmt, home
Next step
• Write up design specification for VDB
• Probably develop code from scratch
– Jetspeed looks promising
– Keep script functionality
– Replace notebook database with virtual
data catalogs
• Interface to Virtual Data Language
More Information
• Acknowledgements:
– IU Physics
• Rob Gardner, Lisa Ensman, Fred Leurhing
– Extreme Computing Lab
– US ATLAS testbed sites
• Grappa web page:
http://iuatlas.physics.indiana.edu/grappa
• Email: [email protected]