Transcript Mobile Analyzer A Distributed computing platform

Mobile Analyzer
A Distributed Computing Platform
Juho Karppinen <[email protected]>
Helsinki Institute of Physics Technology Program
May 23th, 2002
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (1)
Overview
• Distributed computing platform
• Designed for need of high energy physics
• Can be used to analyze vast amounts of
data stored in a distributed fashion
• Agent based concept
• Implemented using Java
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (2)
Basic idea
• User provides java code and description of
needed data
• Data is found automatically using
intelligence implemented to LDAP
directories
• Agents (analysis code) are sent where the
data is and executed
• Only status messages and results are sent
back
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (3)
Architecture
Resource information server
User supplied data
The code to run and a
description of required
data
public void processEvent (Event e)
{
if( e.getColumn( RMC ))
…
}
Runs “yellow pages” for needed
resources
LDAP
Data ranges to process:
10..100, 500..1600
Client computer
gives access point
Server 1
Client
Network
Proxy
Proxy server(s)
Autonomous job dispatching,
result saving and status
monitoring
Server 2
Server 3
Analysis servers
Computers which have
data and computing power
for users
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (4)
Technology overview
• Uses Grid Security Infrastructure for
security and authentication
• Agents uses Java Analysis Studio –
interface with some modifications
• Supports JAS compatible data sources
and custom ones, like Objectivity
• Uses own XML-based agent platform for
communication
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (5)
Benefits
• Supports truly heterogeneous hardware
environments (Solaris, Linux, Windows, ...)
• Uses existing Java Analysis Studio and
GSI -interfaces
• Reduced workload for the user as the data
location does not need to be known
• Not only restricted to physics analysis.
Agents gives lots of possibilities, ex realtime graphical cluster status monitoring.
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (6)
Current status
• Support for off-line execution of jobs
• Can access private networks or clusters
through proxy server
• Integration with CMSIM through
GridPortal, allows automated verification
of results right after simulations are
finished
• Command line utilities
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (7)
Conclusion
• Mobile Analyzer has lots of potential in
future. Be aware!
• More information
Demonstration during breaks
or
http://wikihip.cern.ch/twiki/bin/view/Globus/MobileAnalyzer/
Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (9)