Transcript 2012-0529-FJKPPL-DB-VBx

May 29th, 2012
French – Asia Grid Activities
Dominique Boutigny
Joint FJ / FK Particle Physics Laboratory Workshop
Credits :
Yonny Cardenas
Sylvain Reynaud
History of the French – Asia Grid
The Grid has been one of the major technical project within all the 3 French
– Asia LIAs : FJPPL – FCPPL – FKPPL and to a lesser extent within the
FVPPL (Grid deployment and tutorial in 2007, 2009 and 2011 )
Part of the activity was related to LCG
Another part was related to different projects (often multidisciplinary) and
to computing development :
• Distributed storage
• CPU cycles
• Interoperability tools
After a few years of work it has been decided to build a common French /
Korean Grid infrastructure, then Japan has been added
We now have a functional global France / Korea / Japan / China
distributed infrastructure at the disposal of the LIA projects
May 29th, 2012
Extra services
Storage
GLite / SRM storage system is often not flexible enough to satisfy standard
users' needs
 Considerable expertise at CC-IN2P3 and KEK on iRODS
Deploy iRODS as an alternative Grid storage system
Implement advanced data management policies / data replication
Federation of iRODS systems between KEK and CC-IN2P3 VO sites
Job Management
A DIRAC service will be implemented to facilitate job submission and
reliability
May 29th, 2012
VO Infrastructure
VOMS
CE
SE
CE VOMS
WMS
UI
LFC SE
CE
CE
WMS
CE
WMS
WIKI
SE
A few examples of LIA projects using
the France / Asia Grid
FCPPL :
• Autonomous Cosmic radio detection system : TREND – Use GLite /
iRODS
• Cosmology projects in the framework of the Tsinghua Center for
Astrophysics
FJPPL :
• g-2 EDM project @ JPARC
 Simulation GEANT4
 Data analysis and reconstruction
 Data sharing

Requirements : 26 000 millions of CPU HS06-hours (preliminary
estimate !!! ) – Enormous amount of CPU
May 29th, 2012
A few examples of AIL projects using
the France / Asia Grid
FJPPL :
• Project to setup a data recovery system based on iRODs for
disaster recovery
• See talk from Takashi
FKPPL :
• A lot of activity in 2010 / 2011 on Lattice QCD,
GEANT4 and drug discovery
• Grid tutorials and trainings
FVPPL :
• Analysis of Next Generation Sequence data
• Grid-enabled Drug Discovery
• Generation of Tsunami scenarii
May 29th, 2012
Interoperability tools a.k.a. SAGA
Ideally a standard user wants to have access to "unlimited" computing
resources in a uniform and simple way
The reality is often much more complicated :
• Different middleware
• Different storage system
• Different authentication mechanism
• Grid Vs non Grid (simple batch system)
• Cloud / virtualization
• etc…
A lot of work in France and Japan around the Open Grid Forum standard
SAGA  see Takashi's talk
May 29th, 2012
Supported technologies
Batch SSH
local
SSH
Cream
Unicore6
Genesis II
ARC
BES
wsgram
gLite-WMS
zip
ftp
file
SRB
SFTP
HTTPS
HTTP
iRODS
Unicore6
SRM
gsiFTP
Local catalog
iRODS
SRB
LFC
Data
Globus
G. Legacy
G. RFC820
MyProxy
VOMS
JKS
SSH
Login / pwd
X509
.netrc
Secret Svc
done
InMemCred
9
Physical
Logical
in progress
Security
gatekeeper
Execution
Conclusions
The Grid computing projects are very active within the 3 LIAs
 They are now converging on a global coherent project built around
the French – Asia Grid
This computing infrastructure is fully functional and at the disposal of the
scientific projects. New services will be added to increase the flexibility.
Yonny Cardenas from CC-IN2P3 is providing an efficient support to help
people to port their applications on the Grid.
May 29th, 2012