Transcript 24.04._Korenkov_JINR-DubnaGridInitiatives

Grid activities in JINR
&
Meta-cluster of distributed
computing “Dubna-Grid”
Korenkov Vladimir
JINR, Dubna
In 2006 the Joint Institute for
Nuclear Research (JINR) - an
international intergovernmental
scientific research organization
- celebrated its 50-th
anniversary.
JINR Member States
Armenia
Azerbaijan
Belarus
Bulgaria
Cuba
Czech Republic
Georgia
Kazakhstan
Democratic People’s
Republic of Korea
Moldova
Mongolia
Poland
Romania
Russia
Slovak Republic
Ukraine
Uzbekistan
Vietnam
JINR is a large multidisciplinary
scientific centre incorporating:
– basic research in frontier
particle, nuclear and
condensed matter physics,
– development and
application of high
technologies, and
– university education
in the relevant fields
of knowledge.
International Cooperation
AMERICA
REPUBLICS
OF
BRAZIL
BRAZIL
CANADA
CANADA
CLAF
CUBA
UNITED STATES
STATES
UNITED
DUBNA
FORMER USSR
EUROPE
ASIA
AUSTRIA
BELGIUM
BULGARIA
CERN
CROATIA
CZECH REPUBLIC
DENMARK
FINLAND
FRANCE
GERMANY
GREECE
HUNGARY
IRELAND
ITALY
NETHERLANDS
NORWAY
CHINA
DEMOCRATIC
PEOPLE'S
REPUBLIC
OF KOREA
AFRICA
EGYPT
SOUTH AFRICA
INDIA
ISRAEL
JAPAN
MONGOLIA
SOUTH KOREA
TURKEY
VIETNAM
PORTUGAL
SLOVENIA
SPAIN
SWEDEN
SWITZERLAND
UNITED KINGDOM
YUGOSLAVIA
AUSTRALIA
AND
OCEANIA
AUSTRALIA
JINR’s partners are about 700 institutions located in 60 countries
Science Bringing Nations Together
CERN and JINR joint exhibitions:

1997:
1998:
1999:
2000:
2001:
2002:

2003:






2005:
University of Oslo (Norway)
UNESCO, Paris
UN Office in Geneva
European Parliament in Brussels
Russian State Duma, Moscow
Ministry of Education and
Sciences, Bucharest, Romania
Yerevan University, Armenia
Diplomatic Academy, Moscow
University of Thessaloniki, Greece
Thessaloniki
Bucharest
Geneva
Brussels
Moscow
Local Area Network Backbone
At present the JINR LAN
comprises more 6000 computers
and nodes (Gigabit Ethernet)
JINR in the LCG/EGEE Project
-

support and development LCG/EGEE infrastructure;
participation in LCG middleware testing/evaluation,
participation in Data and Service Challenges,
CASTOR and dCache usage/development;
grid monitoring and accounting system development;
EGEE-RDIG portal support and development,
MCDB development;
HEP application;
User & Administrator Training and Education
support of JINR member states in the LCG/EGE activities.
RDIG monitoring&accounting
http://rocmon.jinr.ru:8080
Architecture
www.egee-rdig.ru
DUBNA-GRID
Meta-cluster of distributed computing “Dubna-Grid”
The “Dubna-Grid” Project is aimed at the creation of a
distributed environment of meta-computing on the
basis of vacant computing resources of “office”
computers.
Implementation of the project “Dubna-Grid” will allow:
to create a unified computing environment of the city of Dubna (meta-cluster) on
the basis of the resources of scientific and educational institutions, in particular,
JINR subdivisions, University “Dubna”, secondary schools and other organizations
concerned;
 to create a segment of the international Grid-infrastructure, operating in frames of
various Grid systems (LGG, NorduGrid and OSG). To perform research of control,
security and stability within the Grid environment.
 to provide execution of large-scale computing tasks of JINR and other enterprises
of Dubna scientific – industrial complex and other organizations concerned;
 to distribute experience of creation of the city segment of the Grid-infrastructure
for creation of similar systems in other Russian cities.

Main stages of realization





development of technologies on realization of a separate
administration of office computers and nodes of the Grid
infrastructure on the basis of software shells of virtual
machines
creation of a meta-cluster prototype integrating
resources of various organizations
development of mass installation technologies and
spreading software to all accessible nodes of the city
infrastructure
installation of various Grid systems at the meta-cluster
nodes and accordance of these resources to the users of
other Grid projects such as LCG, NorduGrid, EGEE, OSG.
training of specialists in the field of Grid technologies.
Holding seminars, giving lectures and demonstrations.
Network resources of the Project
City Informational-Educational Computer Network “Dubna”
JINR Backbone
Construction of the system



The Meta-cluster can be interpreted as a cluster, but the computing
resources are distributed over different places. Basically metaclusters are constructed from resources which are specially
provided for it, but the “Dubna-Grid” meta-cluster uses vacant
computer resources of office computers in parallel with their main
purpose.
Dubna-Grid Meta-cluster includes a managed server, a bridge and
computational nodes. Computational nodes represent Virtual PCs
emulated by virtual machine technology (VMware).
By means of VMware we have two computers instead of one, there
are no differences between real and virtual PCs, they both have its
own memory, IP address, processor and etc, but physically they
both use the same resources. Two machines share one processor,
memory, Ethernet card and all of PC devices. As all nodes in the
cluster represent the virtual PCs, we have absolutely a homogenous
environment for building the infrastructure.
Construction of the system
In order to create the computing meta-cluster the following
approaches were used:
 time-shared equipment with common access to the resources;
 common network infrastructure for real and virtual resources and own
additional network infrastructure for virtual resources
 virtual clustering of the equipment.
The following software tools and technologies were used:
 software support for virtual machines maintenance (VMware),
 virtual network (VLAN),
 virtual access to the software and data (AFS),
 building and loading OS images to the Virtual PCs of the meta-cluster
(Warewulf package).
On the central server the following software is installed:
 Scientific Linux CERN OS;
 a package for support of cluster architecture Warewulf;
 Ganglia monitoring system;
 OpenAFS,
 the batch system Torque with Maui scheduler.
Logical scheme
of the “Dubna-Grid” meta-cluster
Conclusion





A distributed meta-computing environment of Dubna
city based on vacant computing resources
(computational, storage) of office computers of
scientific and educational institutions has been
created.
Mass installation technologies and spreading software
to all accessible nodes of the city infrastructure have
been developed
Virtual meta-clusters have been integrated with JINR
batch system
Monitoring system of the meta-cluster has been
developed
First real tasks have been run, including simulation of
ttbar  4m in ATLAS detector
Grid infrastructure in University Centre of JINR
Grid infrastructure is a set of
virtual machines (VMs) running
on physical ones (hosts)
 Virtualisation was made
using User Mode Linux
 current number of VMs is 36
(6 VMs on each of 6 hosts)
 all virtual resources are
grouped into independent
testbeds which in turn can be
used for different aims: system
administrators and users
training in grid field,
debugging and testing custom
grid services in desirable grid
environment

●
Course for system administrators using
Nordugrid ARC middleware, LCG and gLite
was successfully conducted on that
infrastructure
The two major Grid conference in
Russia (Grid2004 and Grid2006), hosted
by Joint Institute for Nuclear Research
in Dubna, has been hailed a success:
- more than 200 participants;
- about 100 reports.
http://lit.jinr.ru/grid2004/
http://grid2006.jinr.ru