Transcript IDGF International Desktop Grid Federation

IDGF
International Desktop Grid Federation
RUSSIAN CHAPTER OF INTERNATIONAL DESKTOP GRID
FEDERATION: ACHIEVEMENTS, CURRENT STATE AND
PROSPECTIVES
Mikhail Posypkin
DEGISCO project
DEGISCO is supported by the FP7 Capacities Programme under contract nr RI-261561.
1
PRESENTATION PLAN
 Intro to Desktop Grid Computing
 Desktop Grids in Russia: Current State
 DEGISCO project and International Desktop
Grid Federation
 Russian Chapter of IDGF
 Conclusion
DEGISCO WP4 17/07/2015
2
2
WHAT “DESKTOP GRIDS” ARE
 Use free CPU cycles
 Volunteer computing
Use master-slave
model of distributed
computation
 Major technologies:
 BOINC
 XTREMWEB-HEP
 OURGRID
 CONDOR
 X-COM
 SARD
3
DESKTOP GRIDS BENEFITS
STRONG POINTS
WEAK POINTS
Low-cost: DGs are
leaders in terms of
Flops/$
Reuse of existing
resources
Ease of setup and
maintenance
DGs are “Green”
Restricted area of
application: coarse
grain master-slave
Complex technology
Low w.r.t.
supercomputers
efficieincy
NOT a REPLACEMENT for
SUPECOMPUTERS/SERVICE GRIDS/
CLOUDS
4
DESKTOP GRID ACTIVITY IN
RUSSIA
ISA RAS: OPTIMA@home, DG technology, tools for
performance monitoring, dissemination and user
support
ISDCT SB RAS: SAT@home
KRC RAS: Useful tools (BOINC portal), DG based data
mining, dissemination
BOINC.RU – Russian team of BOINC Volunteers
 Other teams not mentioned here…
5
ISA RAS Desktop Grid
Infrastructure
BOINC Educational
Infrastructure
boinc-edu.isa.ru
BOINC Test
Infrastructure
boinc-test.isa.ru
Based on SZTAKI Desktop Grid Package
DEGISCO WP4 17/07/2015
6
6
BOINC
Production
Infrastructure
boinc.isa.ru,
sat.isa.ru
The Typical Pass
Lots of
(student)
projects
DEGISCO WP4 17/07/2015
Netmax
7
7
OPTIMA@home
SAT@home
OPTIMA@home
 Project OPTIMA@home - a research project
that uses Internet-connected computers to
solve challenging large-scale optimization
problems
http://boinc.isa.ru/dcsdg/
 Institute for Systems Analysis of RAS,
M. Posypkin, N. Khrapov
DEGISCO WP4 17/07/2015
8
8
More than 800 active
hosts connected
9
Communication, dissemination, and
Community management

Tutorials:
1st year: GRID’2010, IT-EDU’2010,DICR’2010,PAVT’2011
2nd year:
IT-EDU’2011, Moscow, December 2011,
GRID’2012, July 2012, Dubna
DEGISCO WP4 17/07/2015
10
10
Communication, dissemination, and
Community management


Exhibitions
– Softool’2010
– Softool’2011
– SIMO Network(Spain)’2011
Talks
1st year: IT-EDU’2010,DICR’2010,PAVT’2011
2nd year:
– IT-EDU’2011 (regular talk)
– PAVT’2012 (regular talk)
– GRID’2012 (regular and plenary + Desktop Grid
Track)
DEGISCO WP4 17/07/2015
11
11
Communication, dissemination, and
Community management
 Courses
– Moscow State University
– Moscow Institute for Physics and
Technology
 Localized material
– Posters
– Flyers
– Russian Chapter of IDGF site:
desktopgrid.ru
DEGISCO WP4 17/07/2015
12
12
SAT@home: Most Successful
BOINC Project in Russia
Project SAT@home – research project aimed
at solving hard combinatorial problems
reduced to SAT problems
http://sat.isa.ru/pdsat/
Institute for System Dynamics and Control
Theory of Siberian Branch of Russian
Academy of Sciences (ISDCT SB RAS)
A. Semenov, O. Zaikin
DEGISCO WP4 17/07/2015
13
13
SAT@home
14
SAT@home: More than 5500 hosts
connected
15
SAT@home: Finds Useful Solutions
16
KRC RAS: BOINC BASED DATA MINING
Based on Partition algorithm , the special BOINCbased software has been developed in Highperformance Data Center of Karelian Research Centre,
RAS (HpDC) for discovering associative rules in large
data sets.
The software performs three stages of
data processing with two points of synchronization.
The software includes a client's software and the
following developed BOINC's services: work
generator, scheduler and assimilator. Also it uses the
single MySQL database to store workunits.
17
OPTIMA@home
DEGISCO FP7 PROJECT
Main objective: Expand European DCIs into ICPC
countries by supporting the creation of new Desktop
grids for e-Science in those countries and in Europe and
by connecting them using the EDGeS bridge technology.
Support applications on this expanded infrastructure,
disseminate, promote and provide training about this
expanded infrastructure and its usage.
DEGISCO WP4 17/07/2015
20
20
International Desktop Grid
Federation





The International Desktop Grid Federation (IDGF)
brings together organisations and persons interested
in Desktop grid computing and related technologies.
Focuses on application developers and Desktop grid
operators.
IDGF is a member organisation that provides services
for its members (legally: participants).
IDGF brings them together, so they can get better
information, documentation and training, a platform
to exchange experiences.
IDGF serves as a marketing channel for its members
DEGISCO WP4 17/07/2015
21
21
The Goals of Russian Chapter





Help Russian research and industry teams to develop,
deploy and maintain their desktop-grid distributed
applications
Maintain DCI infrastructures for our projects and for
other organizations
Provide courses and tutorials on desktop grids and
volunteer computing for Russian academic and
industrial community
Promote Russian BOINC projects
Explain the mission of IDGF and benefits of the
membership
DEGISCO WP4 17/07/2015
22
22
The Future of Russian Chapter




Maintain and improve Web-site desktopgrid.ru
Dissemination activity:
• Tracks
• Tutorials
• Courses
• Papers
Create “Umbrella” project for Russian BOINC
applications
International collaboration
DEGISCO WP4 17/07/2015
23
23
The Future of Russian Chapter

Joint Activity (development)
• BOINC Web-portal (easy application deployment
and job submission)
• Scientific Gateways
• Supporting interoperability: Bridges
• Messaging service for BOINC
• Alternative DG systems
• ….
DEGISCO WP4 17/07/2015
24
24
25
IDGF
International Desktop Grid Federation
http://
desktopgridfederation.eu
Globe adapted from
http://upload.wikimedia.org/
wikipedia/commons/f/fa/
Globe.svg
26
WP2: Service grid infrastructure
EGI Grid site: RU-ISA-CGTDC
27
http://grid.isa.ru
WP3: Application and User
Support
 ISA RAS support local developers from
– Institute for System Dynamics and Control
Theory of Siberian Branch of Russian
Academy of Sciences
– Moscow Institute for Electronic Technology
(MIET)
– Joint Institute for Nuclear Research
DEGISCO WP4 17/07/2015
28
28
WP2: 3G-Bridge Infrastructure
3gbridge.isa.ru
29