Transcript current-grid-vietnam

Current State of Grid Computing
Researches and Applications in
Vietnam
Nguyen Thanh Thuy1, Nguyen Kim Khanh1,
Tran Ba Thai2
1Hanoi University of Technology
2Institute of Information Technology
[email protected]
On behalf of the members of the VNGrid Project
International Workshop APAN 24, 2007
1
Outline
• Researches on grid computing in Vietnam
– Centers for High Performance Computing
– Research activities
• Towards a grid infrastructure for Vietnam
– VNGrid project
– The aims
– Planed activities
• Initial results:
– a data grid for meteorology
• Conclusion
2
Grid computing in Vietnam
• Initial step
– since a few last years
– several HPC centers in Hanoi
and HCM City
• Hanoi University of Technology
• Institute of Information
Technology, HCM City
• Vietnam National University,
Hanoi
• Vietnamese Institute of
Mathematics
• HCM City University of
Technology
Centers for HPC
3
Milestones
First
center for
HPC at
HUT
2001
300 GFlops
computing
center at
VNU (max)
2002
Other HPC
centers are
founded
2003
BK Grid
Group at
HUT
2004
First national
conference on
HPC and grid
computing in
HCM city
2005
TEIN2-VN
Project
(Trans-Eurasia
Information
Network)
2006
BioGrid
Group at
IOIT-HCM
VNGrid
Project
4
Encountered Issues
• Not yet HPC centers of Tera Flops
• Not yet a common infrastructure to
connect HPC centers
• Grid computing rests in academic
researches. Not yet large scale
applications.
5
Activities done
• Building grid portals
– BKGrid (HUT)
– Grid iPortal (VNU-HCM)
• Experimenting with applications on
– Meteorology (HUT, VNU-Hanoi)
– Bioinformatics (IOIT-HCM)
• Participating in international grids
– Pragma (IOIT-HCM)
– APGrid (Vietnamese Institute of Mathematics)
6
VNGrid Project
• Financed by Ministry of Science and Technology
•
•
of Vietnam
A two year project, to be finished in October
2009
5 partners in the project
–
–
–
–
–
HUT
IOIT in Hanoi
IOIT in HCM City
VNU in Hanoi
Vietnam Military Technical Academy (VMTA)
7
The aims of VNGrid (1)
• Building a cyber-infrastructure to connect
five partners in VN-Grid
• Deploying advanced grid technologies to
improve the performance
– Resource monitoring and discovering
– Scheduling and brokering
 hard to reach the objective!
8
The aims of VNGrid (2)
• Experimenting grid-based applications on
– Bioinformatics,
– Meteorology,
– Virtual Reality,
– Cryptography.
• Being connected to other grid systems in
the region and over the world
9
Planned activities
• Selecting the common technology solution for
the whole VNGrid
– suitable for the infrastructure in Vietnam
– Via TEIN2
•
•
•
•
Establishing necessary security policy
Developing and deploying some grid applications
Building a VNGrid Portal
Connecting VNGrid to PRAGMA and some others
10
Attended results
• Establishing VNGrid for Grid RD and application
•
•
•
•
community in Vietnam
Assembling separated HPC centers in Vietnam
Reinforcing researches on grid computing in
Vietnam
Towards applying GC in industrial domains
Opening a new opportunity for collaboration
with partners outside Vietnam: HPC, storage and
content resources!!!
11
Apllication 1: Bioinformatics
• Deploying grid technologies for Gene Mapping
(IOIT-HCM)
– Use Haplotype Pattern Mining (HPM), and Density
Based Spatial Clustering of Application with Noise
(DBSCAN) to specify the locations of genetic diseases
• Performing Blast and gene prediction in Grid
computing environment using iGridPortal (HCM
City College of Natural Sciences)
12
Apllication 2: Meteorological
Forecast
• Using agent
technologies to
deploy grid
services
– An agent has
responsible for
calling appropriate
services following
user requirements
BKGrid Portal
Resource Broker Agent
Security
Service
GRAM
Cluster
PBS
Information
Service
MDS 3
Weka
HPC Service
Grid FTP Globus Toolkit
Fedora Core 1
Cluster
PBS
13
Application 2: BKGrid and
Meteorological Forecast (cont)
• Applying the HPC and Grid Computing for
climate forecast (HUT, VNU-Hanoi)
– Deploying the MM5 model
• Exploiting resources on APGrid to run a
model for climate forecast (Vietnamese
Institute of Mathematics)
14
Intial results: data grid for
meteorology at HUT
• Weather forecasting plays an important role in
the society
– for agriculture, commerce, catastrophe preventing,
etc.
• There are different institutions in Vietnam
working on the meteorology problems but the
cooperation is not easy for
– sharing local observation data
– sharing hardware and software resources on
computing weather forecast data
15
A data grid portal for
meteorology
• Building a data grid for sharing meteorological
datasets is a suitable solution in Vietnam for:
– Exploiting resources from different HPC centers
– Providing a central and easy access point to all
meteorological data via a grid portal
– Offering a reliable mean for storing and sharing
meteorological data for research purpose
– Public access to climate forecast website
16
System architecture
`
`
`
`
`
MM5 Modeling System
`
User
Administrator
Http
Users
Grid portal
(gridsphere based)
Data
Grid
`
Locally
meteo-data
`
`
`
HRM Modeling System
Global
meteo-data
Group
GrADS
server
`
`
`
`
`
WRF Modeling System
17
Weather forecast modeling
• Model used for
weather
forecasting: MM5.
• It can be run on a
cluster for the high
performance
18
Deployment of MM5 model
• MM5 model already deployed automatically
in a cluster with 3 datasets each day
– Downloading periodically global meteorology
data from the AVN site
– Combining with local observation data on
modeling
– Configuring easily the modeling process via a
configuration file
– Fault tolerance implemented to make the
service more reliable
19
Data grid services
• Data grid as a virtual container for storing
data and easy access later
• Basic services provided:
– Replicating data in several nodes
– Searching data based on metadata
– Transferring data between nodes
20
Prototype
21
Conclusion
• Grid Computing brings chances to developing
countries as Vietnam. We need:
– Computing Resources and HPC
– Storage Resources and Data in applications,
– QoS networking service.
– Grid tools
– Collaboration
Shortage of resources and only initial steps done, more
co-operations needed!
22
Conclusion
• We would like to join grid computing
communities in
– APAN
– TEIN
23
Thank you very much
for your attention!
International Workshop APAN 24, 2007
24