Transcript ppt - JVO

Japanese Virtual Observatory Project
Masatoshi OHISHI, Yoshihiko MIZUMOTO, Naoki YASUDA, Yuji SHIRASAKI, Masahiro TANAKA, Satoshi HONDA (NAOJ) and
Yoshifumi MASUNAGA (Ochanomizu Univ. and NAOJ) in Collaboration with Fujitsu Ltd.
Contact Address: [email protected]
Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project
since April 2002. JVO utilizes the Grid technology to combine several remote computational resources. We have defined the
query language for the JVO to federate multiple astronomical databases and constructed a prototype of the JVO to confirm
whether federated databases can be accessed through Grid technology. More information is available at:
http://jvo.nao.ac.jp/
JVO Prototype Ver 1.
Main Control Window
Column attributes are displayed by
pushing the “column_info” button, where
you can also control the column layout.
Open a JVO QL Editor
Write JVO QL here or
use an editor.
The query result is shown up in a result page, which is
a kind of VOTable viewer and provides an easy access to
both the table and image data. For graphical viewing of
the table data, plotting tool is available. You can specify
any column or expression for X/Y axis.
The current JVO prototype can
communicates with four distributed
database, “Subaru Deep Field i’-band”
(SDF-i’), SDF-z’, “Subaru XMM Deep
Survey” (SXDS), and 2MASS.
A main control window provides you to specify a query in JVO Query Language. You can
save/load the QL in a file with the Export/Import button. A QL editor is opened by pushing
the editor button and provides an easy way to specify search conditions.
The JVO system splits the user input query into pieces of queries for each database, then
issues search commands to appropriate servers through a “globus-job-submit” command
of Globus Toolkit.
Three-Tiered Design of the JVO Prototype I
UDDI server
Service
Registry
JVO
Portal
Virtual Observation
execution service
Globus
Toolkit V2
Astronomical Catalog
Query Service
Globus Toolkit
Security mngmt Resource mngmt Data management
JVO GRID Environment
Other GRID Environment
Service
Globus Toolkit
Registry
Security mngmt Resource mngmt Data management
Data Archive
Service
Data manage
DB
Data Base server 1
User operation Window
Catalog DB
MVC
1. Adoption of Globus
Toolkit 3 (OGSA),
Data
Data Analysis
service
Other VO services
Other Catalog
services
The first version of
JVO prototype has
been completed. The
design of the JVO
prototype is shown as
a schematic diagram.
We adopted to use
the Globus Toolkit 2
for our prototype.
However, we also
take into account the
Web Service concept
which is included in
the Globus Toolkit 3.
At the beginning, researchers provide the JVO with simple instructions how they plan to use their own
''Virtual Observation''. The JVO portal interprets them and generates a work flow through consulting the
UDDI servers, where available JVO services are registered. Based on the work flow, built-in or userdefined services are called. The GRID framework is used for dynamical assignment of distributed
resources according to their availabilities. Execution results of the work flow are transferred through
GridFTP and presented to the researchers.
Distributed Resource manager
Registry
3. Simple user interface
for making a query,
showing the result, and
so on..,
Status display
Distributed processing
control
Search criteria Window
・Search DAISGR
・Parse GWDSL
・Preparation, Execute
・Confirmation of results
Status monitor
Data storage
Status monitor Window
5.
データベースサーバ２
GWSDL
Image
management
PostgreSQL
DB
WSDL
Globus
Toolkit V3
データ数count
Linux
Web Server
Globus Toolkit V3
SUBARU
SupCam
i-band
Globus Toolkit V3
Analysis services
Query request
Analysis server
Linux
Analysis services
Linux
Data base server N
Data query services
PostgreSQL
WSDL
the
Data number count
Analysis request
Make
schedule I
Results Window
JVO-QL parse server
X match
OGSA-DAI
Globus Toolkit V3
Solaris8
User DB server
GT3
Query request
Solaris8
user
data
Road Map
2001
JVO project start
2002
Development
of Prototype I
2003
Development
of Prototype II
Image
management
DB
Analysis services
Windows,
Solaris8, Linux
Integrated
data
analysis services.
Make schedule
II
Globus Toolkit V3
Web Browser
2004
2MASS
画像管理
DB
OGSA-DAI
User management
Registry search
ORACLE
Data number count
データ検索処理
OGSA-DAI
X match
Portal servlet
Query Results
Federation of
distributed DBs,
DAISGR
Portal Server
Query request
4.
Resource
Manager
Globus Tk
2. User management,
OGSA
-DAI
Security
Manager
Data query services
Gb Ether
Viewer
for JVO
User’s own
service
We are designing the JVO prototype II, which is an extension of the prototype I
and incorporates functions required in the practical system. Followings will be
newly implemented or improved on the prototype II:
Federation of distributed DBs
Researcher
MVC
MVC
Design for Prototype II
Gb Ether
Web
Browser
Browser
for JVO
Services
callable
Webブラウザ
through Grid
This example shows a demo doing a cross-matching search between the two databases
SDF-i’ and SDF-z’. At first a search command is issued to the SDF-i’ database server,
mizu-g, then the result is transferred to the SDF-z’ database server, minazuki-g, where
cross-matching search is executed. Image requests are issued at the last two steps.The
query results are transferred through GridFTP in a VOTable format for table data and in
FITS for image data.
2005
Development of
Practical Systems
2006 .
Experimental
service start
SUBARU
SupCam
z-band