Transcript 発表資料 - JVO
Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan and Sokendai [email protected] 2003/11/27 CVO Meeting in Beijing Collaborators NAOJ Y. Mizumoto N. Yasuda Y. Shirasaki M. Tanaka S. Honda Ochanomizu U. Y. Masunaga Osaka U. S. Shimojo & his team Titech S. Matsuoka & his team 2003/11/27 Fujitsu Ltd. K. Monzen K. Kawarai Y. Ishihara H. Yanaka Y. Yamaguchi M. Ishida N. Saito K. Abe J. Tsutsumi H. Nakamoto Y. Morita CVO Meeting in Beijing Ken Miura Large Telescopes of NAOJ Subaru (optical & Infrared) @ Hawaii Nobeyama (Radio) single dish : f 45-m interferometer : 6 x f 10-m solar interferometer : 84 x f 75-cm HALCA – in orbit f 8-m 2003/11/27 CVO Meeting in Beijing Subaru 2003/11/27 CVO Meeting in Beijing Subaru Telescope 2003/11/27 CVO Meeting in Beijing 2003/11/27 CVO Meeting in Beijing 2003/11/27 CVO Meeting in Beijing 45m Radio Telescope 2003/11/27 CVO Meeting in Beijing 2003/11/27 CVO Meeting in Beijing VSOP 2003/11/27 CVO Meeting in Beijing JAXA is going to join JVO !! Infrared Satellite by JAXA Launch : 2005 ? 2003/11/27 CVO Meeting in Beijing Data Productivity Nobeyama Radio ：~1TB/yr Subaru@Hawaii ：~20TB/yr ALMA（planned） ：~PB/yr Flood of excellent data (survey data) Digitized & Archived 2003/11/27 CVO Meeting in Beijing 10 Gbps 2003/11/27 CVO Meeting in Beijing HPC + High Speed NETWORK +GRID Technology → it is possible to federate multiwavelength-DBs and computing facilities for data analyses → Virtual Observatory 2003/11/27 CVO Meeting in Beijing JVO prototype : Ver. 1 Establish seamless access to federated DBs by using the Grid technology Define JVO Query Language, and implement its parser Test environment is in a closed subnet 2003/11/27 CVO Meeting in Beijing 2003/11/27 CVO Meeting in Beijing Monitor Window: Refreshed automatically in every 15 seconds Dynamical creation of a workflow 2003/11/27 CVO Meeting in Beijing Sample Outputs 2003/11/27 CVO Meeting in Beijing Redhat Linux JVO Prototype System Architecture GSDL UDDI Maintenance Tool JVO Client Apache Tomcat Netscape Communicator JVO Service (X match) Maintenance Tool UDDI4J soapuddi Apache ＳＯＡＰ ① Applet DownLoad Globus Toolkit (Server) Java2SE 1.4 Java2SE 1.4 Hypertext contents Redhat Linux JVO Service Gb Ether Solaris8 (Possible at Linux) JVO Controller UDDI Registory / Servlet Engine 2Mass DataBase JVO Service (select) • register • update • delete JDBC SQL library Java2 Plugin JVO Client (applet) ③ Find Service ② Request Observation JVO Controller DB Service Java2SE 1.4 PostgreSQL (DBMS) UDDI4J • • • • Image Data SUBARU SupCam z-band UDDI Data get & parse GSDL pre condition check execute Service post condition check ⑤ execute Service ⑤’ execute Service Internet ③ get GSDL Check status ④’ Get GSDL by GridFTP ⑥’ spawn Service GridFTP SQL library JVO Service (select) SQL library JVO Service (image) Image Data 2003/11/27 GSDL ⑥ spawn Service JVO Service (count) Free Software In House Software Commercial Software Function JVO Service (image) JVO Service (X match) Globus Toolkit (Server) Globus Toolkit GSDL Globus Toolkit (Server) JVO Service SUBARU DataBase SUBARU DataBase JVO Service ⑦ issue SQL GSDL (copy) ④ Get GSDL by GridFTP AVO 2Mass DB Redhat Linux Globus Toolkit (Client) NVO PostgreSQL JVO Server Monitoring Globus Toolkit DB Service Image Data (copy) JVO Service (X match) Image Data (copy) The following free software is included by globus toolkit. • OpenSSL (Secure Socket Library) • OpenLDAP (LDAP Server) • wu-ftpd (ftp server) CVO Meeting in Beijing JVO Service (select) SQL library JVO Service (count) SQL library ⑦’ issue SQL Copy imate data by GridFTP Copy imate data by GridFTP Image Data (copy) Image Data DB Service ORACLE SUBARU SupCam i-band JVO Query Language create view myEROtable as select s.Bmag, s.Rmag, t.Hmag, t.Kmag, ..., sr.BOX(POINT(s.ra,s.dec),w,h) as Rimage, tk.BOX(POINT(s.ra,s.dec),w,h) as Kimage, ... from SUBARU s, 2MASS t, ..., SUBARU.R sr, 2MASS.K tk, ... where XMATCH(s,b,...) < 3 arcsec and (s.Rmag-t.Kmag) > 6 mag and BOX(POINT(ra0,dec0), w0, h0) 2003/11/27 CVO Meeting in Beijing and ... Create view with the user specified name in JVO system. Select attributes from each catalog server. Column names can be expressed in UCD. Select cutout images from each image data server. Image area can be specified by BOX or CIRCLE operand. Select the catalog server. Select the image data server. Cross-match distributed catalogs. Query condition based on distributed catalog. Specify search area with the same syntax as cutout image specification. SkyQL & ADQL JVOQL has been adopted as one of the basis for SkyQL (standard query language in IVOA) XML description of SkyQL = ADQL Astronomical Data Query Language 2003/11/27 CVO Meeting in Beijing Serious Issue Q) GT2 has too large overhead before starting actual jobs !! They are several seconds. A) For batch jobs, such as database accesses, the overhead could be negligible. However users can never wait for several second for interactive data analyses. Request) Overheads must be < 0.1 seconds excluding the network delays. 2003/11/27 CVO Meeting in Beijing Partially solved !! Introduction of NMI -- authentication module : binary Analysis of the source codes of GTK2 -- polling interval : 30 sec -> 3 sec Elapsed time was halved ! But …, still very slow. 2003/11/27 CVO Meeting in Beijing Improvement of U.I. Need to know about SQL to use JVOQL → An editor to create JVOQL from GUI Edittable on screen → more flexibility for advanced users 2003/11/27 CVO Meeting in Beijing 2003/11/27 CVO Meeting in Beijing Search for Gravitational Lenses caused (?) by Cosmic Strings SXDS data observed by Subaru Query results were obtained less than 5 min., displaying SEDs It has been proven that VO can accelerate researches. 2003/11/27 CVO Meeting in Beijing Cosmic Strings? Theoretical origin of the elementary particles which existed (?) at t ~ 10-35 s， T ~ 1015 GeV Not a POINT, has its SIZE Width < 10-22m, Length ~ size of the Universe. Mass of 10km string ~ the Earth 2003/11/27 CVO Meeting in Beijing Gravitational Lens A phenomenon that the space-time is distorted by a huge mass object, and multiple images of another object behind the massive object are observed around it. 2003/11/27 CVO Meeting in Beijing 2003/11/27 CVO Meeting in Beijing Development of Prototype2 For preparation of Operational System User registration : single sign-on User area over Firewall : GSI-SFS Adoption of OGSA Implementation of several analysis tools 2003/11/27 CVO Meeting in Beijing データベースサーバ１ 利用者操作画面 OGSA -DAI ｾｷｭﾘﾃｨ 管理 Registry 資源管理 DAISGR Globus Tk ポータルサーバ 統合検索指示 統 登録情報検索機能 ﾎﾟｰﾀﾙｻｰﾌﾞﾚｯﾄ 合 利用者管理機能 検 分散処理制御 統合検索状況モニター ・DAISGR検索 ・GWDSL解釈 ・準備、実行、結果確認 データ保存 検索状況モニター画面 実 行 制 御 Web Server 統合検索結果表示機能 Globus Toolkit V3 機 能 解析指示 ｽｹｼﾞｭｰﾙ 作成 Ⅰ FW JVO-QL翻訳ｻｰﾊﾞ Webブラウザ Windows, Solaris8, Linux 2003/11/27 ｽｹｼﾞｭｰﾙ 作成 Ⅱ Globus Toolkit V3 検索結果画面 結果サーバ GT3 利用者 CVO データ GSI-SFS ORACLE データベースサーバ２ GWSDL Solaris8 PostgreSQL WSDL 2MASS Local disk 画像管理 Globus Toolkit V3 データ数count DB GT3 利用者 クロスマッチ処理 Linuxデータ OGSA-DAI GSI-SFS SUBARU SupCam i-band Globus Toolkit V3 解析処理 Local disk 検索依頼 解析サーバ Linux GT3 利用者 データ GSI-SFS 解析処理 Linux データベースサーバ N データ検索処理 PostgreSQL WSDL データ数count 画像管理 DB クロスマッチ処理 OGSA-DAI Globus Toolkit V3 解析処理 検索依頼 Meeting in Beijing 画像管理 DB データ数count データ検索処理 OGSA-DAI 索 状況表示 条件指定画面 Gb Ether Gb Ether 分散情報管理 データ検索処理 SUBARU SupCam z-band Local disk GT3 利用者 Solaris8 データ GSI-SFS Road Map 2003 Prototype 2 → development of components for operation 2004 start to develop operational system late 2004 ?? trial use 2005-2006 trial use & upgrade 2007 prepare for partial operation of ALMA 2003/11/27 CVO Meeting in Beijing ALMA in Chile (sub-mm wave) 2003/11/27 CVO Meeting in Beijing