Transcript pdf - AstroGrid-D

AstroGrid-D and (GA)VO
2006-11-15, Garching
Overview
• VObs/IVOA
• GAVO I + II
• Synergy with AstroGrid-D ?
2006-11-15, Garching
Virtual Observatory I
• Broad goal
– Make results of astronomical research, data
and applications, more readily available to
larger community, and create value-adding
services.
• Facilitate results– communication
– checking
– (re)use
– comparison
– combination
2006-11-15, Garching
Combination: a multi-wavelength view of a
galaxy merger
Radio
Optical
X-Ray
John Hibbard
http://www.cv.nrao.edu/~jhibbard/n4038/n4038.html
NASA/CXC/SAO/G. Fabbiano et al.
2006-11-15, Garching
the problem
FIRST
ROSAT
2MASS
2006-11-15, Garching
GAIA
SDSS
work on a solution
FIRST
ROSAT
2MASS
2006-11-15, Garching
GAIA
SDSS
Virtual Observatory II
• Approach:
– online availability of datasets and applications
– standardized publication and discovery mechanisms
– standardized description through common
(meta-)data models
– standardized selection mechanisms
– standardized formats for transmitted data
– value added services
– introduce new technologies
– find clever algorithms
• Organized in International VO Alliance (IVOA)
2006-11-15, Garching
2006-11-15, Garching
Some Results
• Data formats:
– VOTable
• Data models for
–
–
–
–
–
Resource metadata (registry)
Space-time events: STC
Characterisation
Spectral data model
VOEvent
• Protocols
–
–
–
–
Simple cone search (not a standard!)
Simple image access
simple spectral access
VOQL (ADQL/SkyNode)
• Applications:
– Aladin, VOPlot, TOPCAT, SpecView, Plastic
2006-11-15, Garching
Grid activities in VObs
• IVOA Grid and web services working
group (html)
– Authentication
– Universal Worker Service
– VOSpace
• Astro-RG in GGF (Nic Walton)
• Euro VO DCA WP 5
• GAVO I (Gadget simulation, cluster finder)
2006-11-15, Garching
GAVO II
• Since July 2007
• Organisation (5 FTEs)
– AIP
– ARI (PI)
– MPE
– Tübingen
– TUM-Informatik
2006-11-15, Garching
GAVO (I + II) projects
• Archives:
– ROSAT All Sky Survey
• cone search: photons, sources
• SIAP: fields
–
–
–
–
RAVE web site
SSA on CDFS optical follow up spectroscopy
Heidelberg catalogues and GAVO archive
ROSAT pointed observations: SIAP
•
•
•
•
standardised approach to publish FITS images under SIAP
uses FITS metadata repository (SQLServer)
SQL based mapping and SIAP implementation
easily generalised to other datasets and protocols (SSA)
• Data mining
– Cross-matcher (also on Grid, TUM)
– SED classifier
– Cluster finder
2006-11-15, Garching
GAVO (I + II) projects ctd.
• Grid
– evaluation Globus
– Gadget 2 on Globus MPI (AIP + MPE)
– cluster finder
• VOQL/SkyNode
– VOQL tiger team (Benjamin Gufler)
– HiSbase peer-to-peer approach
– Mock catalogues for testing
• Theory
– IVOA:
•
•
•
•
Initialised Theory Interest Group (chair)
SNAP
Data models
Semantics
– Millennium database
– Virtual telescopes (planck, MoMaF2, Dolag)
2006-11-15, Garching
GAVO + AstroGrid-D I
• Groups involved in both projects: AIP, ARI,
MPE, TUM
• Different kind of use cases:
– VObs aims to enable external users to use
resources
– Heterogeneous world: Interoperate with
resources outside of AstroGrid-D (but within
IVOA standards)
2006-11-15, Garching
GAVO + AstroGrid-D II
• Possible projects
– Virtual telescopes
– VOEvent and Robotic Telesopes ?
– IVOA Registry vs Information Services
– Input welcome !
• Definitely
– SNAP implementation
– OGSA-DAI access to Millennium DB
2006-11-15, Garching
SNAP using grid services
• Simple Numerical Access Protocol
–
–
–
–
Project of IVOA theory interest group
Based on simulation data model (input welcome !)
Query interesting simulations
Select and retrieve subset
• Implementation: SNAP on Millennium snapshots
– Custom access code deployed near large datasets
– Authenticated access
– Standardised publication for use in Grid workflows
(ProC? Streaming?)
– Data staging and movement
2006-11-15, Garching
Globus container
SNAP
web service
Grid Service
getBox()
C-module
Information
Service
IS aware
Workflow
Engine
2006-11-15, Garching
Millennium
snaphots
Millennium website and OGSA-DAI
• SQLServer database
–
–
–
–
–
halo/galaxy catalogues
density fields (environment queries)
efficient retrieval merger tree histories
spatial indexing
MyDB
• TOMCAT web server
– http://www.g-vo.org/MyMillennium
– authentication using RDB
– wget based access, IDL+R modules
• Synchronous queries
– JDBC, streaming
– 7 min time limit
– I/O problems
2006-11-15, Garching
2006-11-15, Garching
Why Grid interesting?
• Need
– Asynchronous access
• Queuing
• Improve result management, data delivery
– Bulk uploading into MyDB
– More generic authentication (X.509)
• Will try CAS jobs (SDSS/JHU)
• Investigate OGSA-DAI
– Map portal to OGSA-DAI functionality
– Monitoring ? Logging ? Performance ?
2006-11-15, Garching
2006-11-15, Garching
Conclusion
• VObs and Grid complementary
• Plenty points of contact
• Useful synergies easy to find
2006-11-15, Garching