Transcript Systems of Systems Observatory

Observatory
System of Systems
MSC
LSST
NVO
Mauna Kea
Observatories
Internet 2
2
Observatory Systems of Systems
OVERVIEW
 Goal:
Leverage astronomical community’s plan to develop a:





synoptic survey telescope
(LSST)
interactive web-based access to massive archival databases
(NVO)
world’s premiere observation site and largest in-place telescope investment (Mauna Kea)
wide-band remote access to telescopes, computing centers, and databases (Internet2)
state-of-the-art high performance computing center
(MHPCC)
into a new model of a system-of-systems observatory that would
generate a dramatic change in both:
how observational astronomy is conducted, and
 what we understand of our universe.

 Request:
$5M in FY-02 to provide developmental funding to capture a ~ $200M out-year program
for Hawaii-based organizations.
 FY-03 and 04 needed funding would be approximately $10M each year to bring the
initiative to fruition.

3
Observatory Systems of Systems
Components
 Systems:



LSST - Large-aperture Synoptic Survey Telescope
NVO - National Virtual Observatory
Mauna Kea family of Observatories  Infrared Telescope Facility
 Canada-France-Hawaii Telescope
 United Kingdom Infrared Telescope
 Keck I & II
 Subaru telescope
 Gemini North


(3.0M)
(3.6M)
(3.8M)
(10M/10M)
(8.3M)
(8M)
(2.2 teraflops)
(bandwidth)
Maui Supercomputer Center
Internet 2
 Observatory
complex system of systems
for which the telescope
and instrument is
only the front-end
MSC
LSST
NVO
Internet2I
(6.5M)
(Petabytes of data)
Mauna Kea
Observatories
4
Observatory Systems of Systems
Concept
Mauna Kea
Field of View
IfA
MSC







LSST - all sky survey
LSST
NVO - archival reference
Internet 2 - nodal connectivity
MSC - change detection, dynamic database
Mauna Kea - rapid & detailed follow-up
World-wide observatories - detailed follow-up
Astronomical Community  professional - off-site participation
 educational - teaching resource
 amateur - database access

Mauna Kea
Astrophysical
Community
IfA - Observatory System of Systems administration
World
wide
Observatories
Merge Astrophysical and Information Technologies
5
Observatory Systems of Systems
LSST - overview
 Parameters Telescope Class Instrument  Data Rate  Data Storage  Cost 

6.5 meter class (50m2 collecting area) , 3 deg FOV
24 magnitude sensitivity, 50,000 x 50,000 pixels
20,000 deg2/week, terabytes/day
1+ petabyte
~$150M, funding - NSF/NASA/other non-government
 Area of Investigation
opens up the field of time-domain astronomy - revolutionize knowledge of
astronomical source that vary or move on short time-scales (e.g. - movies versus
still photos)
 10,000,000,000 objects within grasp, 10,000,000 variable objects expected
 real-time data stream to astronomical community - professional, academic, amateur

6
Observatory Systems of Systems
LSST - knowledge generation
 Asteroids / NEOs
- 90% of 250-meter class within first decade, 100’s/day to be detectioned
- understand the origin, relationships, and fate of small bodies in the Solar System
 Kuiper Belt and Trans-Neptunian Objects-
- 10,000 orbital maps, complex dynamic structure, gross physical characterization
 Planet Search -
- 100,000,000 stars investigated using occultation(gas-giants) and micro-lensing (Jupiter-size) planets
 Super Novas - discover ~ 100,000 year, addresses question of heavy element abundance
 Galactic Halo - low-luminosity White Dwarfs of ~0.5 solar masses
 Dark Matter - synthesize optics, software, high throughput data analysis to image and map non-luminous mater
 Active Galactic Nuclei - construct complete sample of types
 Celestial Archive -
- Transients / temporal dimension- gamma ray burst (rising light curve), eclipsing binaries, lensed quasars,
- Vast new discovery space of optical transients -’ unknown unknowns’
- Digital Sky Map - co-adding repeated scans to generate limiting magnitude of 26.5
- Support observations at all wavelengths via participation in National Virtual Observatory
7
Observatory Systems of Systems
NVO
 National Virtual Observatory:



integration of all major astronomical archives into a interoperable system of
federated multi-wavelength data bases
exploit potential for scientific discovery afforded by LSST and other survey
programs
focus for development of capabilities that do not yet exist
realize full potential of petabyte datasets
establish statistical correlations, discover significant patterns and temporal variations
understand complex astrophysical systems, interactive numerical simulations &
statistically complete multivariate bodies of data
 Tool Sets








processing
~ tera scale
distributed storage
~ petabyte
image libraries
~ 500,000,000 point sources / 1,000,000 extended sources
dynamic range
~ 11 mag
rapid querying of large scale catalogs
real time collaboration
software
Digital Sky & GIOD technologies, XSIL, new computational tools
data analysis visualization
multivariate patterns
grid computing
8
Observatory Systems of Systems
Maui Supercomputing Center
 Computational Characteristics of
Observatory System of Systems:




Tera-byte / night of data
process data-stream in near real-time
detect, characterize, classify objects / events
retrievable achieve - data structures
 Applications:




tuned-change detection algorithms
scaling - data storage of world’s largest non-proprietary database
real-time data mining / farming tool-set
Access-query user-interface & analysis data-visualization aids
 Functions:



Curator of existing data sets
support multiple types of queries
Interconnection to other NVO sites
9
Observatory Systems of Systems
Mauna Kea Observatories
Site Characteristics:
elevation
favorable climatic conditions - smooth Pacific air flow, mountain dryness
 equatorial proximity - northern & southern hemisphere viewing
 provides US astronomers with special advantage - generating leadership position
 significant infrastructure already in place, recent publication of site master plan (w/o
LSST as tenant)


Observation Capability:
- world’s largest observational site, most power collection of optical/infrared and
sub-millimeter telescopes
 ___% of nation’s observation capability

10
Observatory Systems of Systems
Internet 2
 Accessibility - User Explosion:
Professional: front-line astronomers, need breeds of ‘archival’ astronomers
The Public / Educational user
 Amateur


 Tool Set;
vBNS - very high speed backbone network service OC192 / 9.6Gbps
ATM - asynchronous transfer mode
quality of service
GigaPOP regional high performance aggregation points
Middleware Glueworks
Distributed Storage Manoa as Infrastructure anchor point
 Remote Operations GLOBUS
 Virtual Laboratories AURA / SPARC
 Internet of the future 




billions of Internet 2 users, convergence applications, embedded systems, unknown killer apps

Technology availability for critical Observatory System of Systems functions by 2005
11
Observatory Systems of Systems
Systems Concept
 DRIVER:


ability to conduct all-sky survey with high sensitivity instrument
good for IfA areas of inquiry
 ENABLERS:



NVO / MSC / Internet 2
NVO technology/approaches to capturing, warehousing, mining, and disseminating data
MSC - good mission fit, looking for strategic sponsor, currently has cycles-to-burn,
ability to scale-up to LSST/NVO long-term demand
Internet 2 - UH as node
 HARVESTER:


LSST
Mauna Kea Observatories (and others)
ability to convert LSST/NVO alerts into new discoveries
new paradigm for observational astronomy -- near real-time response to celestial
anomalies, vice attempting to predict where they might be observed
12
Observatory Systems of Systems
Technical Issues
 LSST:


site, telescope, instrument/detector, data processing, internal system operation
hardware performance, software performance
 MSC / NVO (SOSO sub-set):
terascale pipeline processing
data acquisition, calibrations/registration, QA, pipelining, archiving, data mining,
data farming, retrieval
 computational hardware / software /


 exchange protocols, cross-correlation tools, metadata standards
 data access layer, query and computing services, data mining, data farming,

data analysis / visualization
 Mauna Kea Observatories:

LSST and Master Plan
 Internet II:

communication architecture
 System of Systems

concept of operations, systems engineering / integration
VBNS, GigaPOP, GLOBUS
13
Observatory Systems of Systems
Funding Issues
 Potential Funding conduits:
 NASA, NSF, DOE
 DoD - Naval Observatory, NRL, AFRL/DE, NRO
 Private
 Near-Term Effort (with Congressional Support):
 bridge funding to jump-start Observatory System of Systems architecture development
 development of A-spec for LSST
 selected technology risk reduction
 Mid-Term (based on historical trends):
 National Research Council - Astronomy & Astrophysics in the New Millennium
 5th in a series of decadal reports
 21 new equipment initiatives based on scientific merit, technical readiness, cost effectiveness
 $4.67B in scope
 SOSO #2 (under combined projects of LSST, NVO, WAVE)
 Trends -
 increase in international projects
 increase in university-based consortia to build and operate midsized-to-large telescopes
 general increase in the size of research groups pursuing large/long-term programs
 NASA - 60%, NSF - 30%, Private - 10+%
14
Observatory Systems of Systems
Cost Issues
Long-term Funded program:
 LSST
 telescope  Instrumentation - EO
 Instrumentation - IR
 Operations ($3M for 10 years)
 NVO/MSC (SOSO/LSST element)
 Software
 Hardware - Computational
 Hardware - Storage ($2M/year)
 Hardware - Visualization
 Hardware - Communication
 Operations ($2M/year for 10 years)
Near-Term Effort (FY-02 through 04):
 LSST: technology development and A-Spec
 NVO/MSC Architecture
$70M
$16M
$20M
$30M
$10M
$5M
$20M
$2M
$3M
$20M
$196
$15M
$10M
Systems of Systems Observatory
Back-up Slides
16
Observatory Systems of Systems
NEO Threat
NEO - Near Earth Object = Asteroids and Comets
extreme case of low-probability events / high-consequence effects
Binzel Report (NAS Astronomy and Astrophysics Survey Committee)
Population:
 > 1-meter,
 > 100-meter,
1,000
150,000
20% discovered
1% discovered
Earth Impact Rate ~:
 1KM
 100m
 >1 m
~ 1 per 100,000 years
~ 1 per 100 years
~ 100,000 kg /day
~ 10,000 MT TNT energy release
~50 MT TNT energy release
Historical Record of Cataclysmic Event
 Cretaceous-Tertiary Extinction (65 million)
~ mass extinction
 Tunguska, Siberia (1908)
~ 50m ~ 10-20MT (>100KM2 devastation)
 Shoemaker-Levy 9
(1999)
 Annual Hiroshima scale energies dissipate in atmosphere (earth shields upto 30-50M)
Bottom-line =
1% chance of severe regional damage in next century
17
Observatory Systems of Systems
New Approach to Astronomy
 in the past, exploratory efforts in astronomy were constrained by the need to
carefully select small samples, we can now imagine exploiting the revolution in
computing and networking to:

- discover patterns revealed from analysis of statistically rich and unbiased image
and/or catalog databases and from application of advanced visualization tools; and,

- deepen our understanding of complex astrophysical systems through
sophisticated numerical simulations with the use of advanced statistical methods

erase old barriers of time and distance in carrying out modern astronomical
observations