Transcript ELV_20050826_a

High Data Volume
Transfer Issues at NOAA
Christopher D. Elvidge
Earth Observation Group
National Oceanic and Atmospheric Administration
National Geophysical Data Center
Boulder, Colorado
August 26, 2005
[email protected]
NOAA’s Vision and Mission
•
VISION – An informed society that uses a comprehensive
understanding of the role of the oceans, coasts, and
atmosphere in the global ecosystem to make the best social
and economic decisions.
•
MISSION – To understand and predict changes in the Earth’s
environment and conserve and manage coastal and marine
resources to meet our Nation’s economic, social, and
environmental needs.
2
Benefits of Satellite Earth
Observations
Energy
Resources
Human Health &
Well-Being
Weather Information,
Forecasting &
Warning
Terrestrial, Coastal
& Marine
Ecosystems
Water Resources
Natural & Human
Induced Disasters
Sustainable
Agriculture &
Desertification
Climate Variability &
Change
Biodiversity
3
NOAA’s Current Satellite Observing Systems
• Polar-orbiting Operational Environmental Satellites (POES)
~10 GB per day.
• Geostationary Operational Environmental Satellites (GOES)
~ 10 GB per day.
• Defense Meteorological Satellite Program (DMSP) ~ 8 GB
per day.
4
NOAA’s Future Satellite Observing Systems
•
NPOESS Preparatory Project (NPP) ~4 TB per day 2008- 2012.
•
National Polar-orbiting Operational Environmental Satellite System
(NPOESS) C1 ~4 TB per day 2010-2015.
•
National Polar-orbiting Operational Environmental Satellite System
(NPOESS) C2 ~4 TB per day 2012-2017.
•
National Polar-orbiting Operational Environmental Satellite System
(NPOESS) C3 ~4 TB per day 2014-2019.
•
Geostationary Operational Environmental Satellites-R (GOES-R) ~ 2
TB per day 2012-2017.
5
Projected NOAA Data Holdings By Year
6
The NOAA Comprehensive Large Arraydata Stewardship System
(CLASS) will be the long term archive for
the data from these systems, providing
data access for the scientific community.
Hardware and Network Design
• CLASS will have three operational sites (NGDC, NCDC, and NASA
IV&V)
• CLASS will have a centralized development environment and a
centralized integration and test environment at NSOF
• CLASS will use a Multi-protocol Label Switching (MPLS)-based
peerless IP network used for site to site communication
• New hardware and network architecture
– Implemented by January 2006
– Modular, scalable, and redundant
– Addresses security requirements
8
CLASS Multi-Site Configuration
AIX Nodes
Web Servers
DMZ
CISCO SYSTEMS
CISCOSYSTEMS
Asheville
Data Provider
(e.g., IDPS)
DMZ
DMZ
CISCOS YSTEMS
MPLS
Web Servers
Web Servers
CISCOS YSTEMS
Boulder
Suitland
AIX Nodes
Fairmont
AIX Nodes
CISCO SYSTEMS
DMZ
Web Servers
Cisco 7606 Router
CISCO S YSTEMS
Cisco 6509 w/ FWSM
AIX Nodes
OC-12
SX-MM Fiber
Copper GE
9
CLASS Distribution Process
10
NGDC will have direct access to the NLR
via the Front Range GigaPop for use in
delivering data from CLASS
11
The Data Hog?
The Visible-Infrared Imaging Radiometer Suite
(VIIRS) will fly on NPP and each of the NPOESS
satellites.
Raw data (RDRs) from a VIIRS will run 116 GB
per day.
Radiance calibrated geolocated data (SDRs) will
tilt to 815 GB per day.
Environmental data records (EDRs) will bulge
towards 2 TB per day.
12
The Challenges
Moving the data within NOAA - from the Suitland
to the CLASS nodes.
Providing simple, useable tools to establish and
manage large volume data subscriptions.
Transferring large volumes of data to the users,
including those in the APAN region.
MAFFIN, Chiba U., U. Tokyo, Tokoku U. in Japan
have expressed interest in receiving global VIIRS
data!
13
Thanks for Listening
QUESTIONS?
14