Transcript Review of RMDCN Requirements

RMDCN Requirements
Tony Bakker
Network and Security Section
ECMWF
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 1
ECMWF
Scope
 Current use of RMDCN and other networks between
-
ECMWF
-
Member States and Co-operating States
-
EUMETSAT
 Potential changes related to:
-
Increase in model resolution
-
Observing system
-
New projects
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 2
ECMWF
Current situation
 Main traffic patterns
-
Data dissemination
-
Data acquisition
-
Access to computing resources
-
Access to archived data
 Network infrastructures used are
-
RMDCN
-
Leased line between UKMO and ECMWF
-
Internet
-
EUMETCast
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 3
ECMWF
Access to computing resources and archived
data
 Users from National Met Services can use both RMDC
and Internet
 Users from universities, research institutes, etc. can use
the Internet only
 Internet is the preferred choice for non-critical data
transfers to
-
Avoid impact on operational traffic using the RMDCN
-
Take advantage of available Internet bandwidth
 Although difficult to assess, the future requirements for
network bandwidth are likely to grow with the increase
in the size of data archive
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 4
ECMWF
Data acquisition
 Entry point and first step of the data flow needed for the
operational forecast production
 Daily figures show that
-
1.5 gigabytes received from UKMO (GTS + USA satellite data)
-
2 gigabytes received from DWD (GTS + EUMETSAT satellite data)
-
2.5 gigabytes received via Internet mainly from USA + very limited amount
from Member States and Cooperating States
-
20 gigabytes received via EUMETCast
 RMDCN used for transfers from DWD only
 Amount of data fairly constant in time increasing with the
launch of new satellites and the availability of data from
new instruments
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 5
ECMWF
Data dissemination
 Characterised by an extremely large catalogue
-
Current total volume is 2.3 terabytes
-
Users can request tailored products
-
Large variety of products with very little overlap
-
User can control, at product level, the network used for transfers
 Centred on two peak periods per day (00 and UT) each
lasting 2 to 3 hours
-
In addition, products from BC project disseminated at 06 and 18 UT to the
participating countries
 Time or mission critical data sent over RMDCN or Leased
Line while less critical data (e.g. backup/research data)
transferred over the Internet
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 6
ECMWF
Data dissemination
(continued)
Denmark: daily traffic
Denmark: weekly traffic
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 7
ECMWF
Data dissemination
(continued)
 RMDCN
-
Bandwidth varies between countries
-
“basic package” includes 768 kilobit/s IP bandwidth and 384 kilobit/s ISDN backup
-

Funded centrally for Member States

Co-operating States, EUMETSAT and other RMDCN
countries fund their connection to the RMDCN
Countries are free to increase the available IP bandwidth out of their own budget
according to their requirements
 Appropriate dissemination channel chosen by each
country according to own requirements
-
Some (e.g. Norway) increasingly use Internet to complement RMDCN
-
Others (e.g. France) rely exclusively on the RMDCN
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 8
ECMWF
Data dissemination
(continued)
 Over the last 8 years the volume of data transferred over
RMDCN has increased by a factor of ~20
Daily Dissemination Volume through the RMDCN
45000
40000
35000
30000
25000
20000
15000
10000
5000
0
2000
2001
2002
2003
RMDCN Steering Group, 4-6 June 2008, Vienna
2004
2005
2006
Slide 9
2007
2008
ECMWF
Upcoming changes
 Evolution of model resolution
-
2009/2010: increase from 25km x 25km and 91 vertical levels to 16km x
16km and ~130 vertical levels
-
Therefore, volume of data to be transferred will increase by a factor up to
~4
-
The increase in data volume is expected not to become effective
immediately
-
2015: next resolution upgrade will multiply by ~4 the volume of data
available for dissemination
 New products, larger hindcast sets, etc will further
increase the data volume
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 10
ECMWF
Upcoming changes
(continued)
 Data acquisition
-
Growth will continue to be strongly linked to satellites

METOP-B and NPP are expected to increase data volume by
a factor of 5 to 10

NOAA polar satellites (NPOESS), first in 2013, will require an
increase in the networking capacity with UKMO by 15
 Expected daily amounts for the next 10 years are:
-
22.5 gigabytes from UKMO
-
10 gigabytes from DWD
-
7.5 gigabytes via the Internet
-
60 gigabytes via EUMETCast
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 11
ECMWF
Upcoming changes
(continued)
 Potential new projects
-
The number of Member State projects running at ECMWF are expected to
continue to increase continuing the recent trend
-
Additional time-critical applications with their needs for both acquisition
and dissemination of data may be implemented
-
New projects like GLAMEPS are aiming to use ECMWF as a central
resource
 All these activities will required improved networking
facilities between ECMWF and MS/Co-op States
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 12
ECMWF
Questionnaire
 Expected growth in following areas:
- ECMWF dissemination data
- Future service oriented architecture for ECMWF dissemination
- Other ECMWF traffic requirements
- GTS data
- Other traffic
- Envisaged new traffic
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 13
ECMWF
SLA Requirement
 Mission Critical
-
Managed Network; Dual connection
 High Availability
-
Managed Network; With backup (ISDN)
 Standard
-
Managed Network; No backup
 Best Effort
-
Internet like
RMDCN Steering Group, 4-6 June 2008, Vienna
Slide 14
ECMWF
Summary Responses
Site
Current
connectio
Future
Connection
SLA requirement
RMDCN traffic
n
Finland
768 kbps
1.5 Mbps
High Availability
France
3Mbps
20 Mbps
High Availability / Mission Critical
Germany
2 Mbps
10 Mbps
High Availability / Mission Critical
Hungary
1 Mbps
2 Mbps
High Availability
Italy
2Mbps
10 Mbps
High Availability / Mission Critical
Norway
2 Mpbs
24-100 Mbps
High Availability
Romania
256 kbps
1 Mbps
High Availability
Sweden
3Mbps
4 Mbps
Mission Critical
UK
2 Mbps
27 Mbps
High Availability / Mission Critical
EUMETSAT
2 Mbps
12.5 Mbps
RMDCN Steering Group, 4-6 June 2008, Vienna
Mission Critical
Slide 15
ECMWF