Transcript present

WIS data-communication structure
Outcome of study by ET-CTS
(Expert Team on WIS-GTS Communication Techniques and Structure)
Please consider our Earth environment before printing
ICT-ISS (Geneva, 10-12 Nov 2008)
Hiroyuki ICHIJO (Co-chair of ET-CTS)
ET-CTS-1 (Tokyo, 25-28 April 2006)
Outcome
Follow-up discussion
Compiling further
study items
ICG-WIS-3 (Beijing, 5-8 Sep 2006)
Interim
Report
Progress
Report
ET-CTS-2
Process of Study
ICG-WIS-4 (Reading, 4-7 Sep 2007)
Contribution
Outcome
(Toulouse, 26-30 May 2008)
ICM-IMTN (cloud I)
(Washington, 27-29 Oct 2007)
RA VI ROC & Steering Group Meeting
(Vienna, 3-6 June 2008)
VGISC-info & ET-WISC
Follow-up
Discussion
Further discussion
to finalize the outcome
of ET-CTS
(Darmstadt, 10-13 June 2008)
Outcome
ICG-WIS-5 (Brasilia, 14-17 July 2008)
We are here
ET-CTS
Outcome
ICT-ISS (Geneva, 10-12 Nov 2008)
Recommendation
CBS-XIV (Croatia, 25 March-2 April 2009)
Foreword
Cg-XV agreed that the WIS implementation plan has two parts that
would be developed in parallel:
Part A: the continued consolidation and further improvements of
the GTS for time-critical and operation-critical data, including its
extension to meet operational requirements of WMO Programmes
in addition to the World Weather Watch (including improved
management of services);
Part B: an extension of the information services through flexible data
discovery, access and retrieval services to authorized users, as
well as flexible timely delivery services.
Part A :
improved GTS for time-critical and operation-critical data
for all WMO Programmes
1. SWOT analysis of the GTS
Strengths
The GTS is:
a) in operation on a 24x7 basis;
b) functioned well under
interoperation rules;
c) secure as a private network;
d) organized regionally and globally by
sharing roles and responsibility.
e) Necessity of sustainable funding is
well understood.
Weakness
a) Higher total running cost
b) No overall operational management
c) Difficulty in discovery of available data &
arranging delivery
d) Difficulty in organizing traffic between nonadjacent centers & adjusting routing
e) Limited Bandwidth
f) Imperfect achievement in meeting the
requirements of time-critical data exchange
g) Slow in responding to changing user
requirements and technical developments
Opportunities
Threats
a) IMTN and RMDCN demonstrate that
the use of managed data network
services leads to one of successful
evolution ways.
b) Potential for trend from traditional
bilateral to more coordinated
approaches
c) Infiltration of IP migration strategy
d) Range expansion of standardized
TCP/IP based applications
a) Some centers fail to catch up or keep up with
the modernization. As the result, they act as a
brake on progress and incur security risk.
b) Lack of overall traffic management becomes
a problem, e.g. dividing traffic between private
network and the Internet, priority control for
WWW operation-critical and other traffic.
c) Failure to address new requirements leads
WMO members to the use of alternative
networks outside WMO structure.
Key ideas from SWOT analysis
(1) Use of cost-effective managed data network services
through a coordinated approach;
(2) Necessity of overall management for data exchange
operation with security;
(3) New applications taking a place of store-and-forward
mechanism;
(4) Coordination scheme to respond to changing user
requirements and technical developments;
(5) Preparing a remedy for differences between centers in
progress speed.
2. Two strategic options for WIS real-time network structure
Considering the key ideas from the SWOT analysis,
ET-CTS discussed what a desirable goal of WIS data
communication structure could be.
As the result, the team recognized that there could be
two options for a strategic concept, i.e. GMDCN and
AMDCNs.
Global Meteorological Data
Communication Network
(GMDCN)
Area Meteorological Data
Communication Networks
(AMDCNs)
2.1 Global Meteorological Data Communication Network
(GMDCN)
GMDCN
(WIS real-time network
supplied by a single provider)
Evolving GTS
Additional
Meteorological
Networks
Gateway
Conventional
GTS networks
Gateway
Non-NMHS
DCPCs/NCs
Logical concept of GMDCN as the WIS real-time network
•
•
Establishment of a single coordinated global network
composed by initially an evolution part of the GTS, and finally the
greater part of the GTS and additional meteorological networks
2.2 Area Meteorological Data Communication Networks
(AMDCNs)
Conventional
GTS networks
Non-NMHS
DCPCs/NC
s
Gateway
GISC
#1
AMDCN
#1
AMDCN
#2
GISC
#3
Gateway
AMDCN
#3
WIS core
network
GISC
#2
Gateway
GISC
#4
Gateway
Conventional
GTS networks
AMDCN
#4
Gateway
Non-NMHS
DCPCs/NC
s
Logical concept of RMDCNs as the WIS real-time network
•
Each GISC is responsible for managing telecommunication and data flow
in its area of responsibility.
Design principles of AMDCNs based on the key ideas
(1) An AMDCN should be based on a cost-effective network
service appropriate for its area of responsibility.
(2) A GISC should be a control body of its AMDCN, possibly in
cooperation with other GISC(s), for overall technical and
administrative management (e.g. traffic, security, monitoring,
backup arrangement, competitive procurement and contract, funding
coordination and so on) .
(3) New applications taking a place of message switching
mechanism should be developed to ensure sophisticated
communication without serious delay, especially between
any WIS centers overarching AMDCNs.
Design principles of AMDCNs based on the key ideas (cont.)
(4) An AMDCN should keep scalability and flexibility to
respond to new global and regional requirements, and to
introduce new technology.
(5) Gateway facilities/functions and guidelines to promote
the migration to the AMDCN should be provided.
2.3 Recommendable concept for WIS real-time network structure
Comparison between the two options
Options
GMDCN
Strategy
Homogeneous, future-oriented
Heterogeneous, present-based evolution
1. Any-to-any connectivity for all participating
centers
2. Common standard, easier trouble shooting
and reducing technical gaps
3. Easier backup for a GISC failure
1. Use of most appropriate technologies and
services for individual areas
1. Limited choice of global diffusion
technologies and services
1. Seam connections between any centers
overarching RMDCNs
2. Multi-standards, complex trouble shooting
and enlargement of technical gaps
Technical
benefits
Technical
disadvantages
Administrative
benefits
Administrative
disadvantages
1. Unifying contractual body (effective and
intensive activities for a market survey and
contract procedures)
2. Facilitating WIS global collaboration
1. Concentration of all workload and difficulty
for management (necessity of cost-recovery and/or
RMDCNs
1.
2.
Smooth evolution
Manageable scale, earlier consensus
operational resource sharing for a strong management
body)
2. Limited choice of service providers (risk of
higher cost due to less competition)
1.
Risk of uneven GISC management capacity
Feasible but difficult in administrative aspect,
especially to create a management body
Depends on each GISC capability (e.g.) feasible
in some area but not feasible in other
3. Lost of light footwork toward new
technologies and services
Feasibility
Advisory comment from ICG-WIS-5
" A GISC is responsible for co-ordinating with the Centres
within its area of responsibility a WIS telecommunications
infrastructure that can meet the WIS requirements for
information exchange within the area and that can
exchange agreed WIS operational critical and time critical
information with other areas".
Conclusion of ET-CTS after careful consideration
 Feasibility of concepts would depend on the
administrative aspect rather than the technical one;
 The concept of AMDCNs is recommended for the WIS
real-time network, because the GMDCN concept is less
pragmatic;
 Each AMDCN should be composed by network solutions
appropriate for each area. All AMDCNs may be not
necessarily structured on a managed data network service.
2.4 Further study on WIS real-time network structure
(1) Connection with WIS participants other than NMHSs
DCPCs and NCs operated by non-NMHSs are basically
connected with a GISC in their responsible area. There are
two types of the connections as follows:
a) Indirect type by Internet VPN and bilateral dedicated
links through a gateway operated by their GISC or their
associated NMHSs.;
b) Direct type by an additional meteorological connection
through the AMDCNs (future possibility);
Although administrative and security issues should be
coordinated, in the future view non-NMHS participation in
the AMDCNs may facilitate collaboration with other
international community.
2.4 Further study items (cont.)
(2) Backup solution
Backup solution is practically nothing but Internet based
methods in the view of allowable cost for all centers.
Internet VPN solution is desirable.
There is another backup consideration in a GISC failure
case. GISCs should coordinates backup solutions on
alternate GISCs.
(3) Gateway issues
GISCs and major RTHs should act as a gateway enabling
data exchange between the inside and outside of the
RMDCNs.
Each gateway center has responsibility for interfacing with
outside centers and protecting the AMDCNs against
unauthentic access from the outside.
2.4 Further study items (cont.)
(4) Administrative aspect
There are lots of administrative barriers to realize the
AMDCNs on a large scale:
# consensus process of all participants;
# coordinated procurement on one-stop contract manner;
# overall operational management scheme;
# governance body.
Collaboration
Framework
GISC
MoU
DCPC
NC
NC
Contract
with SLA
DCPC
Managed
Network by a
single provider
NC
NC
NC
NC
NC
3. Consideration on individual components
3.1 WIS core network
All GISCs must synchronize large volume of data and
products with their metadata catalogues on a real-time
basis literally through a WIS core network.
 Thus indispensable requirements of the core network
are predictability and stability in available throughput,
reliability and security.
 Not the Internet but closed network services on SLA
(Service Level Agreement) should be used.

IMTN
WIS core
network
GTS
More than 180
centers
Max 18
centers
Less than 10
centers
Full-mesh topology of WIS core network
Full-mesh topology will bring two benefits:
 maximum redundancy in backup channels between GISCs;
 operational simplicity in data synchronization
To realize the full-mesh GISC topology, the IMTN is expected to be
consolidated into a single cloud.
IMTN
cloud II
IMTN
cloud I
Cloud I
Tokyo
Melbourne
Washington
Buenos Aires
Brasilia
Sofia
Moscow
Prague
New Delhi
Exeter
Jeddah
Offenbach
Cloud II
Nairobi
Toulouse
Dakar
IMTN
Beijing
Cairo
IMTN
WIS core
network
Algiers
Current configuration of the IMTN
Consolidation of IMTN clouds and
forming WIS core network
Practical items to study further
(1) Management and coordination scheme
 Management and coordination body may have to be restricted to
IMTN centers or GISCs to keep a light footwork for evolution to an
innovative future network.
(2) Multicast-oriented network
 Considering synchronization among GISCs, the WIS core network
may be designed on multicast-oriented architecture in future.
 IPv6 is a promising opportunity to migrate from unicast to multicastoriented networks. However IPv6 may be premature.
Multicast-oriented
network
Unicast-oriented
network
Duplicated
transmission
GISC
GISC
GISC
GISC
GISC
GISC
GISC
Multicast group
Responsibility
Area
Responsibility
Area
GISC
Practical items to study further (cont.)
(3) Backup solution of WIS core network
 Dual network configuration with a sophisticated routing protocol
may be not necessarily practical from the views of difficulty in traffic
management and cost tolerance.
 The Internet backup would be a promising practical solution.
WIS core network
WIS core network #1
GISC
GISC
GISC
GISC
WIS core network #2
Dual network configuration
GISC
GISC
GISC
Internet
Internet backup
GISC
3.2 Time-critical operational links
(GISC-DCPC, GISC-NC, DCPC-NC)
(1) Links between NMHSs
 To meet requirements in timeliness, the current GTS configuration
should be adjusted so that all hierarchical connections of GISC-DCPC,
GISC-NC and DCPC-NC become more directly.
 Traditional GTS store-and-forward mechanism is functioned well,
but there are operational problems in switching delay, routing
arrangement and format restrictions.
(2) Links between NMHS and non-NMHS (other organization)
 Authorized NCs and DCPCs operated by non-NMHSs are located
outside of the GTS world.
 New links by other telecom means such as Internet VPN and ad hoc
dedicated connections are needed.
3.3 Multicast component


The standard DVB-S multicast technology allows use of off-the-shelf
inexpensive V-SAT equipment. EUMETcast is one of successful
examples.
IGDDS (Integrated Global Data Dissemination Service) is a collaboration
scheme for satellite data and product circulation and is now one of
WIS core components. It is expected that the IGDDS would facilitate
the WIS multicast plan for global coverage.
5. Standardization of protocols and procedures
The team will contribute technical recommendations to
regulatory documentation :
(1) Comparison of VPN techniques (IPsec, PPTP, SSL and SSH)
(2) Differences between WMO standards in Attachment II-15
(Use of TCP/IP on the GTS) and industrial standards
(3) Standard VSAT
6. Governance organization and traffic management

An important aspect is the definition of the governance
structures to control data flows and growth of traffic.

Not telecom supervisors but data managers will control data
flows and growth. Governance of the data exchange needs to
be redefined.
Part B :
for data discovery, access and retrieval services, including
time delivery services
1. Connectivity
Data Discovery, Access and Retrieval (DAR) services with relevant
data management functions have policy principles as follows:
(1) Procedures for managing of access rights, control of data
retrieval, registration and identification of users, etc can be defined,
as and when required;
(2) Anonymous downloading is technically possible, but depends on
whether a NC permits that feature;
(3) DAR mechanisms have no system-inherent features that would
violate international legal frameworks.


To meet the principles, DAR components and connection networks
with necessary protocols and procedures should be based on
universal standards and independent from specific vendor
architectures.
WIS
core network
Discovery, Access and
Retrieval (DAR)
Internet
Connectivity of DAR services
Inevitably DAR services are implemented essentially through the
Internet with HTTP, FTP and other Internet based protocols.
 The WIS core network is expected to support the services with
synchronization of metadata catalogues.

Timely delivery services for data and products based on delayed
mode "push" mechanism are possibly implemented through a
combination of dedicated telecommunication means and of public
data networks, especially the Internet.
2. Authentication and certification
Future study in cooperation with ET-WISC
3. Supporting protocols
ET-CTS will evaluate some protocols through practical tests such as a
collaboration test for blog-based technology coordinated by JMA with
the participation of Australia, China, HK-China, New Zealand, Brazil and
USA.
Tokyo
Blog Server Configuration
SYNOP
TEMP
GSM, GWM
download file
Files
mod_disk_cache
upload file
post entry
get feed
JMA RSMC Server
Apache HTTP
Server
Apache
Roller
mod_deflate
Apache Tomcat
MySQL
Community
Server
Linux
: HTTPS + Basic access authentication + gzip deflate compression
: HTTPS + Basic access authentication + AtomPub
: HTTP
JMA Web Server
WEIO40
Get a html file
periodically
Get files
periodically
Blog Server1
Get a feed
periodically
and then
Get files
Blog Server2
Post an entry
Tokyo
Brasilia
Post an entry
Blog Server1
Internet
Get a feed
periodically
and then
Get files
Blog Server
Conclusion
Part A : improved GTS for time-critical and operation-critical data for all
WMO Programmes
1. The concept of AMDCN is recommended for the WIS realtime network.
2. Each GISC should manage telecommunication and data
flow in its area of responsibility.
3. GISCs and major RTHs should act as gateways enabling
data exchange between the inside and outside of the
AMDCNs.
4. WIS core network should be established on evolution of
the Improved MTN (IMTN).
5. It is expected that two IMTN clouds are consolidated and
provide full-mesh connectivity for GISCs.
Conclusion (cont.)
Part A : improved GTS for time-critical and operation-critical data for all
WMO Programmes
6. WIS multicast-oriented core network based on IPv6 is
promising evolution in the future.
7. Use of Internet VPN is a practical solution for backup of
the WIS core network and for operational links with nonNMHSs.
Part B : data discovery, access and retrieval services, including time
delivery services
1. DAR services are implemented essentially through the
Internet.
2. The WIS core network is expected to support the
services with synchronization of metadata catalogues.
ET-CTS will continue further study on
technical and administrative details.
Thank you for your attention