Transcript SINET3: NII?s new Network

Fall 2007 Internet2 Member Meeting
San Diego, October 8th, 2007
SINET3: NII’s new Network
Shigeo Urushidani
National Institute of Informatics (NII)
1
Evolution of Japanese Academic Networks
 SINET3 is integrated successor network to two academic networks, SINET and
Super-SINET, economically and flexibly providing rich variety of services.
 SINET3 started its operations in April 2007 and completed its migration in May 2007.
‘87 ‘88 ‘89 ‘90 ‘91 ‘92 ‘93 ‘94 ‘95 ‘96 ‘97 ‘98 ‘99 ‘00 ‘01 ‘02 ‘03 ‘04 ‘05 ‘06
2007～
Packet Switching Network
▲1987.1
Internet backbone for more than 700 universities and research institutions
SINET
▲1992.4
Super-high-speed environment for cutting-edge research
Super-SINET
▲2002.1
- Growing traffic and diversified user requirements
- Limited abilities of existing IP routers
- New trend of end-to-end circuit services
SINET3
▲2007.4
2
Service Categories in SINET3
Best Effort
High Priority QoS-guaranteed
 SINET3 emphasizes four service aspects: transfer layer, virtual private network
(VPN), quality-of-service (QoS), and bandwidth on demand.
On-demand
BW-specified L1VPN
Lambda L1VPN
L3VPN
VPLS (QoS)
L2VPN (QoS)
Multicast (QoS)
Application-based QoS
L3VPN
VPLS
L2VPN
Multicast
Multi-homing
IPv4
IPv6
IP (L3)
Ethernet (L2)
Lambda/Dedicated (L1)
3
Multiple Layer Services
 SINET3: integrated network providing all transfer layer services.
 Users can freely choose best transfer layer for their applications.
 It provides economical service provision and flexible network resource assignment
for ever-changing and unpredictable service demands.
Past Networks
User Equipment
IP Router
Ethernet
Switch
Cutting-edge
Device
SINET3
User Equipment
IP network
(Layer 3)
Ethernet network
(Layer 2)
Dedicated line network
(Layer 1)
IP Router
★ Provides all transfer
layer services
Innovative
Integration
Ethernet
Switch
★ Integrated network
Cutting-edge
Device
4
Multiple VPN Services
 For collaborative research activity: closed user group environment (virtual private
network: VPN) is essential for security reasons.
 Users can choose from L3VPN (IP), L2VPN/VPLS (Ethernet), and L1VPN services.
* Virtual Private Network (VPN); Virtual Private LAN Service (VPLS)
Super-SINET
SINET3
IP Router
IP Router
IP-based VPN
(L3VPN)
Secure
Closed User
Group
L3VPN
Expansion
of Services
& Sites
VPLS
L1VPN
Ethernet
Switch
Analysis device
5
L3VPN (IP-based VPN)
 National Institute for Fusion Science (NIFS) utilizes L3VPN services for its
collaborative research with many universities and research institutions.
6
L2VPN and VPLS (Ethernet-based VPNs)
 SINET3 provides two types of Ethernet-based VPNs:
• Point-to-point-based VPN (L2VPN)
• Broadcast-based VPN
(Virtual Private LAN Service (VPLS)).
e.g. Grid computing research
Point-to-point-based VPN
(L2VPN)
e.g. Earthquake research
Broadcast-based VPN
(VPLS)
7
L1VPN (Layer-1 VPN)
 Virtual dedicated lines over shared platform form VPN among specified sites.
 Users can obtain protocol-free and completely exclusive environment.
 National Astronomical Observatory of Japan (NAOJ) utilizes L1VPN to transfer
constantly-flowing ATM cells from remote telescopes through STM-16 interfaces.
 On-demand capabilities will be available soon.
* Asynchronous Transfer Mode (ATM)
e.g. e-Very Long Baseline Interferometry (eVLBI) project
32 m
11 m
32 m
8
Bandwidth on Demand (BoD) Services
 SINET3 provides BoD services as part of layer-1 services.
 Users can specify the destinations, duration, bandwidth, and route option.
 BoD server receives reservation requests, schedules accepted reservations, and
triggers layer-1 path setup.
Web-based Interface
(Destination, Duration, Bandwidth, & Route option)
User
1 Gbps
(13:00-14:00)
On-demand Server
Layer-1 path setup trigger
On-demand layer-1 path
SINET3
9
Service Parameters of L1 BoD Services
 BoD server allows users to specify destinations, duration, bandwidth, & route
option via Web-based interface.
: VPN-A
: VPN-B
Connection Style + Destinations
: Non-VPN
Pre-configured
interfaces
VPN
- Start Time
&
- Finishing Time
(by 15 minutes)
Extranet
Bandwidth
Public
VC-4 Granularity (about 150 Mbps)
GE
GE
STM-64
STM-16
STM-64
10GE
Lambda
Duration
1≤A≤ 7
1 ≤ B ≤ 64
Route Option
- “Minimum Delay”
or
- “Unspecified”
Bandwidth-specified
10
High-level Network Architecture
 High-level network architecture is composed of transport network, adaptive network
control platform, and user-oriented service control platform.
 User-oriented Service Control Platform
- Bandwidth on demand
- Enhanced network security
- Middleware/application coordination
SINET3
BoD Security Middleware
UNI,
API,
GUI
…
Service Control Platform
Dynamic Control
Network Control Platform
User side
IPv6, Multicast, VPN, QoS …
Layer 3 (IP)
Layer 2 (Ethernet/MPLS)
Layer 1 (TDM/Lambda)
 Adaptive Network
Control Platform
- Dynamic resource control
- Resilient network control
- Performance monitoring
 Hybrid Optical and
IP/MPLS Network
- Multi-layer accommodation
- Enriched VPN
- Enhanced QoS
- High availability
- Flexible resource assignment
- 40 Gbps (STM-256) lines
11
Network Structure of SINET3
 SINET3 has two-layer structure with edge and core nodes.
 Edge nodes are edge layer-1 switches with layer-2 multiplexing, which are located
in universities or research institutions and accommodate user equipment.
 Core nodes are composed of high-end IP routers and core layer-1 switches located
in public data centers.
SINET3
SINET/Super-SINET
IP Router
Backbone
Backbone
Router
Core
Node
Core
L1 Switch
Super-SINET/SINET Router
Edge
L1 Switch
With L2 Mux
Edge
Node
SINET
Router
10GE/GE/FE
STM-16
: L3 (IP)
: L3 (IP)
: L2 (Ethernet)
: L1 (Dedicated/On-demand)
12
Network Topology of SINET3
 Has 63 edge nodes and 12 core nodes (75 layer-1 switches and 12 IP routers).
 Deploys Japan’s first 40 Gbps lines between Tokyo, Nagoya, and Osaka.
 Links form three loops in backbone to enable quick service recovery against link
and node failures and for efficient use of network bandwidth.
40 Gbps package
L1 Switch
(NEC UN5000)
IP Router
(Juniper T640)
Hong Kong
Singapore
Los Angeles
New York
: 40 Gbps
: 10 to 20 Gbps
: 1 to 20 Gbps
: Core Node (L1 Switch + IP Router)
: Edge Node (L1 Switch)
Japan’s first 40 Gbps (STM256) lines
13
Accommodation of Multi-layer Services
 L3 and L2 traffic are accommodated in shared bandwidth by L2 multiplexing and
transferred to IP router, where each traffic is encapsulated with MPLS labels as needed.
 L1 traffic is assigned dedicated bandwidth and separated from L2/3 traffic.
 L2/3 (or IP/MPLS) traffic bandwidth can be hitlessly changed by LCAS to flexibly
accommodate multi-layer services.
* Multi-protocol Label Switching (MPLS); Link Capacity Adjustment Scheme (LCAS)
FE/GE/10GE
data IP Ether
data IP VLAN Ether
data
L3
IP Router
data
Ether
IP Router
VLAN Ether
L2
Mux
IP/MPLS
Shared Layer-2/3 traffic
MPLS
data IP
data VLAN Ether MPLS
Layer-1 traffic
L2
Ethernet
Switch
L1
Flow Control
10GE
Hitless bandwidth
change by LCAS
STM64/STM16
Core
L1 Switch
Edge
L1 Switch
Cutting-edge
GE/10GE/
device
STM16
SINET3
IP/MPLS traffic
STM256/STM64
14
Accommodation of Multi-VPN Services
 L3VPN, L2VPN, and VPLS are logically separated by internal VLAN tags and logical
routers. Each logical router exchanges different protocols for each VPN service.
 L1VPN and on-demand services need GMPLS protocols to set up layer-1 paths and
have separate control planes from that of IP routers.
* Generalized MPLS (GMPLS)
data IP or
data
: Logical Router
: Virtual routing/forwarding table
data IP MPLS
VLAN Ether MPLS
IPv4/IPv6 (L3) IP Router
Aggregation
L3VPN (L3)
data IP Ether
L3
IPv4/IPv6
L3VPN
data
L2
L1
Ether
data IP VLAN Ether
data
L2
MUX
L2VPN
VPLS
L1VPN
L1
VPN
Edge
L1SW
L2VPN (L2)
VLAN Ether
VPLS (L2)
Shared Layer-2/3 traffic
Layer-1 traffic
Core
L1SW
L1
VPN
IP/MPLS traffic
GMPLS Control Plane
15
Architecture for BoD Services
 BoD server receives reservation requests, schedules accepted requests, and
triggers layer-1 path setup to source layer-1 switch via L1-OPS.
 Source layer-1 switch sets up layer-1 path toward destination using GMPLS.
 BoD server changes L2/L3 traffic bandwidth by LCAS via L1-OPS as needed.
Front-end
Destinations, Duration, Bandwidth, & Route Option
Layer-1
BoD Server
User
Scheduling
Route
calculation
Path control
Resource
management
Path setup trigger
L1-OPS
Path setup request
GMPLS control and management plane
On-demand
Ethernet
IP
L1SW
GMPLS
L1SW
L1SW
L2
MUX
L2
MUX
Hitless bandwidth
change by LCAS
L1SW
IP Router
IP Router
16
Path Calculation in BoD server
 BoD server calculates best path for route option using two metrics for each link:
delay time and available bandwidth for layer-1 services.
• For Minimum delay, route is uniquely chosen.
• For Unspecified, route that has largest available bandwidth is chosen.
 Available bandwidth for L1 changes depending on traffic volume of L2/L3.
1 Gbps (VC-4-7v)
Fukuoka
L1SW
Hiroshima
L1SW
Kanazawa
L1SW
Kyoto
L1SW
Sapporo
L1SW
0.6 Gbps (VC-4-4v)
VCAT
0.45 Gbps (VC-4-3v)
Matsuyama
Osaka
L1SW
Nagoya
L1SW
Tsukuba
L1SW
Tokyo１
L1SW
Sendai
L1SW
1 Gbps (VC-4-7v)
Route for Minimum Delay
Route for Unspecified
Route for Unspecified using VCAT
Link Bandwidth
L1SW
Tokyo２
L1SW
Available bandwidth for layer-1 services
L2/L3 Traffic Pattern
Mon
Tue
Wed
Thu
Fri
Sat
Sun
17
High-availability Networking Functions
 Multiple loops easily enable multi-layer traffic to be detoured in different directions.
 Layer-1 switches detect link failures very quickly and inform them to neighboring
layer-1 switches and IP routers.
Service
IPv4/IPv6
L3VPN, L2VPN, VPLS
L1VPN, On-demand
No. of users
Very large
Small to medium
Small
Priority of availability
Highest
High
Medium
HA function (normal)
IP route recalculation
MPLS protection
& Fast Reroute
None
HA function (option)
-
-
GMPLS LSP Rerouting
Criteria
Fukuoka
Hiroshima
Kyoto
Kanazawa
IP
MPLS
IP route
recalculation
MPLS
Protection &
Fast Reroute
IP
Matsuyama
TDM
Tokyo2
(option)
GMPLS
LSP Rerouting
TDM
MPLS
Osaka
Hokkaido
Nagoya
Tokyo1
Tsukuba
Sendai
18
Main Features of SINET3 (Summary)
Items
Services
Features
Multiple Layer
• L3 (IP), L2 (Ethernet), & L1 (dedicated/on-demand)
Enriched VPN
• Virtual Private Network for layers 1 to 3
Enhanced QoS
• Support for real-time applications
Layer-1 BoD
• Support for data-intensive applications
Value-added
• Network performance monitoring
Hybrid Network
Architecture
Network
Technologies
Examples
• Hybrid network of layer-1 switches and IP routers
• 75 layer-1 switches nationwide
• 12 IP routers at backbone sites
High Flexibility
• Flexible resource assignment to multiple layers
High Availability
• Fast service recovery owing to multi-loop topology
Large Capacity
• Introduction of Japan’s first STM-256(40 Gbps) lines
NG SDH/SONET
• GFP, VCAT, & LCAS
GMPLS
• RSVP-TE, OSPF-TE, GMPLS-UNI, & GMPLS LSP rerouting
Logical Router
• Logical routers for IPv4/IPv6, L3VPN, L2VPN, & VPLS
Advanced MPLS
• MPLS-based VPN for L3VPN, L2VPN, & VPLS
Fast Detour
• Multi-layer detour triggered by layer-1 switches
19
Schedule
 SINET3 started to provide L3VPN, L2VPN, & L1VPN (static) services, as well as
IPv4/IPv6 dual stack services in April 2007.
 Starting VPLS services soon and layer-1 BoD services in February 2008.
Year
2006
2007
2008
Overlay construction
SINET3
Operation
In operation (01/04/2007)
Migration
Complete (31/05/2007)
IPv4/IPv6 dual stack
L3VPN
SINET3
Services
L2VPN
L1VPN
(static)
VPLS
On-demand
Enhanced
(GMPLS-based)
GMPLS
Today
20
Thank you very much!
21
Backup Slides
22
Multiple QoS Services
 SINET3 provides QoS by identifying applications, VPNs, & physical/logical ports.
 Layer-2/3-based QoS has four priority classes: expedited forwarding (EF), network
control (NC), assured forwarding (AF), & best effort (BE).
 Layer-1-based QoS has smallest packet delay, no delay variance, & no packet loss.
SINET3
SINET/Super-SINET
HDTV
Node
Congestion
Expedited
QoSaware
NW control
Assured
Best effort
Best Effort
 Network congestion affects
all services
Uncompressed
HDTV
End-to-end on-demand path
 Application/VPN/port-based
QoS control
23
Accommodation of Multi-QoS Services
Layer-3/2-based QoS
• User Priority bits of internal VLAN tags are marked at edge L2 MUX.
• User Priority bits are mapped into DSCP (IP) or EXP (MPLS) bits at IP router.
• There are four forwarding classes: EF, NC, AF, & BE.
Layer-1-based QoS
• Layer-1 switches assign end-to-end bandwidth on demand.
Marking User Priority bits
by identifying IP/Ethernet header
data IP
IP
(L3)
data Ether
Ethernet
(L2)
Dedicated
(L1)
Prioritizing
for Ether
IP
L2 MUX
IP VLAN
Prioritizing
for IP
Mapping User Priority bits
into IP DSCP or MPLS EXP bits
EF
User
Priority
based
classifier
NC
AF
Shared Layer-2/3 traffic
BE
VLAN Ether
Internal
VLAN
tag
Identifier
Priority IP MPLS
mapping
for IP
DSCP&
EXP
based
Priority
classifier
mapping
for Ether
Ether MPLS
IP Router
EF
NC
AF
BE
Layer-1 traffic
Edge L1SW
• Smallest packet delay
• No delay variance
• No packet loss
Core
L1SW
24
Functions of BoD Server
 BoD server software is composed of following function modules:
• Front-end functions
• Admission control and scheduling
• Path calculation
• Path control
• Resource management
Layer-1 BoD Server
Database
Front-end
User DB L1SW-DB Path DB Usage DB Route DB Resource DB
Admission Control, Scheduling
User
GUI
IF
(Web browser)
http(s)
- User
Authentication
IF - Session
management
Operator
GUI
IF
(Web browser)
http(s)
- Request Acceptance
- Admission Control, Scheduling
- Database Registration
Path Control
- L1 Path Setup/Release
- IP/MPLS Bandwidth Change
L1-OPS
Path Calculation
- Route Selection
- Link Selection
Resource Management
- L1 Path Management
- L1 Path Monitoring
: Function Module
25