Transcript OC-12 - High Speed Network

Gigabit
Switch Routers
to Scale
Backbones
Sang-won Lee
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
1
Agenda—GSR Optical
Internetworking
• Optical Internetworking Strategy
Networking Trends
Emergence of Optical Internetworking
Requirements for Gigabit Routers
• GSR Technical Overview
• Applications
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
2
Growth of IP Traffic
• E-mail
• Information
search/Access
• Subscription
services/“push”
Rel. Bit
Volume
250
• Conferencing/
multimedia
• Video/imaging
Traffic Projections for
Voice and Data
Data
(IP)
200
150
Voice
100
“From 2000 on, 80% of
service provider profits
will be derived from
IP-based services.”
50
1997
1998
1999
2000
2001
Source: CIMI Corp.
Source: Multiple IXC Projections
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
3
Emergence of a New Network
Model
• Data drives
network investment
• Voice is another data
application
• “Internet” service model
Standards/open systems
computing
Relative
Load
25
20
Data
15
10
Plug and play
5
User defined services
0
1990
Rich application interaction
Data Is 23x
Voice Traffic
30
Data Is 5x
Voice Traffic
Voice
1995
2000
2005
Year
Source: Electronicast
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
4
IP Transport Alternatives
B-ISDN
IP Over
ATM
IP Over
SONET/SDH
IP Over
Optical
Multiplexing, protection and management at every layer
IP
ATM
SONET/SDH
Optical
IP
IP
ATM
SONET/SDH
IP
Optical
Optical
Optical
Lower cost, complexity and overhead
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
5
What is Packet-Over-SONET/SDH?
• Packet-Over-SONET/ SDH is the serial
transmission of data over SONET
frames through the use of Point-toPoint Protocol (PPP).
RFC 1619, “PPP over SONET/SDH”
RFC 1662, “PPP in HDLC-like Framing”
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
6
Benefits of Packet over SONET
• High utilization of WAN
bandwidth
Packet over SONET
provides 98% utilization
• Goodput versus
throughput
Sufficient buffering
for large TCP flows
Congestion avoidance
• Traffic management
Load balancing during
steady-state and
failure conditions
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
Mbit/s
OC-3/STM1 Payload
160
140
120
IP over SONET/SDH
100
80
IP over ATM
60
40
20
0
50
100 200
700 1000
Bytes per Packet
7
SPE Efficiency - Packet over
SONET vs ATM-over-SONET
POS
ether
size
(byte)
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
spe
eff.
%
ATM
spe
eff.
%
64
86.8
43
128
94
69
256
97
75
512
98.6
85
1024
99.3
86
1518
99.5
88
2048
99.6
89
4352
99.8
89
4488
99.8
89
8
Paradigm Shift
Old Requirements
New Requirements
• IP data traffic will be significant,
but only one of many traffic types
• IP data traffic will be predominant
traffic type
• Quality of service can only be
provided by connection-oriented
transport—E.g., ATM
• Quality of service can be provided
by connection-less transport—E.g., IP
• IP Routers cannot scale to gigabit
bandwidths—In performance, port
density or price/port
• IP Routers scale to gigabit bandwidths
and match “Moore’s Law” in performance,
port density and price/port
• Transport above 155 Mbps: ATM or
SONET/SDH only
• Packet (IP) over SONET scales
from 155 Mbps to 2.4 Gbps
with bandwidth efficiency
• Gigabit bandwidth is expensive
or unavailable
0995_03F8_c1
NW98_US_105
• SONET/fiber installations and
deregulation make gigabit bandwidth
available and less expensive and network
services make more efficient use
of available bandwidth
9
New World’s Infrastructure reduces cost
Optical Internetworking
Customer Local
Premise
CO
DS1
Interexchange
~
~
~
Ethernet
OC-48c
WDM
Local Customer
CO
Premise
~
~
~
Ethernet
DS1
OC-48c
OC-48c
OC-48c
• Optimized infrastructure for data services
• Statistical muxing over largest available pipe
• “Flattened” network gives a <10x cost reduction
Cisco Internal Use Only
Proprietary & Confidential
10
Cisco Optical Internetworking
Five-Phase Plan
Phase 5
Extending Optical
to the Edge
Phase 3
SONET/Optical
Integration
Phase 2
Optical in the
Backbone
Phase 1
Gigabit Switching
and Routing
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
Phase 4
Metro and
Interoffice
Solutions
Expand New
Model Outward
Reduce Optical Transmission Costs
• Introduction of ChOC-12/DS3
• Introduction of ChOC-12/STS3
Optimize Data Service Delivery in Core
• World’s First OC-48c Optical Interface
• Partnership with CIENA
• Optical Internetworking Forum
Deliver Data Services Platform
• Cisco 12000 and Cisco 8000
• Packet and ATM over SONET/SDH
• Skystone SONET Acquisition
11
Requirements for Gigabit
Routers in Optical Internet
• Carrier Class Availability
• Scalable Performance
• Scalable Network Services
• Integration with SONET/SDH transport
network
• Feature Rich Software
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
12
Agenda—GSR Optical
Internetworking
• Optical Internetworking Strategy
• GSR Technical Overview
• Applications
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
13
Cisco GSR 12000 Product
Overview
Cisco 12008
Cisco 12012
Bandwidth
10 Gbps to 40 Gbps
15 Gbps to 60 Gbps
Chassis Slots
8
12
Line Cards
7
11
Size
24.9”H x 17.5”W x 21”D
56”H x 17.5”W x 21”D
Power
AC, DC
AC, DC
Redundancy
RP, Power,
Line Card, Mbus, Fabric, Fans
RP, Power, Line Card,
Mbus, Fabric, Fans
Cisco Internal Use Only
Proprietary & Confidential
14
GSR Architecture/Packaging
Top
Blower
• Passive backplane
Cable
Management
• Maintenance bus
• Nondisruptive hot
swap for all elements
GRP
Air Intake
Filter
• Multilevel FRU
diagnostics
• Single-side
serviceability access
• Fiber/cable management
Line Cards
Switch Fabric
(Behind Filter)
Power
Supplies
Bottom
Blower
• NEBS/ETSI
Cisco Internal Use Only
Proprietary & Confidential
15
Cisco 12000 Gigabit Switch Router
• Gigabit switching performance
Cisco 12008–10 to 40 Gbps
Cisco 12012–15 to 60 Gbps
Line
Card
Line
Card
Line
Card
Line
Card
• High-speed interfaces:
OC48/STM16, OC12/STM-4, OC3/STM-1, DS3
PoS and ATM interfaces
Gigabit Ethernet
• Scalable network services:
Silicon queuing engine for QoS
Optimized multicast support
• Carrier class/robustness
Multiple levels of redundancy
NEBS/ETSI
Automatic Protection Switching (APS)
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
•••
Line
Card
Route
Processor
Multigigabit
Crossbar
Fabric
•••
Line
Card
Route
Processor
16
GSR Architecture—Switch Fabric
• Supports high density
of interfaces at OC-48
and beyond - 5 Gbps
per slot
4 x 1.25 Gb/s
Line Card
• Synchronous and
fully redundant
Control
and
Fabric
(CSC)
Line Card
Fabric
(SFC)
No data loss on switch-over
• Virtual output queues
eliminate “head-of-line
blocking”
4 x 1.25 Gb/s
Fabric
(SFC)
Line Card
(or RP)
• Combined scheduling
of unicast and multicast
traffic
Fabric
(SFC)
Control
16 x 16
and
Fabric
Fabric
(CSC)
Line Card
(or RP)
• Hardware assist multicast
packet replication and partial
fulfillment
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
17
GSR Architecture—Availability
• Dual-route processors
Line
Card
Line
Card
Line
Card
Line
Card
• Distributed forwarding tables
• Switch fabric redundancy
Failure/removal without data loss
• Redundant power supplies
DC and AC
• Redundant cooling systems
• Maintenance bus
•••
Line
Card
Route
Processor
• Line card protection
•••
Line
Card
Route
Processor
Maintenance Bus
SONET 1:1 APS
Cisco Internal Use Only
Multigigabit
Crossbar
Fabric
Fan/Blower
System
Proprietary & Confidential
Power
Supply
18
GSR Route Processor
• Control plane only
• Processing and memory
for up to one million
routes/prefixes
200 MHz RISC processor
64 MB to 256MB DRAM
20 MB Flash memory
Console, Aux, and
10/100 Ethernet port
Line
Card
Line
Card
Line
Card
Line
Card
•••
Line
Card
Route
Processor
Multigigabit
Crossbar
Fabric
•••
Line
Card
Route
Processor
• Optional redundancy
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
19
GSR 12000 Line Card
Overview
• GSR offers industry leading
interface breadth for all
environments
OC48/STM-16 PoS
OC12/STM-4 PoS
OC3/STM-1 PoS
OC12/STM-4 ATM
OC3/STM-1 ATM
Ch OC12 to DS3
Ch OC12 to STS3
Gigabit Ethernet
– Backbone, Aggregation, Intra-PoP
• Optimized for queuing and forwarding
– Up to one million forwarding entries
• Hardware assist for high-performance
switching at OC-N line rates
250 Kpps for OC-3 and OC-12
4 Mpps for OC-48 (bi-directional)
• Silicon queuing engine for QoS
• Interfaces types
– PoS, ATM, LAN (GE, FE*)
• Multiple Optics
– Multimode
– Single Mode
Cisco Internal Use Only
Proprietary & Confidential
(IR, LR)
20
GSR PoS Line Cards
• Interface bandwidth
Tx
1 port OC48/STM-16
1 port OC-12/STM-4
4port OC-3/STM-1
Rx
Route
Table
Burst
Buffer
• Memory Options
CPU memory: 32 MB to 128 MB
Packet memory: 32 MB to 256 MB
Burst
Buffer
L3 Switch
Processor
• Optics options
Multimode, Single Mode (IR, LR)

Buffer
Memory
Layer 3 Options
Silicon
Queuing
Engine
Precedence Control
Access Control List (ACL)
WRED
HSRP
Tag Switching
CAR
Netflow Data Export
Cisco Internal Use Only
Buffer
Memory
DC
Power
System
Silicon
Queuing
Engine
Fabric Interface
Proprietary & Confidential
21
GSR ATM Line Cards
• Interface bandwidth
1 port OC-12/STM-4
4port OC-3/STM-1
Tx
Rx
Tx/Rx SAR Engine
• Memory Options
CPU memory: 32 MB to 128 MB
Packet memory: 32 MB to 256 MB
Output Queue Controller
• Optics options
Route
Table
Multimode and Single Mode (IR)
• Output Queue Controller
Manages 4 layer 3 Queues
Manages 2K ATM Queues
• ATM Software
RFC 1483 PVC and SVC
RFC 1577l
Inverse ARP
WRED
Tag Switching
ATM MIB
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
L3 Switch
Processor
Buffer
Memory
Buffer
Memory
Silicon
Queuing
Engine
DC
Power
System
Silicon
Queuing
Engine
Fabric Interface
22
Channelized Line Card
• Interface bandwidth
1 port STM-4 channelized to four VC-4
1 port OC12 channelized to 4 x STS-3c
1 port OC12 channelized to 12 DS-3
(DCEF load sharing across some or all of the
embedded channels)
Tx
Rx
Route
Table
Burst
Buffer
L3 Switch
Processor
• Memory Options
CPU memory: 32 MB to 128 MB
Packet memory: 32 MB to 256 MB
• Optics options
Burst
Buffer
Buffer
Memory
Buffer
Memory
Single Mode (IR)
• Software
Online Insertion & Removal (OIR)
FIB Switching
WRED
Frame Relay
IP Multicast
QoS/CoS support
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
Silicon
Queuing
Engine
DC
Power
System
Silicon
Queuing
Engine
Fabric Interface
23
GSR LAN Interface Cards
• Interface bandwidth
1 port Gigabit Ethernet
SX (Multi mode)
LH (Single Mode)
Tx
Rx
8 port Fast Ethernet (CY 1Q99)
• Memory Options
CPU memory: 32 MB to 128 MB
Packet memory: 32 MB to 256 MB
Route
Table
Burst
Buffer
L3 Switch
Processor
• Optics options
Multimode, Single Mode (IR)
• Software
Auto-negotiation
Flow Control (transmit)
Precedence Control
ACL
WRED
HSRP
Tag Switching
CAR
Netflow Data Export
ISL
802.1Q
GE MIB
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
Burst
Buffer
Buffer
Memory
Buffer
Memory
Silicon
Queuing
Engine
DC
Power
System
Silicon
Queuing
Engine
Fabric Interface
24
Distributed Cisco Express
Forwarding (dCEF)
Master FIB and
Adjacency Table
Populated by
Routing Table
Master FIB
Table
Routing Table
R5000 CPU
Adjacency
Table
GRP
Slave FIB
Table
Adjacency
Table
ASIC
GSR Line Card
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
Multigigabit
Crossbar Fabric
Slave FIB
Table
Adjacency
Table
ASIC
GSR Line Card
25
Distributed CEF on the Line
Cards (dCEF) (Cont.)
Slave FIB and
Adjacency Table
on Line Cards;
Updated as
Needed by
Master
Master FIB
Table
Routing Table
R5000 CPU
Adjacency
Table
GRP
IPC
IPC
Slave FIB
Table
Adjacency
Table
Multigigabit
Crossbar Fabric
Slave FIB
Table
Adjacency
Table
ASIC
ASIC
GSR Line Card
GSR Line Cards
Inter-Process Communications (IPC)
Mechanism Ensures Synchronized FIB Info.
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
26
Cisco Express Forwarding
Layer 3 Switching
X-bar Switching Fabric
4
5
3
2
Route Processor
Incoming
Datagrams
4
Tx Line Card
Rx Line Card 2
Outgoing
Datagrams
5
4
4
A
C
B
D
E
1
Forwarding Information
Routing Information
Buffers
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
17 Virtual Output Queues
FIB
Layer 3 Processor
Silicon Queuing
Engine
Adjacency Table
27
Feature Rich Software
Cisco IOS® Network Services
• Scalable Industrial-Strength
routing
• Quality of service
• Traffic engineering
• SONET/SDH protection
• Tag Switching
• Express forwarding
Global Internet
Enterprise
Backbone
Internet
Border
(NAP)
Internet
Backbone
Dedicated
Access
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
Corporate
Servers
User
Network
28
Agenda—GSR Optical
Internetworking
• Optical Internetworking Strategy
• GSR Technical Overview
• Applications
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
29
Optical Internetworking Migration
• Minimize optical/
electronic conversions
• Optical management
• Standard and low-cost
2.5-10 Gbps WDM
transponder interface
Old World
OC-3/12
SONET/S OC-48
DH
Terminal
SONET/S
DH
Terminal
SONET/S
DH
Terminal
12000
OC-48
Regenerator
12000
New World
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
30
Old World - SONET/SDH-Based TDM
Transport
• Accepted transport
architecture
Nx OC-3
GSR
• Logical pt-pt over
physical ring
SONET/SDH
Ring
• Protection and management
• Large overhead for
bursty data
• Good protection, but
expensive
OC-3
7500
OC-3
OC-3
7500
Optimized for TDM Voice, not Data
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
31
SONET/SDH Aggregation
OC-3c
DS3
OC-3c
…
DS3
OC-3c
OC-3c
DS3
OC-12 TDM Channelized
DS3
ADM
OC-3
OC-48c
SONET
TDM Ring
ADM
ADM
DS3
OC-3
Customer
Aggregation
NW98_Asia_105
© 1998, Cisco Systems, Inc.
OC-12
OC-12
ADM
1471_07F8_c1
OC-12 TDM Channelized
OC-48c
2.5Gbit/s
Statistically
Multiplexed
Core
OC-48c
OC-48c
Backbone
32
SONET/SDH-Based Aggregation
GS
R
• Eliminates multiple
connections
• Leverages protection
and redundancy
offered with
SONET/SDH
Channelized
OC-12
SONET/SDH
Ring
• Maximizes installed
base of SONET/SDH
transmission
• OC-12 to 12 x DS3
• OC-12 to 4 x OC-3
OC-3
DS3
DS3
7500
GSR
7200
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
33
GSR Channelized OC-12 Interface
• Leverages existing
SONET infrastructure
DS3
• Efficient DS3
customer aggregation
DS3
• 12 DS3s per interface
DS3
DS3
....
ADM
OC-3
OC-48c
SONET
TDM Ring
ADM
OC-12 TDM
Channelized
ADM
OC-12
ADM
DS3
OC-3
Customer
Aggregation
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
OC-48c
2.5Gbit/s
Statistically
Multiplexed
Core
OC-48c
OC-48c
Backbone
34
Flexibility in offering incremental bandwidth
Service providers looking to offer business customers incremental
bandwidth:bandwidth can be increased in increments of 155 Mbps with
load sharing between active STS-3c. Software bandwidth provisioning
eliminates the need for additional equipment and installation costs.
STS-3c
STS-3c
STS-3c
STS-3c
STS-3c
off
off
off
STS-3c
STS-3c
STS-3c
311 Mbps b/w
155 Mbps b/w
STS-3c
STS-3c
STS-3c
STS-3c
STS-3c
STS-3c
STS-3c
off
466 Mbps b/w
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
off
off
STS-3c
622 Mbps b/w
35
Line rate upgrade to legacy STM-4
interface
Service Providers needs to co-locate STM-4 to
multiplex four VC-4 into STM-4 SDH frame
Cisco 7500
ADM
OC-3c
4x OC-3c
GE GSR12000
Cisco 8500
AD
M
OC-12/STM-4
ADM
OC-48/STM-16
ADM
Ring
STM-4 terminal
New line card results in savings by eliminating the need for
an intermediate STM-4 terminal, reducing the number of fiber
pairs used and increasing port density on the STM-16
Cisco 7500
OC-3c
ADM
OC-12x 4 STS-3c
ADM
GE
1471_07F8_c1
NW98_Asia_105
Cisco 8500
© 1998, Cisco Systems, Inc.
GSR12000
OC-48/STM-16
ADM
Ring
36
Facilitating VPN implementations
Customer 3
campus B
Customer 2
campus B
Customer 1
campus B
OC-3c
Distribution network
with hard QoS using
TAG-VLANs
Customer 1
campus A
OC-3c
Customer 2
campus A
Customer 3
campus A
1471_07F8_c1
NW98_Asia_105
OC-12
ADM
OC-3c
Customer 4
campus B
OC-12
Service Providers
are able to offer a
hard QoS, bounded
within each
customer’s own
private network. The
new card provides a
private STS-3c path
through the public
SONET/SDH network
ADM
TDM or
WDM metro
Ring
ADM
OC-12
Customer 1
campus C
OC-3c
OC-3c
Customer 4
campus A
© 1998, Cisco Systems, Inc.
OC-3c
Customer 4
campus C
Customer 2
campus C
Customer 3
campus C
37
IP and ATM Integration
SONET/SDH
SONET/SDH
SONET/SDH Transport
SONET/SDH
SONET/SDH
Internet
Backbone
Four Fiber with APS Connectivity
LS 1010
BPX
ATM Network
IP Optimized
Distribution
Routers
DSLAMs
Multiservice
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
38
Intra-POP connectivity
Keep network
expansions cost
down by deploying a
low cost intra-POP
connection between
GSR12000 and other
edge routers and
switches
GE link
GE links
Edge routers
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
39
Server Farm Access
Internet
Backbone
Cisco 12000
ge
For web-based SP
with large server
farms and looking
ISP the link
to lower
cost between the
high-speed
servers and the
interconnect
POP’s GSRs
server farm
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
40
Switched GE Uplinks
Internet
Backbone
OC-48
OC-48
Cisco 12000
ge
ge
Allow Service
Providers to keep up
with increase for low
cost and high
bandwidth capacity
POP interconnects
to enterprise GE
switches
ge
ge
Cisco 7500
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
41
Carrier-Class Optical IP Rings
• Retain key features of SONET/SDH
Topology/interfaces
Nx OC-3
Framing
Management
• Logical IP rings
Statistical multiplexed
OC-12
IP Transport
Ring
OC-3
Priority mechanism
Multicast
• MAC-layer protection
OC-3
Fast restoration
Bandwidth efficient
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
42
Data Optimized Aggregation
DS3
OC-48c
OC-3
IP Transport
Ring
Ethernet
NW98_Asia_105
© 1998, Cisco Systems, Inc.
2.5Gbit/s
Statistically
Multiplexed
Core
OC-48c
OC-48c
IP Transport
Ring
DS3
Customer
Aggregation
1471_07F8_c1
OC-48c
Backbone
Customer
Aggregation
43
SONET/IP
Access Networks
Inter-office
OC-12/48
Ring
• Coexistence not
replacement
• SONET/SDH
interoperability and
management
• Voice remains TDM
• Enterprise-focused
connections for data
IP
TDM
SONET TDM
CC and ADM
IP/SONET
ADM
Metro Business
Access
Ring
IP/SONET
Ethernet
ADM
OC-3/12
IP/SONET
ADM
Ethernet
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
DS1 (Voice)
44
Optical Internetworking Migration
Customer Aggregation
Backbone
T1/E1
ATM/
Frame Relay
T3/E3
OC-3c-OC-12c
ATM/
Frame Relay
OC-3/STM1
OC-3cOC-12c
T1/E1
SONET/SDH
T3/E3
SONET/SDH
OC-48c-OC-192c
Ethernet
Optical
Optical
OC-48c
1471_07F8_c1
NW98_Asia_105
© 1998, Cisco Systems, Inc.
45
0995_03F8_c1
NW98_US_105
© 1998, Cisco Systems, Inc.
46